-- Logs begin at Tue 2022-08-30 23:29:43 UTC, end at Wed 2022-08-31 00:32:36 UTC. -- Aug 31 00:01:23.301901 dv-cinder-852209-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 00:01:23.309542 dv-cinder-852209-8-smb devstack@keystone.service[81694]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 00:01:23.311505 dv-cinder-852209-8-smb devstack@keystone.service[81694]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:01:23 2022] *** Aug 31 00:01:23.311505 dv-cinder-852209-8-smb devstack@keystone.service[81694]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:01:23.311505 dv-cinder-852209-8-smb devstack@keystone.service[81694]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:01:23.311505 dv-cinder-852209-8-smb devstack@keystone.service[81694]: nodename: dv-cinder-852209-8-smb Aug 31 00:01:23.311505 dv-cinder-852209-8-smb devstack@keystone.service[81694]: machine: x86_64 Aug 31 00:01:23.311505 dv-cinder-852209-8-smb devstack@keystone.service[81694]: clock source: unix Aug 31 00:01:23.311505 dv-cinder-852209-8-smb devstack@keystone.service[81694]: pcre jit disabled Aug 31 00:01:23.311894 dv-cinder-852209-8-smb devstack@keystone.service[81694]: detected number of CPU cores: 4 Aug 31 00:01:23.311894 dv-cinder-852209-8-smb devstack@keystone.service[81694]: current working directory: / Aug 31 00:01:23.311894 dv-cinder-852209-8-smb devstack@keystone.service[81694]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:01:23.311894 dv-cinder-852209-8-smb devstack@keystone.service[81694]: your processes number limit is 47680 Aug 31 00:01:23.311894 dv-cinder-852209-8-smb devstack@keystone.service[81694]: your memory page size is 4096 bytes Aug 31 00:01:23.311894 dv-cinder-852209-8-smb devstack@keystone.service[81694]: detected max file descriptor number: 2048 Aug 31 00:01:23.311894 dv-cinder-852209-8-smb devstack@keystone.service[81694]: lock engine: pthread robust mutexes Aug 31 00:01:23.311894 dv-cinder-852209-8-smb devstack@keystone.service[81694]: thunder lock: enabled Aug 31 00:01:23.311894 dv-cinder-852209-8-smb devstack@keystone.service[81694]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 00:01:23.312315 dv-cinder-852209-8-smb devstack@keystone.service[81694]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:01:23.351937 dv-cinder-852209-8-smb devstack@keystone.service[81694]: Python main interpreter initialized at 0x5642dd2f09c0 Aug 31 00:01:23.351937 dv-cinder-852209-8-smb devstack@keystone.service[81694]: python threads support enabled Aug 31 00:01:23.351937 dv-cinder-852209-8-smb devstack@keystone.service[81694]: your server socket listen backlog is limited to 100 connections Aug 31 00:01:23.351937 dv-cinder-852209-8-smb devstack@keystone.service[81694]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:01:23.352300 dv-cinder-852209-8-smb devstack@keystone.service[81694]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:01:23.352380 dv-cinder-852209-8-smb devstack@keystone.service[81694]: *** Operational MODE: preforking *** Aug 31 00:01:23.352608 dv-cinder-852209-8-smb devstack@keystone.service[81694]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:01:23.352608 dv-cinder-852209-8-smb devstack@keystone.service[81694]: spawned uWSGI master process (pid: 81694) Aug 31 00:01:23.352816 dv-cinder-852209-8-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 00:01:23.353580 dv-cinder-852209-8-smb devstack@keystone.service[81694]: spawned uWSGI worker 1 (pid: 81709, cores: 1) Aug 31 00:01:23.353750 dv-cinder-852209-8-smb devstack@keystone.service[81694]: spawned uWSGI worker 2 (pid: 81710, cores: 1) Aug 31 00:01:23.357236 dv-cinder-852209-8-smb devstack@keystone.service[81694]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:01:27.622495 dv-cinder-852209-8-smb devstack@keystone.service[81709]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:01:27.622495 dv-cinder-852209-8-smb devstack@keystone.service[81709]: from cryptography.utils import int_from_bytes Aug 31 00:01:27.623319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:01:27.623319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: from cryptography.utils import int_from_bytes Aug 31 00:01:27.623733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:01:27.623733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: from cryptography.utils import int_from_bytes Aug 31 00:01:27.623843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:01:27.623843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: from cryptography.utils import int_from_bytes Aug 31 00:01:27.672146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:01:27.672349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:01:27.672439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:01:27.672530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] command line args: [] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:01:27.672603 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:01:27.672744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:01:27.672849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] command line args: [] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:01:27.672919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ================================================================================ {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:01:27.673043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:01:27.673192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] admin_token = **** {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.673367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ================================================================================ {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:01:27.673448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] config_dir = [] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.673542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] admin_token = **** {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.673614 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.673747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] config_dir = [] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.673835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] config_source = [] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.673903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.673972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] debug = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.674042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] config_source = [] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.674102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.674418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] debug = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.674418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.674571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.674638 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.674701 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.674764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.674909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.675013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.675094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.675461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.675599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] list_limit = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.675599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] log_config_append = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.675720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] list_limit = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.675785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.675856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] log_config_append = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.675921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] log_dir = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.675979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.676037 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] log_file = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.676099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] log_dir = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.676157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] log_file = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.676221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.676460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.676571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.676635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.676693 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.676820 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.676930 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.677004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.677064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.677216 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.677372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.677372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.677524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.677601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.677677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.677873 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.678010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.678100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.678172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.678295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.678374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.678556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.678657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.678741 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.678811 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.678988 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.679072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.679240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.679317 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.679511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.679737 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.679919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] publish_errors = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.679999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.680149 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.680233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] publish_errors = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.680378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.680459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.680537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.680599 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.680759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.680882 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.680990 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.681058 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.681180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] standard_threads = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.681296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.681450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.681548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] standard_threads = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.681684 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.681765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.681838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.681907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.681984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] use_journal = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.682099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.682227 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] use_json = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.682307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] use_journal = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.682384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] use_stderr = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.682462 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] use_json = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.682535 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] use_syslog = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.682605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] use_stderr = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.682691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.682771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] use_syslog = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.682938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:01:27.683035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.683206 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.683392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.683530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.683606 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.683677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.683745 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.683906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.683994 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.684139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.684227 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.684382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.684469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.684611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.684693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.684853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.684941 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.685095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.685177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.685369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.685450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.685595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.685676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.685835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.685921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.686061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.686147 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.686299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.686381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.686523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.686647 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.686755 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.686839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.686988 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.687064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.687244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.687331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.687480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.687605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.687758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.687831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.687947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.688024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.688198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.688283 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.688444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.688525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.688686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.688763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.688913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.689000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.689141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.689249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.689393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.689470 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.689619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.689704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.689849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.689926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.690092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.690168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.690318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.690402 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.690542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.690619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.690767 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.690842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.691012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.691097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.691240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.691315 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.691478 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.691554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.691700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.691784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.691928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.692004 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.692156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.692237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.692381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.692466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.692607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.692691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.692829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.692904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.693054 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.693270 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.693357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.693429 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.693528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.693612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.693751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.693838 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.693982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.694058 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.694206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.694287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.694431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.694514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.694657 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.694732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.694891 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.694965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.695114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.695198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.695343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.695423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.695571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.695647 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.695799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.695884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.696028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.696132 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.696261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.696369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.696481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.696576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.696712 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.696812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.696907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.697009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.697136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.697232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.697348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.697439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.697593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.697678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.697820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.697898 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.698047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.698128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.698282 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.698429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.698946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.699038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.699038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.699234 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.699234 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.699408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.699528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.699610 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.699690 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.699762 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.699883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.699958 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.700035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.700148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.700234 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.700306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.700419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.700493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.700605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.700679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.700799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.700871 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.701014 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.701093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.701265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.701347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.701510 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.701594 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.701740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.701816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.701969 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.702051 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.702199 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.702280 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.702427 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.702504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.702655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.702739 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.702887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.702965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.703133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.703214 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.703370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.703447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.703602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.703679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.703834 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.703911 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.704069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.704145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.704296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.704370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.704515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.704593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.704746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.704832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.704972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.705059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.705198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.705325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.705446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.705522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.705674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.705763 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.705897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.705974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.706122 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.706199 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.706354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.706438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.706585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.706663 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.706816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.706902 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.707051 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.707136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.707309 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.707421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.707546 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.707685 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.707792 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] auth.external = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.707929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.708016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.708161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] auth.external = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.708269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.708390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.708497 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.708683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.708762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] auth.password = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.708915 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.709002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] auth.token = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.709143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] auth.password = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.709240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.709396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] auth.token = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.709485 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.709633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.709713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.709904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.709982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.710150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.710234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.710396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.710474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.710622 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.710699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.710852 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] credential.caching = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.710930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.711087 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.711165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.711322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] credential.caching = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.711400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.711564 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.711691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.711803 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.711883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.712044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.712122 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.712275 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.712353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.712514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.712593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.712746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.712824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.712978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.713055 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.713244 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.713327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.713483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.713561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.713737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.713835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.714030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.714138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.714531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.714609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.714680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.714751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] federation.caching = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.714831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.714924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.715053 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.715170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.715280 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.715412 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.715499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] federation.caching = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.715638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.715739 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.715878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.715986 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.716107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.716232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.716359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.716445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.716594 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.716693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.716844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.716930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.717075 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.717153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.717350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.717429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.717583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.caching = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.717662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.717825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.717903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.718071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.718149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.718298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.718374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.caching = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.718518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.718596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.718762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.718840 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.718990 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.719069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.719222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.719302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.719467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.719550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.719695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.719773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.719929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.720008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.720153 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.720297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.720383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.720552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.720631 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.720785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.720863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.721017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.721103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.721272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.721355 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.721520 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.721598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.721769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.721859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.722015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.722102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.722258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.722335 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.722487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.722573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.722718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.722797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.722946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.723024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.723176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.723262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.723413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.723569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.723647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.723718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.723865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.723951 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.724091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.724168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.724327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.724403 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.724563 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.724649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.724795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.724872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.725035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.725112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.725299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.725391 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.725528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.725607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.725762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.725842 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.725989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.726075 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.726221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.726301 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.726448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.726526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.726680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.726757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.726914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.727032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.727139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.727214 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.727369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.727454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.727604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.727683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.727829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.727905 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.728060 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.728140 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.728303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.728381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.728543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.728620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.728769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.728847 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.728996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.729073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.729266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.729359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.729514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.729612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.729846 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.730177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.730177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.730434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.730524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.730598 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.730669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.730739 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.730885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.731008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.731100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.731175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.731347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.731471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.731549 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.731622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.731790 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.731914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.731992 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.732065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.732241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.732363 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.732456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.732531 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.732694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.732816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.732894 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.732966 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.733146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.733287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.733382 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.733464 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.733628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.733751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.733843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.733917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.734095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.734218 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.734296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.734367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.734543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.734666 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.734743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.734815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.734993 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.735116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.735207 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.735283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.735440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.735521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.735667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.735747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.735897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.735978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.736130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.736210 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.736369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.736449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.736597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.736677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.736825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.736904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.737050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.737133 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.737323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.737405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.737557 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.737639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.737788 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.737869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.738021 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.738104 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.738265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.738347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] resource.caching = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.738506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.738587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.738735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.738816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.738965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.739046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.739188 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] resource.caching = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.739265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.739437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.739515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.739680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.739757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.739913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.739990 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.740151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.740228 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.740388 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.740465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.740617 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.740692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] role.caching = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.740842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] role.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.740915 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.741072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.741149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.741331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.741420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.741564 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] role.caching = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.741642 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.741808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] role.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.741885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.742036 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.742120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.742278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.742354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.742521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.742597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.742762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.742846 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.743004 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.743080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.743228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.743304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.743470 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.743556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.743710 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.743786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.743952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.744027 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.744179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.744262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.744423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.744572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.744649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.744807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.744903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.745054 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.745133 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.745360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.745572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.745659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.745807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.745899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.746056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.746134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.746304 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.746380 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.746548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.746624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.746782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.746858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.747012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.747156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.747241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.747313 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.747458 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.747535 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.747706 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.747782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.747938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.748015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.748170 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.748247 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.748400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.748476 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.748632 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.748709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.748857 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.748934 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.749089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] token.caching = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.749166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.749345 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.749426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.749586 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.749662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.749815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.749891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.750050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] token.caching = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.750127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.750284 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.750360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.750518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.750593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.750749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.750826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.750987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.751063 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.751234 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.751311 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.751465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.751543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.751699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.751782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.751929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.752006 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.752172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.752250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.752402 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.752477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.752637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.752713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.752869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.752957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.753111 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.753188 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.753413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.connection = **** {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.753489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.753640 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.753737 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.753882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.753968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.754111 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.754188 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.754346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.754423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.connection = **** {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.754577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.754661 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.754808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.754885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.755039 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.755122 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.755269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.755353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.755508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.755586 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.755738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.755815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.755968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.756052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.756196 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.756278 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.756435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.756511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.756663 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.756747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.756900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.756980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.757124 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.757200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.757383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.757470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.757612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.757689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.757781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:01:27.757858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.758064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.758300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.758531 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:01:27.758698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:01:27.787260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.787478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.787691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.788673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.788913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.789133 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.796098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.797823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.823876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.824104 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.826086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.826287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.876576 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.877248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.925058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.925287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.926052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:27.926284 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.085014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.085306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.085453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.085702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.085891 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.086135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.086292 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.086406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.086630 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.086829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.087067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.087259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.109762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.109930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.109930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.110076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.110155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.110235 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.110401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.110527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.110611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.110689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.110754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.110826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.110998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.111135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.121915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.122578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.134658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.134788 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.134997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.135095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.135173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.135236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.135307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.135369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.135449 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.135614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.135739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.135825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.135905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.136252 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:01:28.152580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.152795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:01:28.153114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.153332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.153427 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:01:28.153611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:01:28.153702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.153828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.153910 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.154030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:01:28.154121 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.154243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.154401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.154524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.154874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.155125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.164118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.164397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.164666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.164802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.164960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.165107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.165339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.165628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.171980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.172609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.174873 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.175156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.175439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.175562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.175721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.175845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.175972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.176064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.176230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.176322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.176522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.176663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.176762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.176852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.177062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.177179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.177411 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.177586 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.177683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.177808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.177989 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.178256 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.200187 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.200990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.201673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.201954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.202473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.202762 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.206467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.206749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.207034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.207432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.207717 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.207999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.213489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.213773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.214553 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.214872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.217775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.218046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.218344 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.218623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.218971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.219259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.219542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.219827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.220086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.220362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.220556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.220643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.220847 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.220931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.221123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.221416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.236900 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.237177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.237920 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.238199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.241045 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.242088 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.244170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.244465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.245389 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.245689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.248989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.249970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.252120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.253090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.255227 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.255527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.255811 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.256201 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.256327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.256489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.256629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.256773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.256870 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.257151 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.257468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.257750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.272658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.272947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.273181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.273476 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.273596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.273884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.274156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.274419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.281324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.282877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.284235 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.284737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.285017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.286832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.287679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.287966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.288362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.288487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.288640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.288766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.288941 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.291308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.291594 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.291873 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.292207 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.292497 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.300264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.300549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.300925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.301182 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.301515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.301794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.302091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.305704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.305989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.306265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.306543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.306826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.307103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.307374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.317720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.320662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.323690 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.325163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.326800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.327086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.327378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.329748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.332776 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.333845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.335313 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.335882 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.337392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.338473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.340393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.340484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.340484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.340638 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.340716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.340790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.346074 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.347527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.348046 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.348341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.348622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.350412 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.350705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.350977 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.351240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.355622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.355911 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.356188 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.356463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.356732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.357000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.357300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.357576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.357854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.358113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.358382 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.358645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.358907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.359188 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.359372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.359658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.359932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.366828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:01:28.367106 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.367357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.367636 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.367900 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.368158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.368438 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.368708 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.368979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.369257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.369532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.369790 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.370046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.370392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:01:28.393532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5642dd2f09c0 pid: 81709 (default app) Aug 31 00:01:28.396796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb528a6a-1bd1-4593-9d7c-578024cb71fc None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:28.397084 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb528a6a-1bd1-4593-9d7c-578024cb71fc None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:28.397379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb528a6a-1bd1-4593-9d7c-578024cb71fc None None] PATH_INFO: `/v3` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:28.401644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Wed Aug 31 00:01:28 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:28.403946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5642dd2f09c0 pid: 81710 (default app) Aug 31 00:01:35.116432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa6340-c4f6-40c2-b040-d5a77848df68 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:35.116943 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa6340-c4f6-40c2-b040-d5a77848df68 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:35.116943 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa6340-c4f6-40c2-b040-d5a77848df68 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:35.118387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:35.129191 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f771b72-ba16-4587-9f99-bca0bf162b3b None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:35.129712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f771b72-ba16-4587-9f99-bca0bf162b3b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:35.129850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f771b72-ba16-4587-9f99-bca0bf162b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:35.202277 dv-cinder-852209-8-smb devstack@keystone.service[81710]: INFO dbcounter [None req-6f771b72-ba16-4587-9f99-bca0bf162b3b None None] Registered counter for database keystone Aug 31 00:01:35.223810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG oslo_db.sqlalchemy.engines [None req-6f771b72-ba16-4587-9f99-bca0bf162b3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81710) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:01:35.234299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writer thread running {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:01:35.420905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG passlib.handlers.bcrypt [None req-6f771b72-ba16-4587-9f99-bca0bf162b3b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81710) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 00:01:35.421246 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG passlib.handlers.bcrypt [None req-6f771b72-ba16-4587-9f99-bca0bf162b3b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81710) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 00:01:35.480042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-6f771b72-ba16-4587-9f99-bca0bf162b3b None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:35.481714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6f771b72-ba16-4587-9f99-bca0bf162b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:35.615747 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1/3] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 00:01:36.142590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa6340-c4f6-40c2-b040-d5a77848df68 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:36.216114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: INFO dbcounter [None req-12fa6340-c4f6-40c2-b040-d5a77848df68 None None] Registered counter for database keystone Aug 31 00:01:36.240956 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG oslo_db.sqlalchemy.engines [None req-12fa6340-c4f6-40c2-b040-d5a77848df68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:01:36.250295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writer thread running {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:01:36.370554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa6340-c4f6-40c2-b040-d5a77848df68 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:36.376047 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33911444-3f24-45cf-bad6-90358335b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:36.376672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33911444-3f24-45cf-bad6-90358335b2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:36.376943 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33911444-3f24-45cf-bad6-90358335b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:36.377237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33911444-3f24-45cf-bad6-90358335b2f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:36.386289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33911444-3f24-45cf-bad6-90358335b2f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:36.439038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: WARNING keystone.common.rbac_enforcer.enforcer [None req-33911444-3f24-45cf-bad6-90358335b2f5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 00:01:36.439360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33911444-3f24-45cf-bad6-90358335b2f5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:36.449824 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 3/4] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Aug 31 00:01:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:01:36.459783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f771b72-ba16-4587-9f99-bca0bf162b3b None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:36.483189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f771b72-ba16-4587-9f99-bca0bf162b3b None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:36.489029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84685b1-795b-46e6-b0b9-a6fcb8abc9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:36.490170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84685b1-795b-46e6-b0b9-a6fcb8abc9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:36.490451 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84685b1-795b-46e6-b0b9-a6fcb8abc9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:36.490718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84685b1-795b-46e6-b0b9-a6fcb8abc9c1 admin admin] PATH_INFO: `/v3/projects/59c418df945e4be9ac1404a45cc7dcfd` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:36.492290 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84685b1-795b-46e6-b0b9-a6fcb8abc9c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=59c418df945e4be9ac1404a45cc7dcfd)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:36.544324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c84685b1-795b-46e6-b0b9-a6fcb8abc9c1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 00:01:36.544671 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84685b1-795b-46e6-b0b9-a6fcb8abc9c1 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:36.549243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 2/5] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Aug 31 00:01:36 2022] GET /identity/v3/projects/59c418df945e4be9ac1404a45cc7dcfd => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:38.414737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462b036-d7ba-4793-a28a-d48157e057ec None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:38.415518 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462b036-d7ba-4793-a28a-d48157e057ec None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:38.415518 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462b036-d7ba-4793-a28a-d48157e057ec None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:38.422713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 4/6] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:38.431751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8e42-9298-42be-a77b-da05eeece468 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:38.432432 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8e42-9298-42be-a77b-da05eeece468 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:38.432611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8e42-9298-42be-a77b-da05eeece468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:38.456754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a2ac8e42-9298-42be-a77b-da05eeece468 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:38.458325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a2ac8e42-9298-42be-a77b-da05eeece468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:38.468675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 3/7] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 00:01:38.742953 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462b036-d7ba-4793-a28a-d48157e057ec None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:38.757519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462b036-d7ba-4793-a28a-d48157e057ec None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:38.763039 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34314ea3-21c8-4973-948d-1cabb061d027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:38.763653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34314ea3-21c8-4973-948d-1cabb061d027 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:38.763939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34314ea3-21c8-4973-948d-1cabb061d027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:38.764219 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34314ea3-21c8-4973-948d-1cabb061d027 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:38.777935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34314ea3-21c8-4973-948d-1cabb061d027 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:38.780811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34314ea3-21c8-4973-948d-1cabb061d027 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:38.794862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 5/8] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Aug 31 00:01:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:01:38.800508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac8e42-9298-42be-a77b-da05eeece468 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:38.810114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac8e42-9298-42be-a77b-da05eeece468 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:38.815621 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493a23f-7698-4226-bc70-7053ca487461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:38.816250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493a23f-7698-4226-bc70-7053ca487461 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:38.816523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493a23f-7698-4226-bc70-7053ca487461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:38.816788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493a23f-7698-4226-bc70-7053ca487461 admin admin] PATH_INFO: `/v3/users/5c98c93e9a414022917c074607b2165d` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:38.818221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493a23f-7698-4226-bc70-7053ca487461 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c98c93e9a414022917c074607b2165d)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:38.819937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493a23f-7698-4226-bc70-7053ca487461 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:38.821488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 4/9] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Aug 31 00:01:38 2022] GET /identity/v3/users/5c98c93e9a414022917c074607b2165d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:40.777315 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890cb16-a619-4698-918e-71bc59c77d0b None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:40.777916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890cb16-a619-4698-918e-71bc59c77d0b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:40.777916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890cb16-a619-4698-918e-71bc59c77d0b None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:40.779262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:40.784843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb94b2-4edf-4fd5-ab4e-84d7be229725 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:40.785390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb94b2-4edf-4fd5-ab4e-84d7be229725 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:40.785484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb94b2-4edf-4fd5-ab4e-84d7be229725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:40.804641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-1dfb94b2-4edf-4fd5-ab4e-84d7be229725 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:40.805857 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1dfb94b2-4edf-4fd5-ab4e-84d7be229725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:40.815234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780bb6-79a3-4174-aadc-e25eb1d6f118 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:40.815515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780bb6-79a3-4174-aadc-e25eb1d6f118 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:40.815793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780bb6-79a3-4174-aadc-e25eb1d6f118 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:40.817099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 7/11] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:01:40.822194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f10cc-1e93-4867-ac5e-39b7094af1df None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:40.822428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f10cc-1e93-4867-ac5e-39b7094af1df None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:40.822718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f10cc-1e93-4867-ac5e-39b7094af1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:40.868352 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG passlib.handlers.bcrypt [None req-128f10cc-1e93-4867-ac5e-39b7094af1df None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81709) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 00:01:40.868982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG passlib.handlers.bcrypt [None req-128f10cc-1e93-4867-ac5e-39b7094af1df None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81709) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 00:01:40.891686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 5/12] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:40.919067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-128f10cc-1e93-4867-ac5e-39b7094af1df None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:40.920776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-128f10cc-1e93-4867-ac5e-39b7094af1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:41.027275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 8/13] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:41.155634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb94b2-4edf-4fd5-ab4e-84d7be229725 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:41.182077 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:41.275835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb94b2-4edf-4fd5-ab4e-84d7be229725 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:41.287889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f10cc-1e93-4867-ac5e-39b7094af1df None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:41.311673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa404d4-4832-4972-a570-b1bebc736eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:41.312311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa404d4-4832-4972-a570-b1bebc736eeb None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:41.312589 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa404d4-4832-4972-a570-b1bebc736eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:41.312863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa404d4-4832-4972-a570-b1bebc736eeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:41.324158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa404d4-4832-4972-a570-b1bebc736eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-9fa404d4-4832-4972-a570-b1bebc736eeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:01:41.333019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:01:41.334163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:01:41.334995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:01:41.334995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:01:41.334995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:01:41.334995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:01:41.334995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:01:41.334995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:01:41.334995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:01:41.334995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:01:41.334995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:01:41.334995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:01:41.334995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:01:41.334995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:01:41.334995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 6/14] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:01:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:01:41.340242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa404d4-4832-4972-a570-b1bebc736eeb None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:41.390136 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f10cc-1e93-4867-ac5e-39b7094af1df None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:41.392504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:41.425686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:41.438499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e436cc-e621-4c41-bd79-25b72ecafd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:41.439389 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e436cc-e621-4c41-bd79-25b72ecafd80 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:41.439670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e436cc-e621-4c41-bd79-25b72ecafd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:41.439938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e436cc-e621-4c41-bd79-25b72ecafd80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:41.444389 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa404d4-4832-4972-a570-b1bebc736eeb None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:41.478851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b246dd1-4d93-474b-9b6c-d6504612fa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:41.479680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b246dd1-4d93-474b-9b6c-d6504612fa8b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:41.479793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b246dd1-4d93-474b-9b6c-d6504612fa8b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:41.480042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b246dd1-4d93-474b-9b6c-d6504612fa8b None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:41.480714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b246dd1-4d93-474b-9b6c-d6504612fa8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:41.481013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b246dd1-4d93-474b-9b6c-d6504612fa8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:41.482422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b246dd1-4d93-474b-9b6c-d6504612fa8b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:41.494764 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 7/15] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:01:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:41.500573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b246dd1-4d93-474b-9b6c-d6504612fa8b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:41.509611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e436cc-e621-4c41-bd79-25b72ecafd80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:41.511251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e436cc-e621-4c41-bd79-25b72ecafd80 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:41.603581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b246dd1-4d93-474b-9b6c-d6504612fa8b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:41.616567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 9/16] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:01:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:01:41.622544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e436cc-e621-4c41-bd79-25b72ecafd80 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:41.625332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:41.638202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9291ac-e0de-47ee-8dcf-340678ac0da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:41.638844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9291ac-e0de-47ee-8dcf-340678ac0da2 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:41.639122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9291ac-e0de-47ee-8dcf-340678ac0da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:41.639392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9291ac-e0de-47ee-8dcf-340678ac0da2 None admin] PATH_INFO: `/v3/users/5c98c93e9a414022917c074607b2165d` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:41.640550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9291ac-e0de-47ee-8dcf-340678ac0da2 None admin] RBAC: Authorizing `identity:get_user(user_id=5c98c93e9a414022917c074607b2165d)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:41.642055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9291ac-e0de-47ee-8dcf-340678ac0da2 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:41.643638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 8/17] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:01:41 2022] GET /identity/v3/users/5c98c93e9a414022917c074607b2165d => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:01:41.649109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9291ac-e0de-47ee-8dcf-340678ac0da2 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:41.665617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:41.724469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e436cc-e621-4c41-bd79-25b72ecafd80 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:41.753280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9291ac-e0de-47ee-8dcf-340678ac0da2 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:41.758254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cd095-67c6-4474-a91c-0fd7518260b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:41.759152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cd095-67c6-4474-a91c-0fd7518260b2 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:41.759427 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cd095-67c6-4474-a91c-0fd7518260b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:41.759698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cd095-67c6-4474-a91c-0fd7518260b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:41.779196 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cd095-67c6-4474-a91c-0fd7518260b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:41.780704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cd095-67c6-4474-a91c-0fd7518260b2 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:41.788196 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c864d-b265-4de0-be62-d7dca935717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:41.788827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c864d-b265-4de0-be62-d7dca935717d None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:41.789110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c864d-b265-4de0-be62-d7dca935717d None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:41.789410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c864d-b265-4de0-be62-d7dca935717d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:41.790528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c864d-b265-4de0-be62-d7dca935717d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:41.792003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c864d-b265-4de0-be62-d7dca935717d None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:41.793695 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 9/18] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:01:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-035cd095-67c6-4474-a91c-0fd7518260b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:01:41.799549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:01:41.800498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:01:41.801325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:01:41.801325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:01:41.801325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:01:41.801490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c864d-b265-4de0-be62-d7dca935717d None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:41.801567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:01:41.806549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cd095-67c6-4474-a91c-0fd7518260b2 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:41.863323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:41.879141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:41.899332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c864d-b265-4de0-be62-d7dca935717d None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:41.910592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cd095-67c6-4474-a91c-0fd7518260b2 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:41.933358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e9131-14ce-488e-97ac-f8ea49946dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:41.933973 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e9131-14ce-488e-97ac-f8ea49946dca None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:41.934250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e9131-14ce-488e-97ac-f8ea49946dca None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:41.934522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e9131-14ce-488e-97ac-f8ea49946dca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:41.935246 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e9131-14ce-488e-97ac-f8ea49946dca None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.domain.id=default, user.id=5c98c93e9a414022917c074607b2165d) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:41.935556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e9131-14ce-488e-97ac-f8ea49946dca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:41.937008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e9131-14ce-488e-97ac-f8ea49946dca None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:41.943554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef9866-f666-4f5a-aa2f-91bc06ac4891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:41.943693 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 10/20] 10.222.0.60 () {56 vars in 1322 bytes} [Wed Aug 31 00:01:41 2022] GET /identity/v3/role_assignments?user.id=5c98c93e9a414022917c074607b2165d&scope.domain.id=default&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:01:41.944162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef9866-f666-4f5a-aa2f-91bc06ac4891 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:41.944440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef9866-f666-4f5a-aa2f-91bc06ac4891 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:41.944712 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef9866-f666-4f5a-aa2f-91bc06ac4891 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:41.945388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef9866-f666-4f5a-aa2f-91bc06ac4891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:41.945692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef9866-f666-4f5a-aa2f-91bc06ac4891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:41.947071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef9866-f666-4f5a-aa2f-91bc06ac4891 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:41.966762 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 11/21] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:44.144297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ebc2-398b-406b-ab33-634d09e4c95e None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:44.144803 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ebc2-398b-406b-ab33-634d09e4c95e None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:44.144803 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ebc2-398b-406b-ab33-634d09e4c95e None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:44.146190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 11/22] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:01:44.151775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12025743-a00e-4586-82cd-47b18caeff6c None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:44.152211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12025743-a00e-4586-82cd-47b18caeff6c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:44.152396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12025743-a00e-4586-82cd-47b18caeff6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:44.170420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c3c6-2c47-4b49-9c48-62cbd7a371cb None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:44.170752 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c3c6-2c47-4b49-9c48-62cbd7a371cb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:44.170958 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c3c6-2c47-4b49-9c48-62cbd7a371cb None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:44.172548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 12/23] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:01:44.185573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-12025743-a00e-4586-82cd-47b18caeff6c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:44.188109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e09475-3792-4897-bf01-38f0cf62d8a4 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:44.188393 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e09475-3792-4897-bf01-38f0cf62d8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:44.188683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e09475-3792-4897-bf01-38f0cf62d8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:44.193572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-12025743-a00e-4586-82cd-47b18caeff6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:44.226588 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-28e09475-3792-4897-bf01-38f0cf62d8a4 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:44.227786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-28e09475-3792-4897-bf01-38f0cf62d8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:44.351465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 12/24] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:44.353259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c8afa-46fe-45c9-a3c4-2cb4b19fc5f7 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:44.355043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c8afa-46fe-45c9-a3c4-2cb4b19fc5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:44.361825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c8afa-46fe-45c9-a3c4-2cb4b19fc5f7 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:44.366188 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 13/25] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:44 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:44.373015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50bda7-ae78-42eb-9081-b78884bc6d1a None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:44.373675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50bda7-ae78-42eb-9081-b78884bc6d1a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:44.374163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50bda7-ae78-42eb-9081-b78884bc6d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:44.399830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 13/26] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:01:44.411493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-de50bda7-ae78-42eb-9081-b78884bc6d1a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:44.412948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-de50bda7-ae78-42eb-9081-b78884bc6d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:44.477732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:44.511466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 14/27] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:44.810718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e09475-3792-4897-bf01-38f0cf62d8a4 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:44.821171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50bda7-ae78-42eb-9081-b78884bc6d1a None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:44.946820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:44.973591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e09475-3792-4897-bf01-38f0cf62d8a4 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:45.038630 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22247ba5-d09c-4810-9344-57493de30869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:45.039298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22247ba5-d09c-4810-9344-57493de30869 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.039554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22247ba5-d09c-4810-9344-57493de30869 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.039827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22247ba5-d09c-4810-9344-57493de30869 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.041169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50bda7-ae78-42eb-9081-b78884bc6d1a None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:45.051376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22247ba5-d09c-4810-9344-57493de30869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-22247ba5-d09c-4810-9344-57493de30869 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:01:45.056308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:01:45.057138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:01:45.057962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:01:45.057962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:01:45.057962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:01:45.057962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:01:45.057962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:01:45.057962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:01:45.057962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:01:45.057962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:01:45.057962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:01:45.057962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:01:45.057962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:01:45.057962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:01:45.057962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 14/28] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:01:45.058589 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22247ba5-d09c-4810-9344-57493de30869 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:45.110692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0468-67f0-4e53-ab0d-16e6d835fc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:45.111803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0468-67f0-4e53-ab0d-16e6d835fc9a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.112305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0468-67f0-4e53-ab0d-16e6d835fc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.112762 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0468-67f0-4e53-ab0d-16e6d835fc9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.124473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f0468-67f0-4e53-ab0d-16e6d835fc9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:45.126329 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f0468-67f0-4e53-ab0d-16e6d835fc9a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-501f0468-67f0-4e53-ab0d-16e6d835fc9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:01:45.141821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:01:45.142725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:01:45.143515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:01:45.143515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:01:45.143515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:01:45.145639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 15/29] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:01:45.151186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0468-67f0-4e53-ab0d-16e6d835fc9a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:45.162038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22247ba5-d09c-4810-9344-57493de30869 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:45.181728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:45.199375 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2539b1-89bc-41d3-a7fd-922d8d82aa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:45.199981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2539b1-89bc-41d3-a7fd-922d8d82aa0a None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.200249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2539b1-89bc-41d3-a7fd-922d8d82aa0a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.200512 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2539b1-89bc-41d3-a7fd-922d8d82aa0a None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.201309 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2539b1-89bc-41d3-a7fd-922d8d82aa0a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:45.202687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2539b1-89bc-41d3-a7fd-922d8d82aa0a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:45.213677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:45.265380 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0468-67f0-4e53-ab0d-16e6d835fc9a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:45.305330 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b125528-a714-4037-b364-b71cd747e704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:45.306263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b125528-a714-4037-b364-b71cd747e704 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.306705 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b125528-a714-4037-b364-b71cd747e704 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.307134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b125528-a714-4037-b364-b71cd747e704 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.308224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b125528-a714-4037-b364-b71cd747e704 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:45.308700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b125528-a714-4037-b364-b71cd747e704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:45.310262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b125528-a714-4037-b364-b71cd747e704 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:45.324412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 16/30] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:01:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:45.326058 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74010c-4be0-426f-ad1e-fd7bb928b396 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.326507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74010c-4be0-426f-ad1e-fd7bb928b396 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.326964 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74010c-4be0-426f-ad1e-fd7bb928b396 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.328307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 17/31] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:45.329160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74010c-4be0-426f-ad1e-fd7bb928b396 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:45.350823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 15/32] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 31 00:01:45 2022] POST /identity/v3/roles => generated 219 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:01:45.355762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c90d7f-5cc1-4584-a3fc-2a44b7a8f11b None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.355762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c90d7f-5cc1-4584-a3fc-2a44b7a8f11b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.355762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c90d7f-5cc1-4584-a3fc-2a44b7a8f11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.385903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a0c90d7f-5cc1-4584-a3fc-2a44b7a8f11b None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:45.387577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a0c90d7f-5cc1-4584-a3fc-2a44b7a8f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:45.450471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:45.467441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74010c-4be0-426f-ad1e-fd7bb928b396 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:45.549126 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beead8db-665d-445a-8fa8-4ea429ab988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:45.550238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beead8db-665d-445a-8fa8-4ea429ab988c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.551420 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beead8db-665d-445a-8fa8-4ea429ab988c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.551858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beead8db-665d-445a-8fa8-4ea429ab988c None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.553430 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beead8db-665d-445a-8fa8-4ea429ab988c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:45.554813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beead8db-665d-445a-8fa8-4ea429ab988c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:45.557899 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beead8db-665d-445a-8fa8-4ea429ab988c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:45.564626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 16/33] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:45.565736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c90d7f-5cc1-4584-a3fc-2a44b7a8f11b None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:45.581807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 18/34] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:45.587689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beead8db-665d-445a-8fa8-4ea429ab988c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:45.720649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c90d7f-5cc1-4584-a3fc-2a44b7a8f11b None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:45.729133 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beead8db-665d-445a-8fa8-4ea429ab988c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:45.755145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:45.769395 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24e7eb-36cb-4889-95ab-22328a544afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:45.770014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24e7eb-36cb-4889-95ab-22328a544afd None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.770290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24e7eb-36cb-4889-95ab-22328a544afd None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.770559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24e7eb-36cb-4889-95ab-22328a544afd None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.770930 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35151810-0faa-43bf-9f7f-ff6cfbb73fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:45.771489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24e7eb-36cb-4889-95ab-22328a544afd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:45.771983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35151810-0faa-43bf-9f7f-ff6cfbb73fad None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.772455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35151810-0faa-43bf-9f7f-ff6cfbb73fad None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.772901 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35151810-0faa-43bf-9f7f-ff6cfbb73fad None admin] PATH_INFO: `/v3/users/5c98c93e9a414022917c074607b2165d` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.772997 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24e7eb-36cb-4889-95ab-22328a544afd None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:45.774341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35151810-0faa-43bf-9f7f-ff6cfbb73fad None admin] RBAC: Authorizing `identity:get_user(user_id=5c98c93e9a414022917c074607b2165d)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:45.776172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35151810-0faa-43bf-9f7f-ff6cfbb73fad None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:45.778145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 17/35] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:01:45 2022] GET /identity/v3/users/5c98c93e9a414022917c074607b2165d => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:45.779471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7944f98-1282-45bc-b0bf-7379d2339b7b None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.779804 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7944f98-1282-45bc-b0bf-7379d2339b7b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.780141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7944f98-1282-45bc-b0bf-7379d2339b7b None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.781540 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 18/36] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:45.782794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67c5aa-2e23-4991-be52-26bfd8e43c36 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.783215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67c5aa-2e23-4991-be52-26bfd8e43c36 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.783550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67c5aa-2e23-4991-be52-26bfd8e43c36 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.784932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 19/37] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:45.789478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67c5aa-2e23-4991-be52-26bfd8e43c36 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:45.894302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67c5aa-2e23-4991-be52-26bfd8e43c36 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:45.916442 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 19/38] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:01:45 2022] POST /identity/v3/projects => generated 301 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:01:45.918274 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788cd1c-4e57-4d20-9ea1-4a328ca82382 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.918570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788cd1c-4e57-4d20-9ea1-4a328ca82382 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.918845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788cd1c-4e57-4d20-9ea1-4a328ca82382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.925841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:45.941607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-8788cd1c-4e57-4d20-9ea1-4a328ca82382 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:45.943183 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8788cd1c-4e57-4d20-9ea1-4a328ca82382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:45.943607 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f0950-5469-4596-83e0-ae91b3ac58bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:45.944261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f0950-5469-4596-83e0-ae91b3ac58bb None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.944541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f0950-5469-4596-83e0-ae91b3ac58bb None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.944813 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f0950-5469-4596-83e0-ae91b3ac58bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.946053 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f0950-5469-4596-83e0-ae91b3ac58bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:45.947598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f0950-5469-4596-83e0-ae91b3ac58bb None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:45.949597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 20/39] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:01:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:45.955590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6a43-9901-4cb7-bb62-da75f16831f2 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:45.955889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6a43-9901-4cb7-bb62-da75f16831f2 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:45.956143 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6a43-9901-4cb7-bb62-da75f16831f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:45.976920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-8bee6a43-9901-4cb7-bb62-da75f16831f2 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:45.978114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8bee6a43-9901-4cb7-bb62-da75f16831f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:46.023313 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 20/40] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:46.024154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788cd1c-4e57-4d20-9ea1-4a328ca82382 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:46.061641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:46.071728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 21/41] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:46.073827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee6a43-9901-4cb7-bb62-da75f16831f2 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:46.136661 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788cd1c-4e57-4d20-9ea1-4a328ca82382 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:46.170939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:46.175149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766bb0d-ee99-4058-8e2c-ebfed855b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:46.175808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766bb0d-ee99-4058-8e2c-ebfed855b891 None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:46.176047 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766bb0d-ee99-4058-8e2c-ebfed855b891 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:46.176318 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766bb0d-ee99-4058-8e2c-ebfed855b891 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:46.177037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766bb0d-ee99-4058-8e2c-ebfed855b891 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:46.178634 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766bb0d-ee99-4058-8e2c-ebfed855b891 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:46.182701 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee6a43-9901-4cb7-bb62-da75f16831f2 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:46.211391 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 21/42] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 31 00:01:46 2022] POST /identity/v3/roles => generated 225 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:01:46.232207 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dfd5f-c142-4eb4-92c3-fcf9b7330169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:46.234076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dfd5f-c142-4eb4-92c3-fcf9b7330169 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:46.234797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dfd5f-c142-4eb4-92c3-fcf9b7330169 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:46.235281 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dfd5f-c142-4eb4-92c3-fcf9b7330169 None admin] PATH_INFO: `/v3/domains/default/users/5c98c93e9a414022917c074607b2165d/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:46.237968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dfd5f-c142-4eb4-92c3-fcf9b7330169 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5c98c93e9a414022917c074607b2165d, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:46.239728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dfd5f-c142-4eb4-92c3-fcf9b7330169 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:46.267870 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 22/43] 10.222.0.60 () {58 vars in 1361 bytes} [Wed Aug 31 00:01:46 2022] PUT /identity/v3/domains/default/users/5c98c93e9a414022917c074607b2165d/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:01:46.312465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766bb0d-ee99-4058-8e2c-ebfed855b891 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:46.392215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dfd5f-c142-4eb4-92c3-fcf9b7330169 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:46.446997 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766bb0d-ee99-4058-8e2c-ebfed855b891 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:46.490571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33133f-bdeb-4c74-b340-659c6531f6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:46.491957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33133f-bdeb-4c74-b340-659c6531f6b7 None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:46.492658 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33133f-bdeb-4c74-b340-659c6531f6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:46.493282 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33133f-bdeb-4c74-b340-659c6531f6b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:46.494145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33133f-bdeb-4c74-b340-659c6531f6b7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:46.496108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33133f-bdeb-4c74-b340-659c6531f6b7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:46.517904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 22/44] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 31 00:01:46 2022] POST /identity/v3/roles => generated 223 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:01:46.578110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:46.638074 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dfd5f-c142-4eb4-92c3-fcf9b7330169 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:46.680223 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c92cb-d075-4621-85c6-04d176f79f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:46.680873 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c92cb-d075-4621-85c6-04d176f79f60 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:46.681147 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c92cb-d075-4621-85c6-04d176f79f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:46.681459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c92cb-d075-4621-85c6-04d176f79f60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:46.682800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c92cb-d075-4621-85c6-04d176f79f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:46.684225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c92cb-d075-4621-85c6-04d176f79f60 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:46.685871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 23/45] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:01:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:01:46.691757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33133f-bdeb-4c74-b340-659c6531f6b7 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:46.748157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:46.796637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33133f-bdeb-4c74-b340-659c6531f6b7 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:46.829781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cdcd6-3f0c-4996-83f5-06c4303efa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:46.830388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cdcd6-3f0c-4996-83f5-06c4303efa89 None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:46.830664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cdcd6-3f0c-4996-83f5-06c4303efa89 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:46.830929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cdcd6-3f0c-4996-83f5-06c4303efa89 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:46.831572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cdcd6-3f0c-4996-83f5-06c4303efa89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:46.832999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cdcd6-3f0c-4996-83f5-06c4303efa89 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:46.872618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 23/46] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:01:46 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:01:48.333226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42686a38-56c6-4d0d-b894-5c5f8a865001 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:48.333795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42686a38-56c6-4d0d-b894-5c5f8a865001 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:48.333795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42686a38-56c6-4d0d-b894-5c5f8a865001 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:48.335125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 24/47] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:48.340695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d75de8-1214-45df-ac0e-425f609836e5 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:48.341141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d75de8-1214-45df-ac0e-425f609836e5 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:48.341141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d75de8-1214-45df-ac0e-425f609836e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:48.360818 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d3d75de8-1214-45df-ac0e-425f609836e5 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:48.362150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d3d75de8-1214-45df-ac0e-425f609836e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:48.433746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 24/48] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:48.708976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42686a38-56c6-4d0d-b894-5c5f8a865001 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:48.816609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42686a38-56c6-4d0d-b894-5c5f8a865001 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:48.830765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba627ae2-0c5d-48b1-aa64-953502c41331 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:48.831168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba627ae2-0c5d-48b1-aa64-953502c41331 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:48.831590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba627ae2-0c5d-48b1-aa64-953502c41331 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:48.832973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 25/49] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:01:48.835976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:48.837970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13831-8902-4ca7-b7f6-65237c1d0743 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:48.838393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13831-8902-4ca7-b7f6-65237c1d0743 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:48.838856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13831-8902-4ca7-b7f6-65237c1d0743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:48.855204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe2fc2-2a65-4420-971b-e6a12271b52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:48.855903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe2fc2-2a65-4420-971b-e6a12271b52e None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:48.856176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe2fc2-2a65-4420-971b-e6a12271b52e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:48.856448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe2fc2-2a65-4420-971b-e6a12271b52e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:48.857846 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-3da13831-8902-4ca7-b7f6-65237c1d0743 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:48.859100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-3da13831-8902-4ca7-b7f6-65237c1d0743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:48.869323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe2fc2-2a65-4420-971b-e6a12271b52e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-bdbe2fc2-2a65-4420-971b-e6a12271b52e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:01:48.874784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:01:48.875643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:01:48.876413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:01:48.876413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:01:48.876413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:01:48.876413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:01:48.876413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:01:48.876413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:01:48.876413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:01:48.876413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:01:48.876413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:01:48.876413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:01:48.876413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:01:48.876413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:01:48.876413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 25/50] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:01:48.882454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe2fc2-2a65-4420-971b-e6a12271b52e None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:48.887448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:48.931627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 26/51] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:48.990073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe2fc2-2a65-4420-971b-e6a12271b52e None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:49.033477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc5b0a-634c-454d-afc8-6ccd4c127597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:49.034087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc5b0a-634c-454d-afc8-6ccd4c127597 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:49.034364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc5b0a-634c-454d-afc8-6ccd4c127597 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:49.034629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc5b0a-634c-454d-afc8-6ccd4c127597 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:49.035296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc5b0a-634c-454d-afc8-6ccd4c127597 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:49.035596 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc5b0a-634c-454d-afc8-6ccd4c127597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:49.036989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc5b0a-634c-454d-afc8-6ccd4c127597 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:49.046472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 26/52] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:01:49.053462 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13831-8902-4ca7-b7f6-65237c1d0743 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:49.157996 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13831-8902-4ca7-b7f6-65237c1d0743 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:49.193696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc5b0a-634c-454d-afc8-6ccd4c127597 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:49.194320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be17b7-114c-473d-ae9b-37beb7faafb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:49.194971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be17b7-114c-473d-ae9b-37beb7faafb9 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:49.195254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be17b7-114c-473d-ae9b-37beb7faafb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:49.195524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be17b7-114c-473d-ae9b-37beb7faafb9 None admin] PATH_INFO: `/v3/users/5c98c93e9a414022917c074607b2165d` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:49.196908 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be17b7-114c-473d-ae9b-37beb7faafb9 None admin] RBAC: Authorizing `identity:get_user(user_id=5c98c93e9a414022917c074607b2165d)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:49.198488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be17b7-114c-473d-ae9b-37beb7faafb9 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:49.200075 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 27/53] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:01:49 2022] GET /identity/v3/users/5c98c93e9a414022917c074607b2165d => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:49.205576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be17b7-114c-473d-ae9b-37beb7faafb9 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:49.240898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:49.306788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc5b0a-634c-454d-afc8-6ccd4c127597 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:49.344962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4afb62-d2cb-41e7-a3b2-32340dc0c12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:49.345660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4afb62-d2cb-41e7-a3b2-32340dc0c12b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:49.345896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4afb62-d2cb-41e7-a3b2-32340dc0c12b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:49.346181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4afb62-d2cb-41e7-a3b2-32340dc0c12b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:49.347330 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4afb62-d2cb-41e7-a3b2-32340dc0c12b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:49.348800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4afb62-d2cb-41e7-a3b2-32340dc0c12b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:49.350424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 27/54] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:01:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:49.356700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4afb62-d2cb-41e7-a3b2-32340dc0c12b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:49.364476 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:49.438069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be17b7-114c-473d-ae9b-37beb7faafb9 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:49.474514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460016f-b98b-46ed-b78d-1f3d987bff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:49.475205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460016f-b98b-46ed-b78d-1f3d987bff20 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:49.475485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460016f-b98b-46ed-b78d-1f3d987bff20 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:49.475763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460016f-b98b-46ed-b78d-1f3d987bff20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:49.476870 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460016f-b98b-46ed-b78d-1f3d987bff20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:49.478339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460016f-b98b-46ed-b78d-1f3d987bff20 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:49.478456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4afb62-d2cb-41e7-a3b2-32340dc0c12b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:49.480198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 28/55] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:01:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:49.487237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460016f-b98b-46ed-b78d-1f3d987bff20 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:49.493745 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:49.519027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07cb43-b989-4928-839a-6b9dabe2773e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:49.519630 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07cb43-b989-4928-839a-6b9dabe2773e None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:49.519902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07cb43-b989-4928-839a-6b9dabe2773e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:49.520170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07cb43-b989-4928-839a-6b9dabe2773e None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:49.520822 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07cb43-b989-4928-839a-6b9dabe2773e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:49.522369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07cb43-b989-4928-839a-6b9dabe2773e None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:49.552406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 28/56] 10.222.0.60 () {60 vars in 1140 bytes} [Wed Aug 31 00:01:49 2022] POST /identity/v3/projects => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:01:49.588331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:49.591897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460016f-b98b-46ed-b78d-1f3d987bff20 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:49.632852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d4ed7-60b2-432a-a808-74beb5ad8cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:49.633510 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d4ed7-60b2-432a-a808-74beb5ad8cfe None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:49.633791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d4ed7-60b2-432a-a808-74beb5ad8cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:49.634065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d4ed7-60b2-432a-a808-74beb5ad8cfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:49.634801 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d4ed7-60b2-432a-a808-74beb5ad8cfe None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.domain.id=default, user.id=5c98c93e9a414022917c074607b2165d) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:49.635121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d4ed7-60b2-432a-a808-74beb5ad8cfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:49.636697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d4ed7-60b2-432a-a808-74beb5ad8cfe None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:49.646544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 29/57] 10.222.0.60 () {56 vars in 1322 bytes} [Wed Aug 31 00:01:49 2022] GET /identity/v3/role_assignments?user.id=5c98c93e9a414022917c074607b2165d&scope.domain.id=default&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 530 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:01:51.463324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2fd43-795b-47d5-b876-efd85022524a None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:51.463855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2fd43-795b-47d5-b876-efd85022524a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:51.463855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2fd43-795b-47d5-b876-efd85022524a None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:51.465103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 29/58] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:51.471336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0521ce-6b85-4c18-91ba-fefe739a0f34 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:51.471791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0521ce-6b85-4c18-91ba-fefe739a0f34 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:51.471912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0521ce-6b85-4c18-91ba-fefe739a0f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:51.496136 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-0c0521ce-6b85-4c18-91ba-fefe739a0f34 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:51.497992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0c0521ce-6b85-4c18-91ba-fefe739a0f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:51.580969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 30/59] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:51.848519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2fd43-795b-47d5-b876-efd85022524a None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:51.973019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2fd43-795b-47d5-b876-efd85022524a None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:52.008738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93666293-cfde-492a-80a5-5cd7db911a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:52.009377 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93666293-cfde-492a-80a5-5cd7db911a64 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:52.009649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93666293-cfde-492a-80a5-5cd7db911a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:52.009913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93666293-cfde-492a-80a5-5cd7db911a64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:52.011038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93666293-cfde-492a-80a5-5cd7db911a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:52.012460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93666293-cfde-492a-80a5-5cd7db911a64 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:52.014024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 30/60] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:01:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:52.019864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0521ce-6b85-4c18-91ba-fefe739a0f34 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:52.125141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:52.132555 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0521ce-6b85-4c18-91ba-fefe739a0f34 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:52.168387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972e598-4cbc-4cad-958a-4eb4d4aa57e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:52.168995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972e598-4cbc-4cad-958a-4eb4d4aa57e9 None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:52.169299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972e598-4cbc-4cad-958a-4eb4d4aa57e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:52.169576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972e598-4cbc-4cad-958a-4eb4d4aa57e9 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:52.170230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972e598-4cbc-4cad-958a-4eb4d4aa57e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:52.171675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972e598-4cbc-4cad-958a-4eb4d4aa57e9 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:52.201859 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 31/61] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:01:52 2022] POST /identity/v3/users => generated 275 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:01:55.255915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b1061-9f16-4e26-b29c-9942efd557ed None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:55.256424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b1061-9f16-4e26-b29c-9942efd557ed None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:55.256498 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b1061-9f16-4e26-b29c-9942efd557ed None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:55.257844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 31/62] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:55.276611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12cf8-f36e-46cf-b840-7942a332a31a None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:55.277141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12cf8-f36e-46cf-b840-7942a332a31a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:55.277141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12cf8-f36e-46cf-b840-7942a332a31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:55.306261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-84f12cf8-f36e-46cf-b840-7942a332a31a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:55.307653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-84f12cf8-f36e-46cf-b840-7942a332a31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:55.363563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182df9d5-09c0-4d2b-909c-482a94f080ab None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:55.364166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182df9d5-09c0-4d2b-909c-482a94f080ab None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:55.364636 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182df9d5-09c0-4d2b-909c-482a94f080ab None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:55.366245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 32/63] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:55.371897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed89a5d-7de1-4b4b-b649-4a17b87763d2 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:55.372465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed89a5d-7de1-4b4b-b649-4a17b87763d2 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:55.372976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed89a5d-7de1-4b4b-b649-4a17b87763d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:55.398279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-4ed89a5d-7de1-4b4b-b649-4a17b87763d2 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:55.399668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4ed89a5d-7de1-4b4b-b649-4a17b87763d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:55.400507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 32/64] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:55.448686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:55.519859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 33/65] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:01:55.705561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e4794-ae9d-4a5d-83b7-cc87acb54443 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:55.706211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e4794-ae9d-4a5d-83b7-cc87acb54443 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:55.706720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e4794-ae9d-4a5d-83b7-cc87acb54443 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:55.708591 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 33/66] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:55.713881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12127f8-a7d9-4af0-bcb4-0d4dcd906901 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:55.714170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12127f8-a7d9-4af0-bcb4-0d4dcd906901 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:55.714449 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12127f8-a7d9-4af0-bcb4-0d4dcd906901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:55.742282 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d12127f8-a7d9-4af0-bcb4-0d4dcd906901 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:55.743480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d12127f8-a7d9-4af0-bcb4-0d4dcd906901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:55.748673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e4794-ae9d-4a5d-83b7-cc87acb54443 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:55.820549 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 34/67] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:55.830214 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7123a-66fc-4085-894b-61cc85d42b8b None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:55.830717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7123a-66fc-4085-894b-61cc85d42b8b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:55.831162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7123a-66fc-4085-894b-61cc85d42b8b None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:55.832649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 35/68] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:55.837919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5526e9-2bf9-4efc-a0d3-bd7682cd0f26 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:55.838436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5526e9-2bf9-4efc-a0d3-bd7682cd0f26 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:55.838873 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5526e9-2bf9-4efc-a0d3-bd7682cd0f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:55.857064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:55.862050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-4a5526e9-2bf9-4efc-a0d3-bd7682cd0f26 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:55.863454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4a5526e9-2bf9-4efc-a0d3-bd7682cd0f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:55.885764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e4794-ae9d-4a5d-83b7-cc87acb54443 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:55.928529 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8243e-c8d1-4c3c-951f-b2823d2388c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:55.929168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8243e-c8d1-4c3c-951f-b2823d2388c3 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:55.929598 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8243e-c8d1-4c3c-951f-b2823d2388c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:55.929869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8243e-c8d1-4c3c-951f-b2823d2388c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:55.940459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 36/69] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:55.941199 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5526e9-2bf9-4efc-a0d3-bd7682cd0f26 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:55.954084 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8243e-c8d1-4c3c-951f-b2823d2388c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-caf8243e-c8d1-4c3c-951f-b2823d2388c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:01:55.962528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:01:55.963410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:01:55.964324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:01:55.964324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:01:55.964324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:01:55.964324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:01:55.964324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:01:55.964324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:01:55.964324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:01:55.964324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:01:55.964324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:01:55.964324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:01:55.964324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:01:55.964324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:01:55.965561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:55.967484 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 34/70] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:01:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:01:55.969309 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f99f00-9fec-4499-8915-7574bf9ae1ce None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:55.969733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f99f00-9fec-4499-8915-7574bf9ae1ce None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:55.970397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f99f00-9fec-4499-8915-7574bf9ae1ce None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:55.971940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 35/71] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:55.973096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f99f00-9fec-4499-8915-7574bf9ae1ce None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:56.044496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5526e9-2bf9-4efc-a0d3-bd7682cd0f26 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:56.084187 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa8e3d-9c39-4bf3-9baf-343c31e476b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:56.085058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa8e3d-9c39-4bf3-9baf-343c31e476b7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:56.085522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa8e3d-9c39-4bf3-9baf-343c31e476b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:56.085913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa8e3d-9c39-4bf3-9baf-343c31e476b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:56.097596 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa8e3d-9c39-4bf3-9baf-343c31e476b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-92aa8e3d-9c39-4bf3-9baf-343c31e476b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:01:56.102602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:01:56.103444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:01:56.104568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:01:56.104568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:01:56.104568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:01:56.104568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:01:56.104568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:01:56.104568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:01:56.104568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:01:56.104568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:01:56.104568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:01:56.104568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:01:56.104568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:01:56.104568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:01:56.104568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 37/72] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:01:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:01:56.105716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba248c0-ce66-4d44-96fb-f9d214af1a8a None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:56.105716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba248c0-ce66-4d44-96fb-f9d214af1a8a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:56.105950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba248c0-ce66-4d44-96fb-f9d214af1a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:56.116361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f99f00-9fec-4499-8915-7574bf9ae1ce None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:56.123860 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-3ba248c0-ce66-4d44-96fb-f9d214af1a8a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:56.125047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3ba248c0-ce66-4d44-96fb-f9d214af1a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:56.152977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7020b6-cde6-49b9-9f2f-58506e480344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:56.153715 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7020b6-cde6-49b9-9f2f-58506e480344 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:56.154046 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7020b6-cde6-49b9-9f2f-58506e480344 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:56.154389 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7020b6-cde6-49b9-9f2f-58506e480344 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:56.155069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7020b6-cde6-49b9-9f2f-58506e480344 None admin] RBAC: Adding query filter params (name=member) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:56.155373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7020b6-cde6-49b9-9f2f-58506e480344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:56.156763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7020b6-cde6-49b9-9f2f-58506e480344 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:56.166726 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:01:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:56.167531 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7020b6-cde6-49b9-9f2f-58506e480344 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:56.170093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:56.196557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 38/74] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:56.197495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba248c0-ce66-4d44-96fb-f9d214af1a8a None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:56.215683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:56.282679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7020b6-cde6-49b9-9f2f-58506e480344 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:56.312858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba248c0-ce66-4d44-96fb-f9d214af1a8a None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:56.319274 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d3115-7058-4140-b927-91716a24d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:56.320216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d3115-7058-4140-b927-91716a24d4fe None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:56.320495 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d3115-7058-4140-b927-91716a24d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:56.320766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d3115-7058-4140-b927-91716a24d4fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:56.331987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d3115-7058-4140-b927-91716a24d4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-9f4d3115-7058-4140-b927-91716a24d4fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:01:56.337519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:01:56.338782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:01:56.339650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:01:56.339650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:01:56.339650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:01:56.339650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:01:56.339650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:01:56.339650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:01:56.339650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:01:56.339650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:01:56.339650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:01:56.339650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:01:56.339650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:01:56.339650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:01:56.341425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:01:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:01:56.342231 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d3115-7058-4140-b927-91716a24d4fe None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:56.352693 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf0d03-78f7-46c5-9460-9926ba2cc389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:56.353338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf0d03-78f7-46c5-9460-9926ba2cc389 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:56.353941 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf0d03-78f7-46c5-9460-9926ba2cc389 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:56.354215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf0d03-78f7-46c5-9460-9926ba2cc389 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:56.354877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf0d03-78f7-46c5-9460-9926ba2cc389 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:56.355175 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf0d03-78f7-46c5-9460-9926ba2cc389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:56.356552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf0d03-78f7-46c5-9460-9926ba2cc389 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:56.365160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 39/76] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:01:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:56.365814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf0d03-78f7-46c5-9460-9926ba2cc389 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:56.405466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:56.442869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:56.450558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d3115-7058-4140-b927-91716a24d4fe None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:56.475968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf0d03-78f7-46c5-9460-9926ba2cc389 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:56.487921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d145f-fa06-4874-961b-f4d87bfa401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:56.488562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d145f-fa06-4874-961b-f4d87bfa401d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:56.488844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d145f-fa06-4874-961b-f4d87bfa401d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:56.489160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d145f-fa06-4874-961b-f4d87bfa401d None admin] PATH_INFO: `/v3/users/1fbe4ab79488470aa6024ab06cb3767f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:56.504280 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d145f-fa06-4874-961b-f4d87bfa401d None admin] RBAC: Authorizing `identity:get_user(user_id=1fbe4ab79488470aa6024ab06cb3767f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:56.505802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d145f-fa06-4874-961b-f4d87bfa401d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:56.512067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 38/77] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:01:56 2022] GET /identity/v3/users/1fbe4ab79488470aa6024ab06cb3767f => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:56.512067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d145f-fa06-4874-961b-f4d87bfa401d None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:56.514346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a3e53-4060-445c-a0e0-78bf8f69ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:56.515225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a3e53-4060-445c-a0e0-78bf8f69ba39 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:56.516336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a3e53-4060-445c-a0e0-78bf8f69ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:56.516610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a3e53-4060-445c-a0e0-78bf8f69ba39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:56.529447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a3e53-4060-445c-a0e0-78bf8f69ba39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-292a3e53-4060-445c-a0e0-78bf8f69ba39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:01:56.534814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:01:56.535836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:01:56.536709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:01:56.536709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:01:56.536709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:01:56.536709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:01:56.536709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:01:56.536709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:01:56.536709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:01:56.536709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:01:56.536709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:01:56.536709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:01:56.536709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:01:56.536709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:01:56.536709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 40/78] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:01:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:01:56.537941 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a3e53-4060-445c-a0e0-78bf8f69ba39 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:56.614990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d145f-fa06-4874-961b-f4d87bfa401d None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:56.634466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:56.644808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a3e53-4060-445c-a0e0-78bf8f69ba39 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:56.652000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f07cb1-9b2a-42a9-b0f4-97e871fe3833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:56.652601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07cb1-9b2a-42a9-b0f4-97e871fe3833 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:56.652884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07cb1-9b2a-42a9-b0f4-97e871fe3833 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:56.653163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07cb1-9b2a-42a9-b0f4-97e871fe3833 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:56.653891 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f07cb1-9b2a-42a9-b0f4-97e871fe3833 None admin] RBAC: Adding query filter params (name=member) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:56.654200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f07cb1-9b2a-42a9-b0f4-97e871fe3833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:56.655588 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f07cb1-9b2a-42a9-b0f4-97e871fe3833 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:56.665051 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 39/79] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:01:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:56.670176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f07cb1-9b2a-42a9-b0f4-97e871fe3833 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:56.676233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:56.682909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531b23d-4a89-42da-8c16-685aa6633570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:56.683541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531b23d-4a89-42da-8c16-685aa6633570 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:56.683796 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531b23d-4a89-42da-8c16-685aa6633570 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:56.684062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531b23d-4a89-42da-8c16-685aa6633570 None admin] PATH_INFO: `/v3/users/1fbe4ab79488470aa6024ab06cb3767f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:56.685254 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531b23d-4a89-42da-8c16-685aa6633570 None admin] RBAC: Authorizing `identity:get_user(user_id=1fbe4ab79488470aa6024ab06cb3767f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:56.686729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531b23d-4a89-42da-8c16-685aa6633570 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:56.688470 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 41/80] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:01:56 2022] GET /identity/v3/users/1fbe4ab79488470aa6024ab06cb3767f => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:56.689051 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531b23d-4a89-42da-8c16-685aa6633570 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:56.776663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f07cb1-9b2a-42a9-b0f4-97e871fe3833 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:56.790891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531b23d-4a89-42da-8c16-685aa6633570 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:56.809721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128608d4-a2ec-4dcd-999f-0a141974250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:56.810360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128608d4-a2ec-4dcd-999f-0a141974250e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:56.810642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128608d4-a2ec-4dcd-999f-0a141974250e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:56.810904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128608d4-a2ec-4dcd-999f-0a141974250e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:56.812013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128608d4-a2ec-4dcd-999f-0a141974250e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:56.813482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128608d4-a2ec-4dcd-999f-0a141974250e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:56.817257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 40/81] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:01:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:56.817257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128608d4-a2ec-4dcd-999f-0a141974250e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:56.825784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9ab71-9ab9-4bc9-8aa4-b38c89015da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:56.826595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9ab71-9ab9-4bc9-8aa4-b38c89015da6 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:56.826870 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9ab71-9ab9-4bc9-8aa4-b38c89015da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:56.827141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9ab71-9ab9-4bc9-8aa4-b38c89015da6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:56.865470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:56.891664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:56.895339 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9ab71-9ab9-4bc9-8aa4-b38c89015da6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:56.897052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9ab71-9ab9-4bc9-8aa4-b38c89015da6 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:56.917513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128608d4-a2ec-4dcd-999f-0a141974250e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:56.952348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea48e69-a504-4a66-99a1-fa774cbf2f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:56.952962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea48e69-a504-4a66-99a1-fa774cbf2f55 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:56.953262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea48e69-a504-4a66-99a1-fa774cbf2f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:56.953540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea48e69-a504-4a66-99a1-fa774cbf2f55 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:56.954211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea48e69-a504-4a66-99a1-fa774cbf2f55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:56.954516 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea48e69-a504-4a66-99a1-fa774cbf2f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:56.955910 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea48e69-a504-4a66-99a1-fa774cbf2f55 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:56.964751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 41/82] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:01:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:56.966157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea48e69-a504-4a66-99a1-fa774cbf2f55 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:57.001078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 42/83] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:01:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:01:57.002484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9ab71-9ab9-4bc9-8aa4-b38c89015da6 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:57.081150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea48e69-a504-4a66-99a1-fa774cbf2f55 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:57.094507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:57.102084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:57.106341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9ab71-9ab9-4bc9-8aa4-b38c89015da6 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:57.120019 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62950f-9395-45b8-a4c9-577ccfd0e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:57.120664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62950f-9395-45b8-a4c9-577ccfd0e84f None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:57.120958 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62950f-9395-45b8-a4c9-577ccfd0e84f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:57.121234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62950f-9395-45b8-a4c9-577ccfd0e84f None admin] PATH_INFO: `/v3/users/1fbe4ab79488470aa6024ab06cb3767f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:57.122406 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62950f-9395-45b8-a4c9-577ccfd0e84f None admin] RBAC: Authorizing `identity:get_user(user_id=1fbe4ab79488470aa6024ab06cb3767f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:57.123847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62950f-9395-45b8-a4c9-577ccfd0e84f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:57.125530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 42/84] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:01:56 2022] GET /identity/v3/users/1fbe4ab79488470aa6024ab06cb3767f => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:57.129310 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62950f-9395-45b8-a4c9-577ccfd0e84f None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:57.145628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cdd1a-2807-4647-b8cb-d708bb27e37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:57.146255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cdd1a-2807-4647-b8cb-d708bb27e37f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:57.146530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cdd1a-2807-4647-b8cb-d708bb27e37f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:57.146805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cdd1a-2807-4647-b8cb-d708bb27e37f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:57.214969 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cdd1a-2807-4647-b8cb-d708bb27e37f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:57.216431 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cdd1a-2807-4647-b8cb-d708bb27e37f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:57.231398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62950f-9395-45b8-a4c9-577ccfd0e84f None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:57.265184 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb08cea-c483-4e5c-a312-6b119e390b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:57.265923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb08cea-c483-4e5c-a312-6b119e390b6a None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:57.266205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb08cea-c483-4e5c-a312-6b119e390b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:57.266485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb08cea-c483-4e5c-a312-6b119e390b6a None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:57.267148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb08cea-c483-4e5c-a312-6b119e390b6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:57.268597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb08cea-c483-4e5c-a312-6b119e390b6a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:57.290367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 43/85] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:01:57 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:01:57.291233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb08cea-c483-4e5c-a312-6b119e390b6a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:57.331590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:57.336295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:57.344547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 43/86] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:01:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:01:57.345519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cdd1a-2807-4647-b8cb-d708bb27e37f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:57.413444 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb08cea-c483-4e5c-a312-6b119e390b6a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:57.450602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cca08-73eb-4fb8-b129-aad158949aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:57.451243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cca08-73eb-4fb8-b129-aad158949aba None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:57.451525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cca08-73eb-4fb8-b129-aad158949aba None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:57.451890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cca08-73eb-4fb8-b129-aad158949aba None admin] PATH_INFO: `/v3/users/5c98c93e9a414022917c074607b2165d` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:57.454345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cca08-73eb-4fb8-b129-aad158949aba None admin] RBAC: Authorizing `identity:get_user(user_id=5c98c93e9a414022917c074607b2165d)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:57.455168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cca08-73eb-4fb8-b129-aad158949aba None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:57.456771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 44/87] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:01:57 2022] GET /identity/v3/users/5c98c93e9a414022917c074607b2165d => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:57.457660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cca08-73eb-4fb8-b129-aad158949aba None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:57.462915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cdd1a-2807-4647-b8cb-d708bb27e37f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:57.502173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90728e9b-5533-42de-9caf-1335eb993941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:57.502820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90728e9b-5533-42de-9caf-1335eb993941 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:57.503092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90728e9b-5533-42de-9caf-1335eb993941 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:57.503364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90728e9b-5533-42de-9caf-1335eb993941 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:57.505107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90728e9b-5533-42de-9caf-1335eb993941 None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:57.506344 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90728e9b-5533-42de-9caf-1335eb993941 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:57.507766 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 44/88] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:01:57 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:57.513369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90728e9b-5533-42de-9caf-1335eb993941 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:57.579824 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cca08-73eb-4fb8-b129-aad158949aba None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:57.582874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:57.599162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:57.620812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df15a3-f204-4e35-9442-7fb84abba66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:57.621707 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df15a3-f204-4e35-9442-7fb84abba66b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:57.622155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df15a3-f204-4e35-9442-7fb84abba66b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:57.622556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df15a3-f204-4e35-9442-7fb84abba66b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:57.642461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90728e9b-5533-42de-9caf-1335eb993941 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:57.688447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3adb2-031a-4163-b806-ea1fa99b2ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:57.689083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3adb2-031a-4163-b806-ea1fa99b2ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:57.689382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3adb2-031a-4163-b806-ea1fa99b2ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:57.689653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3adb2-031a-4163-b806-ea1fa99b2ba5 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:57.690917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3adb2-031a-4163-b806-ea1fa99b2ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:57.692650 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3adb2-031a-4163-b806-ea1fa99b2ba5 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:57.694308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 45/89] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:01:57 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:57.695548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3adb2-031a-4163-b806-ea1fa99b2ba5 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:57.716082 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df15a3-f204-4e35-9442-7fb84abba66b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:57.718185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df15a3-f204-4e35-9442-7fb84abba66b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:57.887465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3adb2-031a-4163-b806-ea1fa99b2ba5 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:57.924231 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 45/90] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:01:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:01:57.928423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df15a3-f204-4e35-9442-7fb84abba66b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:57.936503 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:57.956757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10cf88-44dd-42ff-828f-23e7169df37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:57.957405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10cf88-44dd-42ff-828f-23e7169df37e None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:57.957679 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10cf88-44dd-42ff-828f-23e7169df37e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:57.957948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10cf88-44dd-42ff-828f-23e7169df37e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:57.961341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:58.079816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df15a3-f204-4e35-9442-7fb84abba66b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:58.100273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10cf88-44dd-42ff-828f-23e7169df37e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:58.100273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10cf88-44dd-42ff-828f-23e7169df37e None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:58.152962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6742c-f810-4b26-9111-8c648a63a8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:58.154087 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6742c-f810-4b26-9111-8c648a63a8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:58.154568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6742c-f810-4b26-9111-8c648a63a8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:58.155040 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6742c-f810-4b26-9111-8c648a63a8d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:58.156166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6742c-f810-4b26-9111-8c648a63a8d5 None admin] RBAC: Adding query filter params (role.id=2dfbdb214b97432588648dba947cb07a, scope.project.id=39be93f42044484fa6db903b2c759bba, user.id=1fbe4ab79488470aa6024ab06cb3767f) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:58.156702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6742c-f810-4b26-9111-8c648a63a8d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:58.158775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6742c-f810-4b26-9111-8c648a63a8d5 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:58.165409 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 46/91] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:01:57 2022] GET /identity/v3/role_assignments?user.id=1fbe4ab79488470aa6024ab06cb3767f&scope.project.id=39be93f42044484fa6db903b2c759bba&role.id=2dfbdb214b97432588648dba947cb07a => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:58.166754 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6742c-f810-4b26-9111-8c648a63a8d5 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:58.236370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 46/92] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:01:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:01:58.242022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10cf88-44dd-42ff-828f-23e7169df37e None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:58.280047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:58.352927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:58.353674 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10cf88-44dd-42ff-828f-23e7169df37e None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:58.395006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba154a19-8c84-4b24-8dc0-fa89d123b347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:58.395645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba154a19-8c84-4b24-8dc0-fa89d123b347 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:58.395936 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba154a19-8c84-4b24-8dc0-fa89d123b347 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:58.396199 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba154a19-8c84-4b24-8dc0-fa89d123b347 None admin] PATH_INFO: `/v3/projects/44ef9fefcd664326a8a0615b5ef73ae1` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:58.398720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba154a19-8c84-4b24-8dc0-fa89d123b347 None admin] RBAC: Authorizing `identity:get_project(project_id=44ef9fefcd664326a8a0615b5ef73ae1)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:58.401247 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba154a19-8c84-4b24-8dc0-fa89d123b347 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:58.402876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 47/93] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:01:58 2022] GET /identity/v3/projects/44ef9fefcd664326a8a0615b5ef73ae1 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:58.403692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba154a19-8c84-4b24-8dc0-fa89d123b347 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:58.427125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6742c-f810-4b26-9111-8c648a63a8d5 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:58.486194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ae22b-b672-44ce-bfff-dc10ea0859af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:58.486815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ae22b-b672-44ce-bfff-dc10ea0859af None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:58.487092 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ae22b-b672-44ce-bfff-dc10ea0859af None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:58.487362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ae22b-b672-44ce-bfff-dc10ea0859af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:58.488087 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ae22b-b672-44ce-bfff-dc10ea0859af None admin] RBAC: Adding query filter params (role.id=b3796e568aa342a1b3318b04d23a9cc0, scope.project.id=39be93f42044484fa6db903b2c759bba, user.id=1fbe4ab79488470aa6024ab06cb3767f) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:58.488396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ae22b-b672-44ce-bfff-dc10ea0859af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:58.489863 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ae22b-b672-44ce-bfff-dc10ea0859af None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:58.501150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 47/94] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:01:58 2022] GET /identity/v3/role_assignments?user.id=1fbe4ab79488470aa6024ab06cb3767f&scope.project.id=39be93f42044484fa6db903b2c759bba&role.id=b3796e568aa342a1b3318b04d23a9cc0 => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:58.502074 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ae22b-b672-44ce-bfff-dc10ea0859af None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:58.578141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba154a19-8c84-4b24-8dc0-fa89d123b347 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:58.583608 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:58.618912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dacb24-51b1-4b49-ae97-f4ba61283180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:58.619650 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dacb24-51b1-4b49-ae97-f4ba61283180 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:58.619923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dacb24-51b1-4b49-ae97-f4ba61283180 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:58.620247 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dacb24-51b1-4b49-ae97-f4ba61283180 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:58.621435 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dacb24-51b1-4b49-ae97-f4ba61283180 None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:58.623129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dacb24-51b1-4b49-ae97-f4ba61283180 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:58.625046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 48/95] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:01:58 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:58.631543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dacb24-51b1-4b49-ae97-f4ba61283180 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:01:58.634833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ae22b-b672-44ce-bfff-dc10ea0859af None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:58.668380 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:58.675221 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1d967-b002-4f6d-a3b2-71213cc63c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:58.676302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1d967-b002-4f6d-a3b2-71213cc63c1d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:58.676781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1d967-b002-4f6d-a3b2-71213cc63c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:58.677287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1d967-b002-4f6d-a3b2-71213cc63c1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:58.678212 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1d967-b002-4f6d-a3b2-71213cc63c1d None admin] RBAC: Adding query filter params (role.id=2dfbdb214b97432588648dba947cb07a, scope.project.id=44ef9fefcd664326a8a0615b5ef73ae1, user.id=1fbe4ab79488470aa6024ab06cb3767f) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:58.678756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1d967-b002-4f6d-a3b2-71213cc63c1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:58.680472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1d967-b002-4f6d-a3b2-71213cc63c1d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:58.687400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 48/96] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:01:58 2022] GET /identity/v3/role_assignments?user.id=1fbe4ab79488470aa6024ab06cb3767f&scope.project.id=44ef9fefcd664326a8a0615b5ef73ae1&role.id=2dfbdb214b97432588648dba947cb07a => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:58.746060 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dacb24-51b1-4b49-ae97-f4ba61283180 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:01:58.785399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a165-cf42-4da6-9a51-6fab1ed96645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:01:58.786022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a165-cf42-4da6-9a51-6fab1ed96645 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:58.786295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a165-cf42-4da6-9a51-6fab1ed96645 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:58.786564 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a165-cf42-4da6-9a51-6fab1ed96645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:58.787301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1a165-cf42-4da6-9a51-6fab1ed96645 None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=39be93f42044484fa6db903b2c759bba, user.id=5c98c93e9a414022917c074607b2165d) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:01:58.787655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1a165-cf42-4da6-9a51-6fab1ed96645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:01:58.789112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1a165-cf42-4da6-9a51-6fab1ed96645 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:01:58.796004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 49/97] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:01:58 2022] GET /identity/v3/role_assignments?user.id=5c98c93e9a414022917c074607b2165d&scope.project.id=39be93f42044484fa6db903b2c759bba&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:01:59.676577 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267e70-b60f-4474-92a2-b8169ff0fe09 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:59.677094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267e70-b60f-4474-92a2-b8169ff0fe09 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:59.677094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267e70-b60f-4474-92a2-b8169ff0fe09 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:59.678606 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 49/98] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:01:59.684749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e534d-192e-42f9-b692-0cb1855ffb25 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:59.685652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e534d-192e-42f9-b692-0cb1855ffb25 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:59.686156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e534d-192e-42f9-b692-0cb1855ffb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:59.709489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-fa9e534d-192e-42f9-b692-0cb1855ffb25 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:59.711015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-fa9e534d-192e-42f9-b692-0cb1855ffb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:59.746821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:01:59.758978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f56e88-beee-4faa-b386-6817149d221d None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:59.759253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f56e88-beee-4faa-b386-6817149d221d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:59.759652 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f56e88-beee-4faa-b386-6817149d221d None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:59.761282 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 50/99] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:01:59.766301 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580a2d2-d23a-4ce0-82c6-2a7f72246edf None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:01:59.766583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580a2d2-d23a-4ce0-82c6-2a7f72246edf None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:01:59.766858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580a2d2-d23a-4ce0-82c6-2a7f72246edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:01:59.788571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c580a2d2-d23a-4ce0-82c6-2a7f72246edf None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:01:59.789791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c580a2d2-d23a-4ce0-82c6-2a7f72246edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:01:59.810787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 50/100] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:01:59.910821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 51/101] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:00.302624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e534d-192e-42f9-b692-0cb1855ffb25 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:00.420652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e534d-192e-42f9-b692-0cb1855ffb25 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:00.432236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580a2d2-d23a-4ce0-82c6-2a7f72246edf None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:00.509228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5c673-3beb-4f88-a31b-0ce06421a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:00.509963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5c673-3beb-4f88-a31b-0ce06421a2cf None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:00.510346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5c673-3beb-4f88-a31b-0ce06421a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:00.510619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5c673-3beb-4f88-a31b-0ce06421a2cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:00.511756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5c673-3beb-4f88-a31b-0ce06421a2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:00.513240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5c673-3beb-4f88-a31b-0ce06421a2cf None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:00.515041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 51/102] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:00.520812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5c673-3beb-4f88-a31b-0ce06421a2cf None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:00.610535 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:00.612482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580a2d2-d23a-4ce0-82c6-2a7f72246edf None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:00.645616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:00.659652 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47ea00-5202-4565-903d-9aa6892afc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:00.660308 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47ea00-5202-4565-903d-9aa6892afc33 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:00.660587 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47ea00-5202-4565-903d-9aa6892afc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:00.660864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47ea00-5202-4565-903d-9aa6892afc33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:00.683217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47ea00-5202-4565-903d-9aa6892afc33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-6d47ea00-5202-4565-903d-9aa6892afc33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:00.688304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:00.689135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:00.689907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:00.689907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:00.689907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:00.689907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:00.689907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:00.689907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:00.689907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:00.689907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:00.689907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:00.689907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:00.689907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:00.689907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:00.689907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 52/103] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:02:00.714202 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47ea00-5202-4565-903d-9aa6892afc33 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:00.750074 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5c673-3beb-4f88-a31b-0ce06421a2cf None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:00.814120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a70c6f-17f8-4b6c-89f3-88f61a425f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:00.814740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a70c6f-17f8-4b6c-89f3-88f61a425f7f None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:00.815018 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a70c6f-17f8-4b6c-89f3-88f61a425f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:00.815285 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a70c6f-17f8-4b6c-89f3-88f61a425f7f None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:00.815945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a70c6f-17f8-4b6c-89f3-88f61a425f7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:00.817594 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a70c6f-17f8-4b6c-89f3-88f61a425f7f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:00.872375 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 52/104] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:02:00 2022] POST /identity/v3/projects => generated 302 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:02:00.902833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47ea00-5202-4565-903d-9aa6892afc33 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:00.949026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4434-eb28-442f-bddd-6ac4c0e6c205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:00.949607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4434-eb28-442f-bddd-6ac4c0e6c205 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:00.949888 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4434-eb28-442f-bddd-6ac4c0e6c205 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:00.950159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4434-eb28-442f-bddd-6ac4c0e6c205 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:00.950833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e4434-eb28-442f-bddd-6ac4c0e6c205 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:00.951134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e4434-eb28-442f-bddd-6ac4c0e6c205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:00.952684 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e4434-eb28-442f-bddd-6ac4c0e6c205 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:00.962177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 53/105] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:00.968210 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a70c6f-17f8-4b6c-89f3-88f61a425f7f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:01.101335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:01.128332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a70c6f-17f8-4b6c-89f3-88f61a425f7f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:01.175928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51aa31-6a33-49b7-a21a-db5b3fe20029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:01.176572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51aa31-6a33-49b7-a21a-db5b3fe20029 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:01.176850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51aa31-6a33-49b7-a21a-db5b3fe20029 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:01.177122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51aa31-6a33-49b7-a21a-db5b3fe20029 None admin] PATH_INFO: `/v3/users/972bf36c35f24c999bcb9fcad86d20a8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:01.191995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51aa31-6a33-49b7-a21a-db5b3fe20029 None admin] RBAC: Authorizing `identity:get_user(user_id=972bf36c35f24c999bcb9fcad86d20a8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:01.193492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51aa31-6a33-49b7-a21a-db5b3fe20029 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:01.195229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 53/106] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:00 2022] GET /identity/v3/users/972bf36c35f24c999bcb9fcad86d20a8 => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:01.202337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4434-eb28-442f-bddd-6ac4c0e6c205 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:01.216800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0461-aa7a-49da-b3f6-a9d08e8a1791 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:01.217087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0461-aa7a-49da-b3f6-a9d08e8a1791 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:01.217383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0461-aa7a-49da-b3f6-a9d08e8a1791 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:01.218731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 54/107] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:01.224817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f29bb6-1735-43f1-81dc-fef0baa1152c None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:01.225099 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f29bb6-1735-43f1-81dc-fef0baa1152c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:01.225401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f29bb6-1735-43f1-81dc-fef0baa1152c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:01.258492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-29f29bb6-1735-43f1-81dc-fef0baa1152c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:01.261192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-29f29bb6-1735-43f1-81dc-fef0baa1152c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:01.293557 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:01.385639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4434-eb28-442f-bddd-6ac4c0e6c205 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:01.395998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 55/108] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:01.426516 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3cb9-0eeb-4087-93a8-d43008061795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:01.427184 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3cb9-0eeb-4087-93a8-d43008061795 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:01.427465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3cb9-0eeb-4087-93a8-d43008061795 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:01.427735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3cb9-0eeb-4087-93a8-d43008061795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:01.517285 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3cb9-0eeb-4087-93a8-d43008061795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:01.518753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3cb9-0eeb-4087-93a8-d43008061795 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:01.581311 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:01.652837 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 54/109] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:01.659216 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f29bb6-1735-43f1-81dc-fef0baa1152c None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:01.670991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10997c93-8c9c-4646-9e74-04171f4c9757 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:01.671313 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10997c93-8c9c-4646-9e74-04171f4c9757 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:01.671543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10997c93-8c9c-4646-9e74-04171f4c9757 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:01.673114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 55/110] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:02:01.678530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee47e3-86bd-4bf8-b818-400a5daa4877 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:01.678899 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee47e3-86bd-4bf8-b818-400a5daa4877 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:01.679174 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee47e3-86bd-4bf8-b818-400a5daa4877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:01.710423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-f3ee47e3-86bd-4bf8-b818-400a5daa4877 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:01.711645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f3ee47e3-86bd-4bf8-b818-400a5daa4877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:01.768333 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:01.791514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 56/111] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:01.792851 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ad6fd-0de1-47ab-9c71-71815e21b4e2 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:01.793166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ad6fd-0de1-47ab-9c71-71815e21b4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:01.793427 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ad6fd-0de1-47ab-9c71-71815e21b4e2 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:01.794797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 57/112] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:01.799582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0296016-5f4e-496c-87ef-69b0cce29a8d None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:01.799867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0296016-5f4e-496c-87ef-69b0cce29a8d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:01.800166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0296016-5f4e-496c-87ef-69b0cce29a8d None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:01.801372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 58/113] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:01.802348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0296016-5f4e-496c-87ef-69b0cce29a8d None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:01.804680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f29bb6-1735-43f1-81dc-fef0baa1152c None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:01.851633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b869f-f2f1-4130-bf34-5b9fdaac465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:01.852878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b869f-f2f1-4130-bf34-5b9fdaac465d None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:01.854165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b869f-f2f1-4130-bf34-5b9fdaac465d None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:01.854902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b869f-f2f1-4130-bf34-5b9fdaac465d None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:01.856226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b869f-f2f1-4130-bf34-5b9fdaac465d None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:01.858952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b869f-f2f1-4130-bf34-5b9fdaac465d None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:01.861406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 56/114] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:01 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:01.862837 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33bad-8c51-416b-aaf5-c68e7c5e5ac1 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:01.863275 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33bad-8c51-416b-aaf5-c68e7c5e5ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:01.863701 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33bad-8c51-416b-aaf5-c68e7c5e5ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:01.888130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-c8f33bad-8c51-416b-aaf5-c68e7c5e5ac1 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:01.889671 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c8f33bad-8c51-416b-aaf5-c68e7c5e5ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:01.901450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:01.925063 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0296016-5f4e-496c-87ef-69b0cce29a8d None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:01.968448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 57/115] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:01.970150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924a21e-2a25-4c93-8017-b4b1b2179956 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:01.970415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924a21e-2a25-4c93-8017-b4b1b2179956 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:01.970687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924a21e-2a25-4c93-8017-b4b1b2179956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:01.972068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e1421-6b7e-4dc5-9471-bd7357520976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:01.972863 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e1421-6b7e-4dc5-9471-bd7357520976 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:01.973320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e1421-6b7e-4dc5-9471-bd7357520976 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:01.973746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e1421-6b7e-4dc5-9471-bd7357520976 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:01.987622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e1421-6b7e-4dc5-9471-bd7357520976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:01.989008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-3924a21e-2a25-4c93-8017-b4b1b2179956 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:01.990206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3924a21e-2a25-4c93-8017-b4b1b2179956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-6d5e1421-6b7e-4dc5-9471-bd7357520976 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:01.994175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:01.995576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:01.996327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:01.996327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:01.996327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:01.996327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:01.996327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:01.996327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:01.996327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:01.996327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:01.996327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:01.996327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:01.996327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:01.996327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:01.996327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 59/116] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:02.002216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e1421-6b7e-4dc5-9471-bd7357520976 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:02.071402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:02.080117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 58/117] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:02.081264 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924a21e-2a25-4c93-8017-b4b1b2179956 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:02.196400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e1421-6b7e-4dc5-9471-bd7357520976 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:02.198531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924a21e-2a25-4c93-8017-b4b1b2179956 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:02.240334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3609bb8-8ccd-4b62-853d-5b97933da4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:02.241399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609bb8-8ccd-4b62-853d-5b97933da4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:02.241895 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609bb8-8ccd-4b62-853d-5b97933da4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:02.242685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609bb8-8ccd-4b62-853d-5b97933da4e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:02.243687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3609bb8-8ccd-4b62-853d-5b97933da4e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:02.244464 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3609bb8-8ccd-4b62-853d-5b97933da4e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:02.246060 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3609bb8-8ccd-4b62-853d-5b97933da4e0 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:02.256006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 59/118] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:02.261415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3609bb8-8ccd-4b62-853d-5b97933da4e0 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:02.267414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad0e05-f951-4586-a466-015df96754e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:02.268127 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad0e05-f951-4586-a466-015df96754e6 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:02.268404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad0e05-f951-4586-a466-015df96754e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:02.268675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad0e05-f951-4586-a466-015df96754e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:02.269479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad0e05-f951-4586-a466-015df96754e6 None admin] RBAC: Adding query filter params (role.id=86d6f10ad167487ab620bf591795470c, scope.project.id=39be93f42044484fa6db903b2c759bba, user.id=972bf36c35f24c999bcb9fcad86d20a8) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:02.269824 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad0e05-f951-4586-a466-015df96754e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:02.271317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad0e05-f951-4586-a466-015df96754e6 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:02.285049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 60/119] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:01 2022] GET /identity/v3/role_assignments?user.id=972bf36c35f24c999bcb9fcad86d20a8&scope.project.id=39be93f42044484fa6db903b2c759bba&role.id=86d6f10ad167487ab620bf591795470c => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:02.285927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad0e05-f951-4586-a466-015df96754e6 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:02.289318 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:02.344255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:02.388342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3609bb8-8ccd-4b62-853d-5b97933da4e0 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:02.426699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699b2c6-6657-4d1b-bc70-03c77ca7752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:02.427754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699b2c6-6657-4d1b-bc70-03c77ca7752d None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:02.428228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699b2c6-6657-4d1b-bc70-03c77ca7752d None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:02.428693 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699b2c6-6657-4d1b-bc70-03c77ca7752d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:02.433959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad0e05-f951-4586-a466-015df96754e6 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:02.442130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699b2c6-6657-4d1b-bc70-03c77ca7752d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-6699b2c6-6657-4d1b-bc70-03c77ca7752d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:02.448830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:02.449781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:02.450528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:02.450528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:02.450528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:02.450528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:02.450528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:02.450528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:02.450528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:02.450528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:02.450528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:02.450528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:02.450528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:02.450528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:02.452886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 60/120] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:02:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:02.454041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699b2c6-6657-4d1b-bc70-03c77ca7752d None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:02.505918 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e26a2c-5aaa-4dfe-87b7-1158fe94a4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:02.506693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e26a2c-5aaa-4dfe-87b7-1158fe94a4ec None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:02.506973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e26a2c-5aaa-4dfe-87b7-1158fe94a4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:02.507296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e26a2c-5aaa-4dfe-87b7-1158fe94a4ec None admin] PATH_INFO: `/v3/users/1fbe4ab79488470aa6024ab06cb3767f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:02.512048 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e26a2c-5aaa-4dfe-87b7-1158fe94a4ec None admin] RBAC: Authorizing `identity:get_user(user_id=1fbe4ab79488470aa6024ab06cb3767f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:02.513601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e26a2c-5aaa-4dfe-87b7-1158fe94a4ec None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:02.515379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 61/121] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:02 2022] GET /identity/v3/users/1fbe4ab79488470aa6024ab06cb3767f => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:02.516208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e26a2c-5aaa-4dfe-87b7-1158fe94a4ec None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:02.602131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699b2c6-6657-4d1b-bc70-03c77ca7752d None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:02.613066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:02.632183 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:02.646019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31b429-d187-405d-96da-af31637ec200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:02.646662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31b429-d187-405d-96da-af31637ec200 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:02.646939 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31b429-d187-405d-96da-af31637ec200 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:02.647202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31b429-d187-405d-96da-af31637ec200 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:02.660049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e26a2c-5aaa-4dfe-87b7-1158fe94a4ec None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:02.660244 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31b429-d187-405d-96da-af31637ec200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-8c31b429-d187-405d-96da-af31637ec200 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:02.665194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:02.666893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:02.667702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:02.667702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:02.667702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:02.667702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:02.667702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:02.667702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:02.667702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:02.667702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:02.667702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:02.667702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:02.667702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:02.667702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:02.667702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 61/122] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:02.671873 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31b429-d187-405d-96da-af31637ec200 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:02.708272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce3712-4804-48e6-b51e-fd30d7521b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:02.709390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce3712-4804-48e6-b51e-fd30d7521b4b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:02.709866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce3712-4804-48e6-b51e-fd30d7521b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:02.710324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce3712-4804-48e6-b51e-fd30d7521b4b None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:02.711184 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce3712-4804-48e6-b51e-fd30d7521b4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:02.712136 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce3712-4804-48e6-b51e-fd30d7521b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:02.714576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce3712-4804-48e6-b51e-fd30d7521b4b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:02.723934 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 62/123] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:02.725079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce3712-4804-48e6-b51e-fd30d7521b4b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:02.777696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31b429-d187-405d-96da-af31637ec200 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:02.813120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da6aaf-e925-4453-b165-06a96c05c677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:02.813799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da6aaf-e925-4453-b165-06a96c05c677 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:02.814078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da6aaf-e925-4453-b165-06a96c05c677 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:02.814349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da6aaf-e925-4453-b165-06a96c05c677 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:02.815481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da6aaf-e925-4453-b165-06a96c05c677 None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:02.816929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da6aaf-e925-4453-b165-06a96c05c677 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:02.823899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 62/124] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:02 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:02.823899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da6aaf-e925-4453-b165-06a96c05c677 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:02.848649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce3712-4804-48e6-b51e-fd30d7521b4b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:02.873349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:02.888033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:02.891960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a6949-39fa-44e4-a8f6-6a5aa71cd910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:02.892858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a6949-39fa-44e4-a8f6-6a5aa71cd910 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:02.893319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a6949-39fa-44e4-a8f6-6a5aa71cd910 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:02.893721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a6949-39fa-44e4-a8f6-6a5aa71cd910 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:02.906364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a6949-39fa-44e4-a8f6-6a5aa71cd910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-bb7a6949-39fa-44e4-a8f6-6a5aa71cd910 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:02.913432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:02.914453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:02.915370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:02.915370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:02.915370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:02.915370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:02.915370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:02.915370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:02.915370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:02.915370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:02.915370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:02.915370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:02.915370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:02.915370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:02.917742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 63/125] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:02:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:02.919196 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a6949-39fa-44e4-a8f6-6a5aa71cd910 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:02.932991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da6aaf-e925-4453-b165-06a96c05c677 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:02.968214 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1ad4f-87c4-4757-89d7-8977caff9f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:02.968831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1ad4f-87c4-4757-89d7-8977caff9f04 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:02.969109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1ad4f-87c4-4757-89d7-8977caff9f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:02.969420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1ad4f-87c4-4757-89d7-8977caff9f04 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:02.970096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1ad4f-87c4-4757-89d7-8977caff9f04 None admin] RBAC: Adding query filter params (name=member) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:02.970397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1ad4f-87c4-4757-89d7-8977caff9f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:02.971827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1ad4f-87c4-4757-89d7-8977caff9f04 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:02.981311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 63/126] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:02.982117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1ad4f-87c4-4757-89d7-8977caff9f04 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:03.058968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a6949-39fa-44e4-a8f6-6a5aa71cd910 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:03.106059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbd399-b9b4-49db-8eb9-08c59fcd7580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:03.107304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbd399-b9b4-49db-8eb9-08c59fcd7580 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:03.108153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbd399-b9b4-49db-8eb9-08c59fcd7580 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:03.108580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbd399-b9b4-49db-8eb9-08c59fcd7580 None admin] PATH_INFO: `/v3/users/5c98c93e9a414022917c074607b2165d` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:03.110392 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbd399-b9b4-49db-8eb9-08c59fcd7580 None admin] RBAC: Authorizing `identity:get_user(user_id=5c98c93e9a414022917c074607b2165d)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:03.112692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbd399-b9b4-49db-8eb9-08c59fcd7580 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:03.113854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1ad4f-87c4-4757-89d7-8977caff9f04 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:03.114689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 64/127] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:02 2022] GET /identity/v3/users/5c98c93e9a414022917c074607b2165d => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:03.115966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbd399-b9b4-49db-8eb9-08c59fcd7580 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:03.130753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:03.154646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cffee8-7cad-47b4-81de-a2b8a9669833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:03.155318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cffee8-7cad-47b4-81de-a2b8a9669833 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:03.155644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cffee8-7cad-47b4-81de-a2b8a9669833 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:03.155967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cffee8-7cad-47b4-81de-a2b8a9669833 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba/users/1fbe4ab79488470aa6024ab06cb3767f/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:03.158328 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cffee8-7cad-47b4-81de-a2b8a9669833 None admin] RBAC: Authorizing `identity:create_grant(project_id=39be93f42044484fa6db903b2c759bba, user_id=1fbe4ab79488470aa6024ab06cb3767f, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:03.160057 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cffee8-7cad-47b4-81de-a2b8a9669833 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:03.176546 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 64/128] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:02:02 2022] PUT /identity/v3/projects/39be93f42044484fa6db903b2c759bba/users/1fbe4ab79488470aa6024ab06cb3767f/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:03.177557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cffee8-7cad-47b4-81de-a2b8a9669833 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:03.202184 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:03.264063 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbd399-b9b4-49db-8eb9-08c59fcd7580 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:03.313619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cffee8-7cad-47b4-81de-a2b8a9669833 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:03.334307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12976d1d-8d47-4016-9c70-e79b387946dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:03.334937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12976d1d-8d47-4016-9c70-e79b387946dd None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:03.335216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12976d1d-8d47-4016-9c70-e79b387946dd None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:03.335486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12976d1d-8d47-4016-9c70-e79b387946dd None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:03.336165 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12976d1d-8d47-4016-9c70-e79b387946dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:03.336466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12976d1d-8d47-4016-9c70-e79b387946dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:03.338043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12976d1d-8d47-4016-9c70-e79b387946dd None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:03.355616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 65/129] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:03.356605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12976d1d-8d47-4016-9c70-e79b387946dd None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:03.397288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c845af2-fd4a-41ba-8386-921f597d4943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:03.398376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c845af2-fd4a-41ba-8386-921f597d4943 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:03.398661 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c845af2-fd4a-41ba-8386-921f597d4943 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:03.398938 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c845af2-fd4a-41ba-8386-921f597d4943 None admin] PATH_INFO: `/v3/users/1fbe4ab79488470aa6024ab06cb3767f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:03.401347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c845af2-fd4a-41ba-8386-921f597d4943 None admin] RBAC: Authorizing `identity:get_user(user_id=1fbe4ab79488470aa6024ab06cb3767f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:03.403654 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c845af2-fd4a-41ba-8386-921f597d4943 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:03.405602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 65/130] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:03 2022] GET /identity/v3/users/1fbe4ab79488470aa6024ab06cb3767f => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:03.407623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c845af2-fd4a-41ba-8386-921f597d4943 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:03.467089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:03.497218 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12976d1d-8d47-4016-9c70-e79b387946dd None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:03.521521 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:03.535032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e8d74-5cfe-40de-a804-56f84441ec82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:03.535986 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e8d74-5cfe-40de-a804-56f84441ec82 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:03.536429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e8d74-5cfe-40de-a804-56f84441ec82 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:03.536836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e8d74-5cfe-40de-a804-56f84441ec82 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:03.538360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e8d74-5cfe-40de-a804-56f84441ec82 None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:03.540064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e8d74-5cfe-40de-a804-56f84441ec82 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:03.541554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c845af2-fd4a-41ba-8386-921f597d4943 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:03.542139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 66/131] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:03 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:03.543127 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e8d74-5cfe-40de-a804-56f84441ec82 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:03.580480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f93249-cebe-41c6-a1ea-ffec9865c354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:03.581200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f93249-cebe-41c6-a1ea-ffec9865c354 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:03.581517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f93249-cebe-41c6-a1ea-ffec9865c354 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:03.581779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f93249-cebe-41c6-a1ea-ffec9865c354 None admin] PATH_INFO: `/v3/users/1fbe4ab79488470aa6024ab06cb3767f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:03.582997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f93249-cebe-41c6-a1ea-ffec9865c354 None admin] RBAC: Authorizing `identity:get_user(user_id=1fbe4ab79488470aa6024ab06cb3767f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:03.584522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f93249-cebe-41c6-a1ea-ffec9865c354 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:03.586286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 66/132] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:03 2022] GET /identity/v3/users/1fbe4ab79488470aa6024ab06cb3767f => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:03.592530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527b892-dc08-4312-bdf4-5d69cf8e00ee None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:03.592884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527b892-dc08-4312-bdf4-5d69cf8e00ee None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:03.593080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527b892-dc08-4312-bdf4-5d69cf8e00ee None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:03.594461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 67/133] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:03.595242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527b892-dc08-4312-bdf4-5d69cf8e00ee None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:03.659194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e8d74-5cfe-40de-a804-56f84441ec82 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:03.694685 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5407e52-411e-481b-bc17-949d6c251f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:03.695378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5407e52-411e-481b-bc17-949d6c251f86 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:03.695661 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5407e52-411e-481b-bc17-949d6c251f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:03.695934 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5407e52-411e-481b-bc17-949d6c251f86 None admin] PATH_INFO: `/v3/projects/44ef9fefcd664326a8a0615b5ef73ae1` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:03.697110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5407e52-411e-481b-bc17-949d6c251f86 None admin] RBAC: Authorizing `identity:get_project(project_id=44ef9fefcd664326a8a0615b5ef73ae1)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:03.698693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5407e52-411e-481b-bc17-949d6c251f86 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:03.700343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 67/134] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:03 2022] GET /identity/v3/projects/44ef9fefcd664326a8a0615b5ef73ae1 => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:03.701110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5407e52-411e-481b-bc17-949d6c251f86 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:03.735212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527b892-dc08-4312-bdf4-5d69cf8e00ee None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:03.747751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:03.769611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:03.784137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194220e1-4464-4855-aea7-7b65c8ca0353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:03.786192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194220e1-4464-4855-aea7-7b65c8ca0353 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:03.786609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194220e1-4464-4855-aea7-7b65c8ca0353 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:03.787016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194220e1-4464-4855-aea7-7b65c8ca0353 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba/users/5c98c93e9a414022917c074607b2165d/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:03.789044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194220e1-4464-4855-aea7-7b65c8ca0353 None admin] RBAC: Authorizing `identity:create_grant(project_id=39be93f42044484fa6db903b2c759bba, user_id=5c98c93e9a414022917c074607b2165d, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:03.790801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194220e1-4464-4855-aea7-7b65c8ca0353 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:03.810098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 68/135] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:02:03 2022] PUT /identity/v3/projects/39be93f42044484fa6db903b2c759bba/users/5c98c93e9a414022917c074607b2165d/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:03.811877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c309a-5f99-4ee8-b368-a6fc54c385a5 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:03.812304 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c309a-5f99-4ee8-b368-a6fc54c385a5 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:03.813139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c309a-5f99-4ee8-b368-a6fc54c385a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:03.824134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5407e52-411e-481b-bc17-949d6c251f86 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:03.838231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-983c309a-5f99-4ee8-b368-a6fc54c385a5 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:03.839909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-983c309a-5f99-4ee8-b368-a6fc54c385a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:03.867659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb490613-c612-4317-b93d-0b01ac75bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:03.868428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490613-c612-4317-b93d-0b01ac75bc84 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:03.868738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490613-c612-4317-b93d-0b01ac75bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:03.869016 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490613-c612-4317-b93d-0b01ac75bc84 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:03.870965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb490613-c612-4317-b93d-0b01ac75bc84 None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:03.872435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb490613-c612-4317-b93d-0b01ac75bc84 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:03.874153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 68/136] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:03 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:03.875176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb490613-c612-4317-b93d-0b01ac75bc84 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:03.934369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 69/137] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:03.936297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c309a-5f99-4ee8-b368-a6fc54c385a5 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:03.997100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb490613-c612-4317-b93d-0b01ac75bc84 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:04.024981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:04.037703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4123c-e52f-4a35-9275-3bf13f459f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:04.038353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4123c-e52f-4a35-9275-3bf13f459f40 None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:04.038700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4123c-e52f-4a35-9275-3bf13f459f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:04.039040 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4123c-e52f-4a35-9275-3bf13f459f40 None admin] PATH_INFO: `/v3/projects/44ef9fefcd664326a8a0615b5ef73ae1/users/1fbe4ab79488470aa6024ab06cb3767f/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:04.041287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4123c-e52f-4a35-9275-3bf13f459f40 None admin] RBAC: Authorizing `identity:create_grant(project_id=44ef9fefcd664326a8a0615b5ef73ae1, user_id=1fbe4ab79488470aa6024ab06cb3767f, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:04.042941 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4123c-e52f-4a35-9275-3bf13f459f40 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:04.061549 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:04.066240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c309a-5f99-4ee8-b368-a6fc54c385a5 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:04.072886 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 69/138] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:02:03 2022] PUT /identity/v3/projects/44ef9fefcd664326a8a0615b5ef73ae1/users/1fbe4ab79488470aa6024ab06cb3767f/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:04.112083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055184f2-f739-4556-804a-2cddd8961e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:04.112768 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055184f2-f739-4556-804a-2cddd8961e01 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:04.113042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055184f2-f739-4556-804a-2cddd8961e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:04.113341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055184f2-f739-4556-804a-2cddd8961e01 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba/users/1fbe4ab79488470aa6024ab06cb3767f/roles/b3796e568aa342a1b3318b04d23a9cc0` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:04.115629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055184f2-f739-4556-804a-2cddd8961e01 None admin] RBAC: Authorizing `identity:create_grant(project_id=39be93f42044484fa6db903b2c759bba, user_id=1fbe4ab79488470aa6024ab06cb3767f, role_id=b3796e568aa342a1b3318b04d23a9cc0)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:04.117129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055184f2-f739-4556-804a-2cddd8961e01 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:04.134993 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 70/139] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:02:03 2022] PUT /identity/v3/projects/39be93f42044484fa6db903b2c759bba/users/1fbe4ab79488470aa6024ab06cb3767f/roles/b3796e568aa342a1b3318b04d23a9cc0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:04.369191 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4123c-e52f-4a35-9275-3bf13f459f40 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:04.511337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4123c-e52f-4a35-9275-3bf13f459f40 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:04.540897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ba43-0916-4ba8-ad3e-aaf8caddd498 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:04.541272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ba43-0916-4ba8-ad3e-aaf8caddd498 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:04.541505 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ba43-0916-4ba8-ad3e-aaf8caddd498 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:04.542854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 71/140] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:02:04.548834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fef02-b676-4790-96a9-1cb18ac171ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:04.549000 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b9634-f378-483d-935d-2ac7eb6fb3ce None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:04.549316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b9634-f378-483d-935d-2ac7eb6fb3ce None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:04.549508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fef02-b676-4790-96a9-1cb18ac171ae None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:04.549603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b9634-f378-483d-935d-2ac7eb6fb3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:04.549790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fef02-b676-4790-96a9-1cb18ac171ae None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:04.550064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fef02-b676-4790-96a9-1cb18ac171ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:04.551242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fef02-b676-4790-96a9-1cb18ac171ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:04.552674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fef02-b676-4790-96a9-1cb18ac171ae None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:04.554276 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 70/141] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:04.560053 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fef02-b676-4790-96a9-1cb18ac171ae None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:04.573479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-382b9634-f378-483d-935d-2ac7eb6fb3ce None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:04.574773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-382b9634-f378-483d-935d-2ac7eb6fb3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:04.620977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:04.654236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 72/142] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:04.686366 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fef02-b676-4790-96a9-1cb18ac171ae None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:04.726958 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522937b3-6776-42b5-b3a2-445c98c2582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:04.727865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522937b3-6776-42b5-b3a2-445c98c2582c None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:04.728374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522937b3-6776-42b5-b3a2-445c98c2582c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:04.728785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522937b3-6776-42b5-b3a2-445c98c2582c None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:04.729846 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522937b3-6776-42b5-b3a2-445c98c2582c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:04.732261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522937b3-6776-42b5-b3a2-445c98c2582c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:04.766787 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 71/143] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:02:04 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:02:04.950459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b9634-f378-483d-935d-2ac7eb6fb3ce None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:05.044288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:05.058182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b9634-f378-483d-935d-2ac7eb6fb3ce None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:05.104463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896fb98-52f9-40ff-ac64-cf666886dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:05.105110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896fb98-52f9-40ff-ac64-cf666886dc44 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:05.105411 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896fb98-52f9-40ff-ac64-cf666886dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:05.105676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896fb98-52f9-40ff-ac64-cf666886dc44 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:05.116475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896fb98-52f9-40ff-ac64-cf666886dc44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-a896fb98-52f9-40ff-ac64-cf666886dc44 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:05.122148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:05.123010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:05.124204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:05.124204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:05.124204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:05.124204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:05.124204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:05.124204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:05.124204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:05.124204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:05.124204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:05.124204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:05.124204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:05.124204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:05.124204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 73/144] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:05.129953 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522937b3-6776-42b5-b3a2-445c98c2582c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:05.269416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522937b3-6776-42b5-b3a2-445c98c2582c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:05.283578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:05.317159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e97cfb-71bd-4107-9a43-11050de3ae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:05.317800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e97cfb-71bd-4107-9a43-11050de3ae09 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:05.318076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e97cfb-71bd-4107-9a43-11050de3ae09 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:05.318340 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e97cfb-71bd-4107-9a43-11050de3ae09 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:05.319006 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e97cfb-71bd-4107-9a43-11050de3ae09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:05.319306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e97cfb-71bd-4107-9a43-11050de3ae09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:05.320667 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e97cfb-71bd-4107-9a43-11050de3ae09 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:05.332864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 72/145] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:05.338474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896fb98-52f9-40ff-ac64-cf666886dc44 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:05.453071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896fb98-52f9-40ff-ac64-cf666886dc44 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:05.493456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668dd21-f79b-4838-8509-c3e72fbf783f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:05.494115 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668dd21-f79b-4838-8509-c3e72fbf783f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:05.494384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668dd21-f79b-4838-8509-c3e72fbf783f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:05.494648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668dd21-f79b-4838-8509-c3e72fbf783f None admin] PATH_INFO: `/v3/users/972bf36c35f24c999bcb9fcad86d20a8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:05.495782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668dd21-f79b-4838-8509-c3e72fbf783f None admin] RBAC: Authorizing `identity:get_user(user_id=972bf36c35f24c999bcb9fcad86d20a8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:05.497234 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668dd21-f79b-4838-8509-c3e72fbf783f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:05.498811 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 74/146] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:05 2022] GET /identity/v3/users/972bf36c35f24c999bcb9fcad86d20a8 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:05.504474 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e97cfb-71bd-4107-9a43-11050de3ae09 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:05.626223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e97cfb-71bd-4107-9a43-11050de3ae09 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:05.671359 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b18f4d-f1fa-4198-93a1-0dcb1a7061dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:05.671995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b18f4d-f1fa-4198-93a1-0dcb1a7061dd None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:05.672266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b18f4d-f1fa-4198-93a1-0dcb1a7061dd None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:05.672530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b18f4d-f1fa-4198-93a1-0dcb1a7061dd None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:05.682191 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b18f4d-f1fa-4198-93a1-0dcb1a7061dd None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:05.683898 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b18f4d-f1fa-4198-93a1-0dcb1a7061dd None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:05.685912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 73/147] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:05 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:05.691644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668dd21-f79b-4838-8509-c3e72fbf783f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:05.715424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:05.805281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7b56b-d639-420d-b185-c213395385d3 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:05.805594 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7b56b-d639-420d-b185-c213395385d3 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:05.805828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7b56b-d639-420d-b185-c213395385d3 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:05.807717 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 74/148] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:05.812679 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668dd21-f79b-4838-8509-c3e72fbf783f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:05.814098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f49a0f-9c25-4145-b205-571786332b00 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:05.814375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f49a0f-9c25-4145-b205-571786332b00 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:05.814641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f49a0f-9c25-4145-b205-571786332b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:05.846663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e5f49a0f-9c25-4145-b205-571786332b00 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:05.847873 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e5f49a0f-9c25-4145-b205-571786332b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:05.895797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c5a68-5c70-48b9-9a91-ad6eb10bfd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:05.896376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c5a68-5c70-48b9-9a91-ad6eb10bfd87 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:05.896647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c5a68-5c70-48b9-9a91-ad6eb10bfd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:05.896913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c5a68-5c70-48b9-9a91-ad6eb10bfd87 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba/users/972bf36c35f24c999bcb9fcad86d20a8/roles/86d6f10ad167487ab620bf591795470c` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:05.901123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c5a68-5c70-48b9-9a91-ad6eb10bfd87 None admin] RBAC: Authorizing `identity:create_grant(project_id=39be93f42044484fa6db903b2c759bba, user_id=972bf36c35f24c999bcb9fcad86d20a8, role_id=86d6f10ad167487ab620bf591795470c)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:05.904476 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c5a68-5c70-48b9-9a91-ad6eb10bfd87 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:05.927902 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:05.936027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 75/149] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:02:05 2022] PUT /identity/v3/projects/39be93f42044484fa6db903b2c759bba/users/972bf36c35f24c999bcb9fcad86d20a8/roles/86d6f10ad167487ab620bf591795470c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:05.975484 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 75/150] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:06.543662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c5a68-5c70-48b9-9a91-ad6eb10bfd87 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:06.643881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:06.673242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c5a68-5c70-48b9-9a91-ad6eb10bfd87 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:06.719533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f94c57-134a-4192-8d83-3a21400e73e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:06.720177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94c57-134a-4192-8d83-3a21400e73e7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:06.720449 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94c57-134a-4192-8d83-3a21400e73e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:06.720715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94c57-134a-4192-8d83-3a21400e73e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:06.741456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f94c57-134a-4192-8d83-3a21400e73e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-58f94c57-134a-4192-8d83-3a21400e73e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:06.746677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:06.747520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:06.748273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:06.748273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:06.748273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:06.748273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:06.748273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:06.748273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:06.748273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:06.748273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:06.748273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:06.748273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:06.748273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:06.748273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:06.748273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 76/151] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:06.754870 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f49a0f-9c25-4145-b205-571786332b00 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:06.876723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f49a0f-9c25-4145-b205-571786332b00 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:06.915576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33439113-a00d-4df4-a6b3-6e2c14bed55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:06.916763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33439113-a00d-4df4-a6b3-6e2c14bed55d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:06.917043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33439113-a00d-4df4-a6b3-6e2c14bed55d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:06.917331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33439113-a00d-4df4-a6b3-6e2c14bed55d None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:06.917999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33439113-a00d-4df4-a6b3-6e2c14bed55d None admin] RBAC: Adding query filter params (name=member) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:06.918299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33439113-a00d-4df4-a6b3-6e2c14bed55d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:06.919675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33439113-a00d-4df4-a6b3-6e2c14bed55d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:06.933574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 76/152] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:06.939152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f94c57-134a-4192-8d83-3a21400e73e7 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:07.064072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f94c57-134a-4192-8d83-3a21400e73e7 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:07.110821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ca619-0621-4a4f-bc0a-154598557c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:07.111471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ca619-0621-4a4f-bc0a-154598557c4c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:07.111744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ca619-0621-4a4f-bc0a-154598557c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:07.112008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ca619-0621-4a4f-bc0a-154598557c4c None admin] PATH_INFO: `/v3/users/1fbe4ab79488470aa6024ab06cb3767f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:07.113151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ca619-0621-4a4f-bc0a-154598557c4c None admin] RBAC: Authorizing `identity:get_user(user_id=1fbe4ab79488470aa6024ab06cb3767f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:07.114679 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ca619-0621-4a4f-bc0a-154598557c4c None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:07.116377 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 77/153] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:06 2022] GET /identity/v3/users/1fbe4ab79488470aa6024ab06cb3767f => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:07.122572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33439113-a00d-4df4-a6b3-6e2c14bed55d None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:07.166216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:07.231422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af08f8-6d65-42e8-a454-d3913f284cf0 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:07.231745 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af08f8-6d65-42e8-a454-d3913f284cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:07.231953 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af08f8-6d65-42e8-a454-d3913f284cf0 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:07.233553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 78/154] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:07.242551 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99751ebe-8537-4010-84ec-c523ee226f55 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:07.242836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99751ebe-8537-4010-84ec-c523ee226f55 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:07.243137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99751ebe-8537-4010-84ec-c523ee226f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:07.256473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33439113-a00d-4df4-a6b3-6e2c14bed55d None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:07.259187 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:07.281351 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-99751ebe-8537-4010-84ec-c523ee226f55 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:07.282851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-99751ebe-8537-4010-84ec-c523ee226f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:07.306559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4c669-bf68-4eab-a282-995678b31e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:07.307248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4c669-bf68-4eab-a282-995678b31e0b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:07.307459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4c669-bf68-4eab-a282-995678b31e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:07.307731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4c669-bf68-4eab-a282-995678b31e0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:07.389605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4c669-bf68-4eab-a282-995678b31e0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:07.391586 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4c669-bf68-4eab-a282-995678b31e0b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:07.431168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:07.464211 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 79/155] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:07.509377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 77/156] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:07.515541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99751ebe-8537-4010-84ec-c523ee226f55 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:07.643082 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99751ebe-8537-4010-84ec-c523ee226f55 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:07.656456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611bdc-f9e8-4f8a-ba09-51dde4961d7a None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:07.657225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611bdc-f9e8-4f8a-ba09-51dde4961d7a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:07.657605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611bdc-f9e8-4f8a-ba09-51dde4961d7a None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:07.659081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 78/157] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:02:07.681869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7434b-d59e-4c60-8b8e-0475c73318ad None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:07.682238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7434b-d59e-4c60-8b8e-0475c73318ad None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:07.682602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7434b-d59e-4c60-8b8e-0475c73318ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:07.694529 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d134ca-0a52-43dd-82e8-e394a0fd0571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:07.695184 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d134ca-0a52-43dd-82e8-e394a0fd0571 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:07.695461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d134ca-0a52-43dd-82e8-e394a0fd0571 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:07.695714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d134ca-0a52-43dd-82e8-e394a0fd0571 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:07.697787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d134ca-0a52-43dd-82e8-e394a0fd0571 None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:07.699242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d134ca-0a52-43dd-82e8-e394a0fd0571 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:07.701082 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 80/158] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:07 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:07.706907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d134ca-0a52-43dd-82e8-e394a0fd0571 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:07.709785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:07.714934 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-72d7434b-d59e-4c60-8b8e-0475c73318ad None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:07.716277 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-72d7434b-d59e-4c60-8b8e-0475c73318ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:07.851771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 79/159] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:07.913316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d134ca-0a52-43dd-82e8-e394a0fd0571 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:07.947415 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7434b-d59e-4c60-8b8e-0475c73318ad None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:07.957795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ae6fb-89eb-45ed-86d9-447266dea997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:07.958633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ae6fb-89eb-45ed-86d9-447266dea997 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:07.959138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ae6fb-89eb-45ed-86d9-447266dea997 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:07.959543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ae6fb-89eb-45ed-86d9-447266dea997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:07.960983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ae6fb-89eb-45ed-86d9-447266dea997 None admin] RBAC: Adding query filter params (role.id=2dfbdb214b97432588648dba947cb07a, scope.project.id=39be93f42044484fa6db903b2c759bba, user.id=1fbe4ab79488470aa6024ab06cb3767f) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:07.961457 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ae6fb-89eb-45ed-86d9-447266dea997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:07.963156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ae6fb-89eb-45ed-86d9-447266dea997 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:07.970258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 81/160] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:07 2022] GET /identity/v3/role_assignments?user.id=1fbe4ab79488470aa6024ab06cb3767f&scope.project.id=39be93f42044484fa6db903b2c759bba&role.id=2dfbdb214b97432588648dba947cb07a => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:07.972198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b9bae-1a35-4c99-8a35-29839b25ff96 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:07.972742 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b9bae-1a35-4c99-8a35-29839b25ff96 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:07.973150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b9bae-1a35-4c99-8a35-29839b25ff96 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:07.974811 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 82/161] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:07.980336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf2218-6ea8-46bf-aef3-9ece8750d9fe None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:07.980816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf2218-6ea8-46bf-aef3-9ece8750d9fe None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:07.981274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf2218-6ea8-46bf-aef3-9ece8750d9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:08.010406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-55bf2218-6ea8-46bf-aef3-9ece8750d9fe None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:08.011859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-55bf2218-6ea8-46bf-aef3-9ece8750d9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:08.071143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:08.102018 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:08.114078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 83/162] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:08.163896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7434b-d59e-4c60-8b8e-0475c73318ad None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:08.213714 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c5f74-636a-4591-9cda-2d5482525331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:08.214276 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c5f74-636a-4591-9cda-2d5482525331 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:08.214549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c5f74-636a-4591-9cda-2d5482525331 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:08.214817 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c5f74-636a-4591-9cda-2d5482525331 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:08.228142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c5f74-636a-4591-9cda-2d5482525331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-2a5c5f74-636a-4591-9cda-2d5482525331 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:08.234300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:08.235169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:08.236337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:08.236337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:08.236337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:08.236337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:08.236337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:08.236337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:08.236337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:08.236337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:08.236337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:08.236337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:08.236337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:08.236337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:08.236337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 80/163] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:02:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:08.241757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf2218-6ea8-46bf-aef3-9ece8750d9fe None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:08.340774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c5f74-636a-4591-9cda-2d5482525331 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:08.407569 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf2218-6ea8-46bf-aef3-9ece8750d9fe None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:08.481766 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb98c64-a9c5-4f36-a0b4-08690d9ce357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:08.482323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb98c64-a9c5-4f36-a0b4-08690d9ce357 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:08.482615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb98c64-a9c5-4f36-a0b4-08690d9ce357 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:08.482884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb98c64-a9c5-4f36-a0b4-08690d9ce357 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:08.483584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb98c64-a9c5-4f36-a0b4-08690d9ce357 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:08.483883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb98c64-a9c5-4f36-a0b4-08690d9ce357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:08.488968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb98c64-a9c5-4f36-a0b4-08690d9ce357 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:08.502063 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 84/164] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:08.510184 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb98c64-a9c5-4f36-a0b4-08690d9ce357 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:08.557735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c5f74-636a-4591-9cda-2d5482525331 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:08.607493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:08.621474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:08.635754 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc494e-822f-4897-b425-9a98fd34c4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:08.636457 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc494e-822f-4897-b425-9a98fd34c4db None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:08.636738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc494e-822f-4897-b425-9a98fd34c4db None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:08.637008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc494e-822f-4897-b425-9a98fd34c4db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:08.666894 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc494e-822f-4897-b425-9a98fd34c4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-94cc494e-822f-4897-b425-9a98fd34c4db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:08.671877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:08.672735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 81/165] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:02:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:02:08.673993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc494e-822f-4897-b425-9a98fd34c4db None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:08.717428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb98c64-a9c5-4f36-a0b4-08690d9ce357 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:08.790086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7b41f-8645-44b2-a6b9-5ca2b561fdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:08.790816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7b41f-8645-44b2-a6b9-5ca2b561fdee None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:08.791088 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7b41f-8645-44b2-a6b9-5ca2b561fdee None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:08.791424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7b41f-8645-44b2-a6b9-5ca2b561fdee None admin] PATH_INFO: `/v3/users/1fbe4ab79488470aa6024ab06cb3767f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:08.792713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7b41f-8645-44b2-a6b9-5ca2b561fdee None admin] RBAC: Authorizing `identity:get_user(user_id=1fbe4ab79488470aa6024ab06cb3767f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:08.794213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7b41f-8645-44b2-a6b9-5ca2b561fdee None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:08.796023 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 85/166] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:08 2022] GET /identity/v3/users/1fbe4ab79488470aa6024ab06cb3767f => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:08.796590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7b41f-8645-44b2-a6b9-5ca2b561fdee None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:08.895981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc494e-822f-4897-b425-9a98fd34c4db None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:08.949037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebf8f7-6d7f-4478-a61f-3f8745516b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:08.950227 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebf8f7-6d7f-4478-a61f-3f8745516b4d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:08.950861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebf8f7-6d7f-4478-a61f-3f8745516b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:08.951326 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebf8f7-6d7f-4478-a61f-3f8745516b4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:08.967643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebf8f7-6d7f-4478-a61f-3f8745516b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-d0ebf8f7-6d7f-4478-a61f-3f8745516b4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:08.973057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:08.973982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:08.974852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:08.974852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:08.974852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:08.974852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:08.974852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:08.974852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:08.974852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:08.974852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:08.974852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:08.974852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:08.974852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:08.974852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:08.977300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 82/167] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:08.979113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebf8f7-6d7f-4478-a61f-3f8745516b4d None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:09.029065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:09.072068 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7b41f-8645-44b2-a6b9-5ca2b561fdee None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:09.108757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebf8f7-6d7f-4478-a61f-3f8745516b4d None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:09.142897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:09.150421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014af7a7-c227-40cc-a110-887ff83f8f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:09.152524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af7a7-c227-40cc-a110-887ff83f8f83 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:09.153020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af7a7-c227-40cc-a110-887ff83f8f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:09.153536 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af7a7-c227-40cc-a110-887ff83f8f83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:09.174498 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00bb48-c64a-4ee5-bf71-6d7b0c38bf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:09.175127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00bb48-c64a-4ee5-bf71-6d7b0c38bf35 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:09.175392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00bb48-c64a-4ee5-bf71-6d7b0c38bf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:09.175685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00bb48-c64a-4ee5-bf71-6d7b0c38bf35 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:09.176388 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00bb48-c64a-4ee5-bf71-6d7b0c38bf35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:09.176690 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00bb48-c64a-4ee5-bf71-6d7b0c38bf35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:09.178108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00bb48-c64a-4ee5-bf71-6d7b0c38bf35 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:09.196796 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 86/168] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:09.197933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00bb48-c64a-4ee5-bf71-6d7b0c38bf35 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:09.241550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014af7a7-c227-40cc-a110-887ff83f8f83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:09.243721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014af7a7-c227-40cc-a110-887ff83f8f83 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:09.294001 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:09.336232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00bb48-c64a-4ee5-bf71-6d7b0c38bf35 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:09.357729 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 83/169] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:09.358821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014af7a7-c227-40cc-a110-887ff83f8f83 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:09.379471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30322c21-7997-468e-8c99-562e8bac7f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:09.380094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30322c21-7997-468e-8c99-562e8bac7f80 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:09.380369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30322c21-7997-468e-8c99-562e8bac7f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:09.380642 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30322c21-7997-468e-8c99-562e8bac7f80 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:09.381467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30322c21-7997-468e-8c99-562e8bac7f80 None admin] RBAC: Adding query filter params (name=member) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:09.381796 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30322c21-7997-468e-8c99-562e8bac7f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:09.383194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30322c21-7997-468e-8c99-562e8bac7f80 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:09.393892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 87/170] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:09.395399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe6752-fabd-485d-a1eb-e2dfdfbde1e0 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:09.395669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe6752-fabd-485d-a1eb-e2dfdfbde1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:09.395945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe6752-fabd-485d-a1eb-e2dfdfbde1e0 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:09.397152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 88/171] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:09.397865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe6752-fabd-485d-a1eb-e2dfdfbde1e0 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:09.477593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:09.534571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe6752-fabd-485d-a1eb-e2dfdfbde1e0 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:09.553523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014af7a7-c227-40cc-a110-887ff83f8f83 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:09.596538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e8ca2-3d57-4cd6-872e-d2b5cd28f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:09.597102 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e8ca2-3d57-4cd6-872e-d2b5cd28f068 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:09.597447 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e8ca2-3d57-4cd6-872e-d2b5cd28f068 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:09.597721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e8ca2-3d57-4cd6-872e-d2b5cd28f068 None admin] PATH_INFO: `/v3/users/5c98c93e9a414022917c074607b2165d` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:09.599557 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e8ca2-3d57-4cd6-872e-d2b5cd28f068 None admin] RBAC: Authorizing `identity:get_user(user_id=5c98c93e9a414022917c074607b2165d)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:09.601268 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e8ca2-3d57-4cd6-872e-d2b5cd28f068 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:09.602930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 84/172] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:09 2022] GET /identity/v3/users/5c98c93e9a414022917c074607b2165d => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:09.603789 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e8ca2-3d57-4cd6-872e-d2b5cd28f068 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:09.617814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:09.621604 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865614e-f55c-4b5e-b5ad-b6aec466272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:09.622254 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865614e-f55c-4b5e-b5ad-b6aec466272d None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:09.622530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865614e-f55c-4b5e-b5ad-b6aec466272d None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:09.622799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865614e-f55c-4b5e-b5ad-b6aec466272d None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:09.624798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865614e-f55c-4b5e-b5ad-b6aec466272d None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:09.626574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865614e-f55c-4b5e-b5ad-b6aec466272d None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:09.633245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 89/173] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:09 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:09.634772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abef37-13b7-4c57-8e23-e0a50b33e1a1 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:09.635050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abef37-13b7-4c57-8e23-e0a50b33e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:09.635322 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abef37-13b7-4c57-8e23-e0a50b33e1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:09.673360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-53abef37-13b7-4c57-8e23-e0a50b33e1a1 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:09.676233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-53abef37-13b7-4c57-8e23-e0a50b33e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:09.767076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e8ca2-3d57-4cd6-872e-d2b5cd28f068 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:09.784843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 90/174] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:09.785654 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abef37-13b7-4c57-8e23-e0a50b33e1a1 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:09.812823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b317d2-c08e-4131-8ffc-8e431af7565a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:09.813536 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b317d2-c08e-4131-8ffc-8e431af7565a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:09.813808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b317d2-c08e-4131-8ffc-8e431af7565a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:09.814071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b317d2-c08e-4131-8ffc-8e431af7565a None admin] PATH_INFO: `/v3/users/1fbe4ab79488470aa6024ab06cb3767f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:09.816291 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b317d2-c08e-4131-8ffc-8e431af7565a None admin] RBAC: Authorizing `identity:get_user(user_id=1fbe4ab79488470aa6024ab06cb3767f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:09.817820 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b317d2-c08e-4131-8ffc-8e431af7565a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:09.819480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 85/175] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:09 2022] GET /identity/v3/users/1fbe4ab79488470aa6024ab06cb3767f => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:09.820230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b317d2-c08e-4131-8ffc-8e431af7565a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:09.897674 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:09.938943 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:09.956795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abef37-13b7-4c57-8e23-e0a50b33e1a1 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:09.966697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b317d2-c08e-4131-8ffc-8e431af7565a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:09.995141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc80538-cd9d-453d-89a1-7ddcd1166087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:09.996196 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80538-cd9d-453d-89a1-7ddcd1166087 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:09.996712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80538-cd9d-453d-89a1-7ddcd1166087 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:09.997314 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80538-cd9d-453d-89a1-7ddcd1166087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.005012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cdb9a-054b-45b4-aa7c-75413edcf549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:10.005872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cdb9a-054b-45b4-aa7c-75413edcf549 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.006294 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cdb9a-054b-45b4-aa7c-75413edcf549 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.006702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cdb9a-054b-45b4-aa7c-75413edcf549 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.007566 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cdb9a-054b-45b4-aa7c-75413edcf549 None admin] RBAC: Adding query filter params (role.id=b3796e568aa342a1b3318b04d23a9cc0, scope.project.id=39be93f42044484fa6db903b2c759bba, user.id=1fbe4ab79488470aa6024ab06cb3767f) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:10.008073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cdb9a-054b-45b4-aa7c-75413edcf549 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:10.010250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cdb9a-054b-45b4-aa7c-75413edcf549 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:10.016565 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 86/176] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:09 2022] GET /identity/v3/role_assignments?user.id=1fbe4ab79488470aa6024ab06cb3767f&scope.project.id=39be93f42044484fa6db903b2c759bba&role.id=b3796e568aa342a1b3318b04d23a9cc0 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:10.017967 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67f35-dbb6-40ea-9201-d92e5c3c1712 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.018387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67f35-dbb6-40ea-9201-d92e5c3c1712 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.018865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67f35-dbb6-40ea-9201-d92e5c3c1712 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.020496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 87/177] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:10.026212 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a67f35-dbb6-40ea-9201-d92e5c3c1712 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:10.077905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc80538-cd9d-453d-89a1-7ddcd1166087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:10.079661 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc80538-cd9d-453d-89a1-7ddcd1166087 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:10.139506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:10.149374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a67f35-dbb6-40ea-9201-d92e5c3c1712 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:10.191336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffde87-b4ea-4721-88ee-18e4c74fbab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:10.191336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffde87-b4ea-4721-88ee-18e4c74fbab1 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.191637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffde87-b4ea-4721-88ee-18e4c74fbab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.191789 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffde87-b4ea-4721-88ee-18e4c74fbab1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.206651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:10.209396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 91/178] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:10.210338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21c986-722d-4366-b80b-b4e06bda6725 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.210620 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21c986-722d-4366-b80b-b4e06bda6725 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.210892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21c986-722d-4366-b80b-b4e06bda6725 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.216073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 92/179] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:10.216073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b76e4-edc7-4299-9442-0d9e669b0b4e None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.216073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b76e4-edc7-4299-9442-0d9e669b0b4e None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.216073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b76e4-edc7-4299-9442-0d9e669b0b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.237045 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a93b76e4-edc7-4299-9442-0d9e669b0b4e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:10.238313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a93b76e4-edc7-4299-9442-0d9e669b0b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:10.276141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffde87-b4ea-4721-88ee-18e4c74fbab1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:10.277629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffde87-b4ea-4721-88ee-18e4c74fbab1 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:10.308417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 93/180] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:10.316238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254a03c-5577-43c9-bdc8-54ceb2971d73 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.316238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254a03c-5577-43c9-bdc8-54ceb2971d73 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.316238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254a03c-5577-43c9-bdc8-54ceb2971d73 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.316238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 94/181] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:10.316238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254a03c-5577-43c9-bdc8-54ceb2971d73 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:10.391882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 88/182] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:10.391882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffde87-b4ea-4721-88ee-18e4c74fbab1 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:10.396378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:10.423695 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254a03c-5577-43c9-bdc8-54ceb2971d73 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:10.433486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:10.461482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59c2a4-577d-4e6d-8fb4-89cc5ea6c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:10.462471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59c2a4-577d-4e6d-8fb4-89cc5ea6c734 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.462725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59c2a4-577d-4e6d-8fb4-89cc5ea6c734 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.463130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59c2a4-577d-4e6d-8fb4-89cc5ea6c734 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.473480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59c2a4-577d-4e6d-8fb4-89cc5ea6c734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-ec59c2a4-577d-4e6d-8fb4-89cc5ea6c734 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:10.478363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:10.479442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 95/183] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:10.485133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3e658-0fc4-47b1-bea0-51d13fc6944f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.486027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3e658-0fc4-47b1-bea0-51d13fc6944f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.486027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3e658-0fc4-47b1-bea0-51d13fc6944f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.501378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-f1b3e658-0fc4-47b1-bea0-51d13fc6944f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:10.502555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f1b3e658-0fc4-47b1-bea0-51d13fc6944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:10.502665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffde87-b4ea-4721-88ee-18e4c74fbab1 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:10.540350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900917b-5d35-4c54-881e-4020b6370a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:10.541305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900917b-5d35-4c54-881e-4020b6370a3d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.542463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900917b-5d35-4c54-881e-4020b6370a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.542741 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900917b-5d35-4c54-881e-4020b6370a3d None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.543893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900917b-5d35-4c54-881e-4020b6370a3d None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:10.545371 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900917b-5d35-4c54-881e-4020b6370a3d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:10.547588 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 89/184] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:10 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:10.549036 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fe848-10fd-470e-8a70-89880b56ed35 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.549335 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fe848-10fd-470e-8a70-89880b56ed35 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.549603 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fe848-10fd-470e-8a70-89880b56ed35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.572136 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-0b0fe848-10fd-470e-8a70-89880b56ed35 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:10.573043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 96/185] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:10.573400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0b0fe848-10fd-470e-8a70-89880b56ed35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:10.578108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3e658-0fc4-47b1-bea0-51d13fc6944f None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:10.646658 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 90/186] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:10.646989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:10.648086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fe848-10fd-470e-8a70-89880b56ed35 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:10.695986 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:10.696712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3e658-0fc4-47b1-bea0-51d13fc6944f None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:10.743651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5070508-3ac5-410d-bf00-a5c65f40b616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:10.744673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5070508-3ac5-410d-bf00-a5c65f40b616 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.745166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5070508-3ac5-410d-bf00-a5c65f40b616 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.745689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5070508-3ac5-410d-bf00-a5c65f40b616 None admin] PATH_INFO: `/v3/projects/44ef9fefcd664326a8a0615b5ef73ae1` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.747544 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5070508-3ac5-410d-bf00-a5c65f40b616 None admin] RBAC: Authorizing `identity:get_project(project_id=44ef9fefcd664326a8a0615b5ef73ae1)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:10.749748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5070508-3ac5-410d-bf00-a5c65f40b616 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:10.752595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 97/187] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:10 2022] GET /identity/v3/projects/44ef9fefcd664326a8a0615b5ef73ae1 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:10.753971 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5070508-3ac5-410d-bf00-a5c65f40b616 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:10.768440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fe848-10fd-470e-8a70-89880b56ed35 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:10.811669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b88b1-27ba-4231-a7d0-73c6de16d44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:10.812306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b88b1-27ba-4231-a7d0-73c6de16d44e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.812575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b88b1-27ba-4231-a7d0-73c6de16d44e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.812835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b88b1-27ba-4231-a7d0-73c6de16d44e None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.813537 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b88b1-27ba-4231-a7d0-73c6de16d44e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:10.813830 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b88b1-27ba-4231-a7d0-73c6de16d44e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:10.815657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b88b1-27ba-4231-a7d0-73c6de16d44e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:10.830125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 91/188] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:10.830125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b88b1-27ba-4231-a7d0-73c6de16d44e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:10.872682 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5070508-3ac5-410d-bf00-a5c65f40b616 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:10.908665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd754c3-170f-46f9-b0fa-5549efd9b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:10.909304 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd754c3-170f-46f9-b0fa-5549efd9b3ad None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.909582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd754c3-170f-46f9-b0fa-5549efd9b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.909850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd754c3-170f-46f9-b0fa-5549efd9b3ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.910621 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd754c3-170f-46f9-b0fa-5549efd9b3ad None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=39be93f42044484fa6db903b2c759bba, user.id=5c98c93e9a414022917c074607b2165d) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:10.910930 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd754c3-170f-46f9-b0fa-5549efd9b3ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:10.912365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd754c3-170f-46f9-b0fa-5549efd9b3ad None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:10.915732 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:10.921364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 98/189] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:10 2022] GET /identity/v3/role_assignments?user.id=5c98c93e9a414022917c074607b2165d&scope.project.id=39be93f42044484fa6db903b2c759bba&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:10.922461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd754c3-170f-46f9-b0fa-5549efd9b3ad None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:10.938148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b88b1-27ba-4231-a7d0-73c6de16d44e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:10.940073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:10.980424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f02062-9138-48c2-bca9-26d96904c2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:10.980761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f02062-9138-48c2-bca9-26d96904c2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:10.980998 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f02062-9138-48c2-bca9-26d96904c2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:10.981298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f02062-9138-48c2-bca9-26d96904c2c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:10.993381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f02062-9138-48c2-bca9-26d96904c2c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-80f02062-9138-48c2-bca9-26d96904c2c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:10.999368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:11.000354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 92/190] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:11.006224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f02062-9138-48c2-bca9-26d96904c2c8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:11.040337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd754c3-170f-46f9-b0fa-5549efd9b3ad None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:11.082453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f0dc-b18c-480b-8314-9f6ddd543838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:11.083111 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f0dc-b18c-480b-8314-9f6ddd543838 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:11.083378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f0dc-b18c-480b-8314-9f6ddd543838 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:11.083640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f0dc-b18c-480b-8314-9f6ddd543838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:11.087018 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f0dc-b18c-480b-8314-9f6ddd543838 None admin] RBAC: Adding query filter params (role.id=2dfbdb214b97432588648dba947cb07a, scope.project.id=44ef9fefcd664326a8a0615b5ef73ae1, user.id=1fbe4ab79488470aa6024ab06cb3767f) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:11.087018 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f0dc-b18c-480b-8314-9f6ddd543838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:11.087018 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f0dc-b18c-480b-8314-9f6ddd543838 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:11.093946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 99/191] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:10 2022] GET /identity/v3/role_assignments?user.id=1fbe4ab79488470aa6024ab06cb3767f&scope.project.id=44ef9fefcd664326a8a0615b5ef73ae1&role.id=2dfbdb214b97432588648dba947cb07a => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:11.095009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f0dc-b18c-480b-8314-9f6ddd543838 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:11.147368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f02062-9138-48c2-bca9-26d96904c2c8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:11.179874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:11.196942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909493f-3723-44d0-805a-109c4314d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:11.197620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909493f-3723-44d0-805a-109c4314d22b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:11.197896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909493f-3723-44d0-805a-109c4314d22b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:11.198159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909493f-3723-44d0-805a-109c4314d22b None admin] PATH_INFO: `/v3/users/e63fb239a1a84cd8b20e63834a10fa57` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:11.217463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909493f-3723-44d0-805a-109c4314d22b None admin] RBAC: Authorizing `identity:get_user(user_id=e63fb239a1a84cd8b20e63834a10fa57)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:11.219721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909493f-3723-44d0-805a-109c4314d22b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:11.222159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 93/192] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:11 2022] GET /identity/v3/users/e63fb239a1a84cd8b20e63834a10fa57 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:11.222810 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909493f-3723-44d0-805a-109c4314d22b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:11.229070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f0dc-b18c-480b-8314-9f6ddd543838 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:11.247942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:11.275447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d908adc-8ec0-4a2a-aad8-ab3b52ed8181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:11.276436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d908adc-8ec0-4a2a-aad8-ab3b52ed8181 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:11.276782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d908adc-8ec0-4a2a-aad8-ab3b52ed8181 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:11.277129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d908adc-8ec0-4a2a-aad8-ab3b52ed8181 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:11.288792 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d908adc-8ec0-4a2a-aad8-ab3b52ed8181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-3d908adc-8ec0-4a2a-aad8-ab3b52ed8181 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:11.294364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:11.295460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:11.296425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:11.296425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:11.296425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:11.296425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:11.296425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:11.296425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:11.296425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:11.296425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:11.296425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:11.296425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:11.296425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:11.296425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:11.297154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 100/193] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:02:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:11.297853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d908adc-8ec0-4a2a-aad8-ab3b52ed8181 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:11.342242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909493f-3723-44d0-805a-109c4314d22b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:11.376028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cca0e6-d7ea-47ab-93c1-b92f69616c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:11.376653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cca0e6-d7ea-47ab-93c1-b92f69616c01 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:11.376926 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cca0e6-d7ea-47ab-93c1-b92f69616c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:11.377191 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cca0e6-d7ea-47ab-93c1-b92f69616c01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:11.378306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cca0e6-d7ea-47ab-93c1-b92f69616c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:11.379750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cca0e6-d7ea-47ab-93c1-b92f69616c01 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:11.385239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 94/194] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:11.385239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cca0e6-d7ea-47ab-93c1-b92f69616c01 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:11.403103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d908adc-8ec0-4a2a-aad8-ab3b52ed8181 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:11.431113 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:11.446814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f21ff6-cf0c-47bb-b56e-4bf48a6faafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:11.447686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f21ff6-cf0c-47bb-b56e-4bf48a6faafd None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:11.447958 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f21ff6-cf0c-47bb-b56e-4bf48a6faafd None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:11.448210 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f21ff6-cf0c-47bb-b56e-4bf48a6faafd None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:11.449113 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f21ff6-cf0c-47bb-b56e-4bf48a6faafd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:11.449113 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f21ff6-cf0c-47bb-b56e-4bf48a6faafd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:11.450529 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f21ff6-cf0c-47bb-b56e-4bf48a6faafd None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:11.458775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 101/195] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:11.462617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f21ff6-cf0c-47bb-b56e-4bf48a6faafd None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:11.476953 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:11.490135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cca0e6-d7ea-47ab-93c1-b92f69616c01 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:11.526743 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69dd2f-313b-4b57-b4d9-281166bc53f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:11.527341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69dd2f-313b-4b57-b4d9-281166bc53f9 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:11.527613 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69dd2f-313b-4b57-b4d9-281166bc53f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:11.527871 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69dd2f-313b-4b57-b4d9-281166bc53f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:11.565225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f21ff6-cf0c-47bb-b56e-4bf48a6faafd None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:11.597523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69dd2f-313b-4b57-b4d9-281166bc53f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:11.598990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69dd2f-313b-4b57-b4d9-281166bc53f9 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:11.599404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d14aa7-a9f9-458a-ace2-e4d1362ca298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:11.600005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d14aa7-a9f9-458a-ace2-e4d1362ca298 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:11.600271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d14aa7-a9f9-458a-ace2-e4d1362ca298 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:11.600528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d14aa7-a9f9-458a-ace2-e4d1362ca298 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:11.601185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d14aa7-a9f9-458a-ace2-e4d1362ca298 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:11.601510 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d14aa7-a9f9-458a-ace2-e4d1362ca298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:11.603113 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d14aa7-a9f9-458a-ace2-e4d1362ca298 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:11.611151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 102/196] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:11.615805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d14aa7-a9f9-458a-ace2-e4d1362ca298 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:11.660754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:11.687893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:11.702152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 95/197] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:11.703053 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69dd2f-313b-4b57-b4d9-281166bc53f9 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:11.714495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d14aa7-a9f9-458a-ace2-e4d1362ca298 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:11.754162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a4e5c-8b06-416b-b534-fc19a2e04b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:11.754776 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a4e5c-8b06-416b-b534-fc19a2e04b93 None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:11.755047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a4e5c-8b06-416b-b534-fc19a2e04b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:11.755325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a4e5c-8b06-416b-b534-fc19a2e04b93 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:11.755966 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a4e5c-8b06-416b-b534-fc19a2e04b93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:11.757545 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a4e5c-8b06-416b-b534-fc19a2e04b93 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:11.786127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 103/198] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:02:11 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:02:11.786951 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a4e5c-8b06-416b-b534-fc19a2e04b93 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:11.819181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69dd2f-313b-4b57-b4d9-281166bc53f9 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:11.864008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a0dce-d2df-44fd-817b-5ba4fcf47427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:11.864659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a0dce-d2df-44fd-817b-5ba4fcf47427 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:11.864909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a0dce-d2df-44fd-817b-5ba4fcf47427 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:11.865178 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a0dce-d2df-44fd-817b-5ba4fcf47427 None admin] PATH_INFO: `/v3/users/972bf36c35f24c999bcb9fcad86d20a8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:11.866496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a0dce-d2df-44fd-817b-5ba4fcf47427 None admin] RBAC: Authorizing `identity:get_user(user_id=972bf36c35f24c999bcb9fcad86d20a8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:11.867960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a0dce-d2df-44fd-817b-5ba4fcf47427 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:11.874554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 96/199] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:11 2022] GET /identity/v3/users/972bf36c35f24c999bcb9fcad86d20a8 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:11.874554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a0dce-d2df-44fd-817b-5ba4fcf47427 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:11.908827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a4e5c-8b06-416b-b534-fc19a2e04b93 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:11.912233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:11.935769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:11.954836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7b74b-5381-439a-9966-abc68cc96cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:11.955475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7b74b-5381-439a-9966-abc68cc96cab None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:11.955745 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7b74b-5381-439a-9966-abc68cc96cab None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:11.956010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7b74b-5381-439a-9966-abc68cc96cab None admin] PATH_INFO: `/v3/users/e63fb239a1a84cd8b20e63834a10fa57` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:11.957231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7b74b-5381-439a-9966-abc68cc96cab None admin] RBAC: Authorizing `identity:get_user(user_id=e63fb239a1a84cd8b20e63834a10fa57)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:11.958747 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7b74b-5381-439a-9966-abc68cc96cab None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:11.960395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 104/200] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:11 2022] GET /identity/v3/users/e63fb239a1a84cd8b20e63834a10fa57 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:11.961152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7b74b-5381-439a-9966-abc68cc96cab None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:11.993371 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a0dce-d2df-44fd-817b-5ba4fcf47427 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:12.036877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec4f4b-7f69-43d5-95c9-e50bc24b71c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:12.037395 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4f4b-7f69-43d5-95c9-e50bc24b71c4 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:12.037670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4f4b-7f69-43d5-95c9-e50bc24b71c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:12.037937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4f4b-7f69-43d5-95c9-e50bc24b71c4 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:12.039803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec4f4b-7f69-43d5-95c9-e50bc24b71c4 None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:12.042129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec4f4b-7f69-43d5-95c9-e50bc24b71c4 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:12.043846 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 97/201] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:11 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:12.044623 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec4f4b-7f69-43d5-95c9-e50bc24b71c4 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:12.100021 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7b74b-5381-439a-9966-abc68cc96cab None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:12.141074 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884e87a-1d02-4c78-942c-4dad8d1faa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:12.141718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884e87a-1d02-4c78-942c-4dad8d1faa86 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:12.141989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884e87a-1d02-4c78-942c-4dad8d1faa86 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:12.142254 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884e87a-1d02-4c78-942c-4dad8d1faa86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:12.180250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec4f4b-7f69-43d5-95c9-e50bc24b71c4 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:12.193824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:12.208959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:12.221783 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e011bc-2e8a-450a-a83a-3b4c6a860a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:12.222400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e011bc-2e8a-450a-a83a-3b4c6a860a00 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:12.222697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e011bc-2e8a-450a-a83a-3b4c6a860a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:12.223029 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e011bc-2e8a-450a-a83a-3b4c6a860a00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:12.232687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884e87a-1d02-4c78-942c-4dad8d1faa86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:12.234968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884e87a-1d02-4c78-942c-4dad8d1faa86 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:12.299169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e011bc-2e8a-450a-a83a-3b4c6a860a00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:12.300696 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e011bc-2e8a-450a-a83a-3b4c6a860a00 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:12.368620 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 105/202] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:12.373242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884e87a-1d02-4c78-942c-4dad8d1faa86 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:12.425956 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 98/203] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:12.426815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e011bc-2e8a-450a-a83a-3b4c6a860a00 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:12.447411 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:12.460703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:12.482503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884e87a-1d02-4c78-942c-4dad8d1faa86 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:12.520322 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeee38-bcad-4056-8974-ae21fbddd59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:12.521352 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeee38-bcad-4056-8974-ae21fbddd59c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:12.521780 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeee38-bcad-4056-8974-ae21fbddd59c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:12.522183 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeee38-bcad-4056-8974-ae21fbddd59c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:12.523053 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eeee38-bcad-4056-8974-ae21fbddd59c None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=caeb95674dad43889d74cefec13b3ed8, user.id=e63fb239a1a84cd8b20e63834a10fa57) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:12.523588 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eeee38-bcad-4056-8974-ae21fbddd59c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:12.525484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eeee38-bcad-4056-8974-ae21fbddd59c None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:12.532245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 106/204] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:12 2022] GET /identity/v3/role_assignments?user.id=e63fb239a1a84cd8b20e63834a10fa57&scope.project.id=caeb95674dad43889d74cefec13b3ed8&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:12.533410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeee38-bcad-4056-8974-ae21fbddd59c None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:12.544488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e011bc-2e8a-450a-a83a-3b4c6a860a00 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:12.582586 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3372b0-4821-445c-8f2d-ecf967ba4c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:12.583184 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3372b0-4821-445c-8f2d-ecf967ba4c3d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:12.583466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3372b0-4821-445c-8f2d-ecf967ba4c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:12.583738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3372b0-4821-445c-8f2d-ecf967ba4c3d None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:12.585350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3372b0-4821-445c-8f2d-ecf967ba4c3d None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:12.586829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3372b0-4821-445c-8f2d-ecf967ba4c3d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:12.589441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 99/205] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:12 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:12.595460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3372b0-4821-445c-8f2d-ecf967ba4c3d None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:12.647620 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeee38-bcad-4056-8974-ae21fbddd59c None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:12.687000 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ee4e6-e8ee-4cf3-b749-3635a7a077b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:12.688152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ee4e6-e8ee-4cf3-b749-3635a7a077b0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:12.688635 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ee4e6-e8ee-4cf3-b749-3635a7a077b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:12.689107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ee4e6-e8ee-4cf3-b749-3635a7a077b0 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:12.690562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ee4e6-e8ee-4cf3-b749-3635a7a077b0 None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:12.692383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ee4e6-e8ee-4cf3-b749-3635a7a077b0 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:12.694465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 107/206] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:12 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:12.704381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ee4e6-e8ee-4cf3-b749-3635a7a077b0 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:12.715140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:12.725901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:12.742172 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3372b0-4821-445c-8f2d-ecf967ba4c3d None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:12.812255 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad3c64-1bd1-414b-8aee-edd171b472b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:12.812870 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad3c64-1bd1-414b-8aee-edd171b472b7 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:12.813142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad3c64-1bd1-414b-8aee-edd171b472b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:12.813431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad3c64-1bd1-414b-8aee-edd171b472b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:12.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad3c64-1bd1-414b-8aee-edd171b472b7 None admin] RBAC: Adding query filter params (role.id=86d6f10ad167487ab620bf591795470c, scope.project.id=39be93f42044484fa6db903b2c759bba, user.id=972bf36c35f24c999bcb9fcad86d20a8) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:12.814522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad3c64-1bd1-414b-8aee-edd171b472b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:12.816007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad3c64-1bd1-414b-8aee-edd171b472b7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:12.823336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 100/207] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:12 2022] GET /identity/v3/role_assignments?user.id=972bf36c35f24c999bcb9fcad86d20a8&scope.project.id=39be93f42044484fa6db903b2c759bba&role.id=86d6f10ad167487ab620bf591795470c => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:12.878316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ee4e6-e8ee-4cf3-b749-3635a7a077b0 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:12.933064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264a45a-bc2d-48b1-99dd-cb357c1616b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:12.933754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a45a-bc2d-48b1-99dd-cb357c1616b4 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:12.933980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a45a-bc2d-48b1-99dd-cb357c1616b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:12.934227 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a45a-bc2d-48b1-99dd-cb357c1616b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:12.934963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264a45a-bc2d-48b1-99dd-cb357c1616b4 None admin] RBAC: Adding query filter params (role.id=b3796e568aa342a1b3318b04d23a9cc0, scope.project.id=caeb95674dad43889d74cefec13b3ed8, user.id=e63fb239a1a84cd8b20e63834a10fa57) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:12.935261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264a45a-bc2d-48b1-99dd-cb357c1616b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:12.936709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264a45a-bc2d-48b1-99dd-cb357c1616b4 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:12.945760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 108/208] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:12 2022] GET /identity/v3/role_assignments?user.id=e63fb239a1a84cd8b20e63834a10fa57&scope.project.id=caeb95674dad43889d74cefec13b3ed8&role.id=b3796e568aa342a1b3318b04d23a9cc0 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:13.890145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3b9dc-40e6-4585-9338-0af3bd0a1a23 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:13.890672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3b9dc-40e6-4585-9338-0af3bd0a1a23 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:13.890672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3b9dc-40e6-4585-9338-0af3bd0a1a23 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:13.892192 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 101/209] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:13.897548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd0d5e-99c9-4cee-afa6-1f4cad69ddb1 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:13.898039 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd0d5e-99c9-4cee-afa6-1f4cad69ddb1 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:13.898509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd0d5e-99c9-4cee-afa6-1f4cad69ddb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:13.917231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-5edd0d5e-99c9-4cee-afa6-1f4cad69ddb1 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:13.918707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-5edd0d5e-99c9-4cee-afa6-1f4cad69ddb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:13.979813 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:13.989358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 109/210] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:14.125534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d1838-f00a-49b1-b2a5-1baab83091cd None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:14.125891 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d1838-f00a-49b1-b2a5-1baab83091cd None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:14.126071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d1838-f00a-49b1-b2a5-1baab83091cd None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:14.127676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 102/211] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:14.133887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b753f9-e7e2-4ded-b08c-35870c351836 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:14.134535 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b753f9-e7e2-4ded-b08c-35870c351836 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:14.135015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b753f9-e7e2-4ded-b08c-35870c351836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:14.154219 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-12b753f9-e7e2-4ded-b08c-35870c351836 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:14.155744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-12b753f9-e7e2-4ded-b08c-35870c351836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:14.225506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 110/212] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:14.251940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d1838-f00a-49b1-b2a5-1baab83091cd None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:14.357807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d1838-f00a-49b1-b2a5-1baab83091cd None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:14.392919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c07cd-027f-417e-95fc-a6cc292e8514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:14.393591 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c07cd-027f-417e-95fc-a6cc292e8514 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:14.393866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c07cd-027f-417e-95fc-a6cc292e8514 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:14.394134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c07cd-027f-417e-95fc-a6cc292e8514 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:14.406047 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c07cd-027f-417e-95fc-a6cc292e8514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-5d4c07cd-027f-417e-95fc-a6cc292e8514 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:14.411434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:14.412304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:14.413096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:14.413096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:14.413096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:14.413096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:14.413096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:14.413096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:14.413096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:14.413096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:14.413096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:14.413096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:14.413096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:14.413096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:14.413096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 103/213] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:14.419312 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b753f9-e7e2-4ded-b08c-35870c351836 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:14.508229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c07cd-027f-417e-95fc-a6cc292e8514 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:14.529069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:14.544308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b753f9-e7e2-4ded-b08c-35870c351836 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:14.573981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:14.582442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bc7ad-c24e-412e-8c38-1e5465852823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:14.583092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bc7ad-c24e-412e-8c38-1e5465852823 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:14.583398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bc7ad-c24e-412e-8c38-1e5465852823 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:14.583624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bc7ad-c24e-412e-8c38-1e5465852823 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:14.584325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bc7ad-c24e-412e-8c38-1e5465852823 None admin] RBAC: Adding query filter params (name=member) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:14.584623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bc7ad-c24e-412e-8c38-1e5465852823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:14.586071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bc7ad-c24e-412e-8c38-1e5465852823 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:14.595322 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 111/214] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:14.600851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bc7ad-c24e-412e-8c38-1e5465852823 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:14.626205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c07cd-027f-417e-95fc-a6cc292e8514 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:14.664575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6a863-c7cc-4f53-bf74-cd4c8921cc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:14.665276 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6a863-c7cc-4f53-bf74-cd4c8921cc5f None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:14.665560 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6a863-c7cc-4f53-bf74-cd4c8921cc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:14.665891 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6a863-c7cc-4f53-bf74-cd4c8921cc5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:14.666991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6a863-c7cc-4f53-bf74-cd4c8921cc5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:14.668435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6a863-c7cc-4f53-bf74-cd4c8921cc5f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:14.670042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 104/215] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:14.671157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a110b-f797-42d8-83ae-acc60726219c None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:14.671431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a110b-f797-42d8-83ae-acc60726219c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:14.671700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a110b-f797-42d8-83ae-acc60726219c None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:14.673043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 105/216] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:14.678203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39002cd7-8f18-489f-b211-fe5637eb3098 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:14.678483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39002cd7-8f18-489f-b211-fe5637eb3098 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:14.678758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39002cd7-8f18-489f-b211-fe5637eb3098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:14.697991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-39002cd7-8f18-489f-b211-fe5637eb3098 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:14.699231 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-39002cd7-8f18-489f-b211-fe5637eb3098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:14.717384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bc7ad-c24e-412e-8c38-1e5465852823 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:14.752581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf7f67-b997-4ab2-876b-c795f373b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:14.753592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7f67-b997-4ab2-876b-c795f373b13a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:14.754238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7f67-b997-4ab2-876b-c795f373b13a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:14.754645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7f67-b997-4ab2-876b-c795f373b13a None admin] PATH_INFO: `/v3/users/4d3ba9d153654772bba434644fe4c196` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:14.769359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf7f67-b997-4ab2-876b-c795f373b13a None admin] RBAC: Authorizing `identity:get_user(user_id=4d3ba9d153654772bba434644fe4c196)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:14.770874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf7f67-b997-4ab2-876b-c795f373b13a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:14.772561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 112/217] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:14 2022] GET /identity/v3/users/4d3ba9d153654772bba434644fe4c196 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:14.777360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf7f67-b997-4ab2-876b-c795f373b13a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:14.782607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 106/218] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:14.783771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39002cd7-8f18-489f-b211-fe5637eb3098 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:14.813978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:14.841598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:14.901043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf7f67-b997-4ab2-876b-c795f373b13a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:14.923738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39002cd7-8f18-489f-b211-fe5637eb3098 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:14.943656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc129ac-5c83-4c0f-8664-c56229bfe3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:14.944277 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc129ac-5c83-4c0f-8664-c56229bfe3c8 None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:14.944555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc129ac-5c83-4c0f-8664-c56229bfe3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:14.944827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc129ac-5c83-4c0f-8664-c56229bfe3c8 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:14.945516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc129ac-5c83-4c0f-8664-c56229bfe3c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:14.947691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc129ac-5c83-4c0f-8664-c56229bfe3c8 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:14.967516 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c04687-c800-4f0e-8fbb-e7e771088cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:14.968652 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04687-c800-4f0e-8fbb-e7e771088cae None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:14.969231 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04687-c800-4f0e-8fbb-e7e771088cae None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:14.969751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04687-c800-4f0e-8fbb-e7e771088cae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:14.975961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 113/219] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:02:14 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:02:15.035170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ef47e-2986-4493-9d95-44b4a6105436 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:15.035793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ef47e-2986-4493-9d95-44b4a6105436 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:15.035793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ef47e-2986-4493-9d95-44b4a6105436 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:15.037244 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 114/220] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:02:15.044103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cf853-444e-45c7-a286-8b632c43407d None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:15.044702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cf853-444e-45c7-a286-8b632c43407d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:15.045190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cf853-444e-45c7-a286-8b632c43407d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:15.057197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c04687-c800-4f0e-8fbb-e7e771088cae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:15.058794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c04687-c800-4f0e-8fbb-e7e771088cae None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:15.066786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-4b9cf853-444e-45c7-a286-8b632c43407d None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:15.068483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4b9cf853-444e-45c7-a286-8b632c43407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:15.075281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:15.155842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 115/221] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:15.157049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cf853-444e-45c7-a286-8b632c43407d None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:15.186078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 107/222] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:15.191287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c04687-c800-4f0e-8fbb-e7e771088cae None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:15.209616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:15.305979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cf853-444e-45c7-a286-8b632c43407d None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:15.325098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c04687-c800-4f0e-8fbb-e7e771088cae None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:15.342105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:15.355249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf48a9-7d27-4c98-a862-deab87ec96a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:15.356002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf48a9-7d27-4c98-a862-deab87ec96a5 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:15.356279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf48a9-7d27-4c98-a862-deab87ec96a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:15.356623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf48a9-7d27-4c98-a862-deab87ec96a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:15.375721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf48a9-7d27-4c98-a862-deab87ec96a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:15.378448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4c8a8-7aaf-42e2-9d60-2224b58462df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:15.379103 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4c8a8-7aaf-42e2-9d60-2224b58462df None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:15.379382 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4c8a8-7aaf-42e2-9d60-2224b58462df None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:15.379651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4c8a8-7aaf-42e2-9d60-2224b58462df None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-7faf48a9-7d27-4c98-a862-deab87ec96a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:15.380675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:15.381553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:15.382350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:15.382350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:15.382350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:15.382350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:15.382350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:15.382350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:15.382350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:15.382350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:15.382350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:15.382350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:15.382350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:15.382350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:15.382943 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4c8a8-7aaf-42e2-9d60-2224b58462df None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:15.383010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 116/223] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:02:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:15.383083 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4c8a8-7aaf-42e2-9d60-2224b58462df None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:15.384802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 108/224] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:15 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:15.389459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf48a9-7d27-4c98-a862-deab87ec96a5 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:15.393398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4c8a8-7aaf-42e2-9d60-2224b58462df None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:15.514185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4c8a8-7aaf-42e2-9d60-2224b58462df None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:15.519780 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:15.528550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf48a9-7d27-4c98-a862-deab87ec96a5 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:15.556933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c8605-9bfb-4ef1-b89e-41dbe75c9b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:15.557626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c8605-9bfb-4ef1-b89e-41dbe75c9b7b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:15.558097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c8605-9bfb-4ef1-b89e-41dbe75c9b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:15.558377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c8605-9bfb-4ef1-b89e-41dbe75c9b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:15.559448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c8605-9bfb-4ef1-b89e-41dbe75c9b7b None admin] RBAC: Adding query filter params (role.id=2dfbdb214b97432588648dba947cb07a, scope.project.id=caeb95674dad43889d74cefec13b3ed8, user.id=4d3ba9d153654772bba434644fe4c196) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:15.559760 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c8605-9bfb-4ef1-b89e-41dbe75c9b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:15.561815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c8605-9bfb-4ef1-b89e-41dbe75c9b7b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:15.569873 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 109/225] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:15 2022] GET /identity/v3/role_assignments?user.id=4d3ba9d153654772bba434644fe4c196&scope.project.id=caeb95674dad43889d74cefec13b3ed8&role.id=2dfbdb214b97432588648dba947cb07a => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:15.570910 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c8605-9bfb-4ef1-b89e-41dbe75c9b7b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:15.571897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f724eaf-9947-4415-b212-3b379c817975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:15.572923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f724eaf-9947-4415-b212-3b379c817975 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:15.573440 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f724eaf-9947-4415-b212-3b379c817975 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:15.574232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f724eaf-9947-4415-b212-3b379c817975 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:15.576223 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f724eaf-9947-4415-b212-3b379c817975 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:15.576775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f724eaf-9947-4415-b212-3b379c817975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:15.578789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f724eaf-9947-4415-b212-3b379c817975 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:15.591407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 117/226] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:15.602328 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f724eaf-9947-4415-b212-3b379c817975 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:15.632948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:15.700272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c8605-9bfb-4ef1-b89e-41dbe75c9b7b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:15.766155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69833cce-c8ff-4b3f-9de6-b6c13a635788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:15.766353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69833cce-c8ff-4b3f-9de6-b6c13a635788 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:15.766597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69833cce-c8ff-4b3f-9de6-b6c13a635788 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:15.766757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69833cce-c8ff-4b3f-9de6-b6c13a635788 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:15.778725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69833cce-c8ff-4b3f-9de6-b6c13a635788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-69833cce-c8ff-4b3f-9de6-b6c13a635788 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:15.784453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:15.785361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:15.786161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:15.786161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:15.786161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:15.786161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:15.786161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:15.786161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:15.786161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:15.786161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:15.786161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:15.786161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:15.786161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:15.786161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:15.786161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 110/227] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:02:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:15.789660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f724eaf-9947-4415-b212-3b379c817975 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:15.791720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69833cce-c8ff-4b3f-9de6-b6c13a635788 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:15.829520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9f7a7-b753-4d79-862f-98373a46e86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:15.830154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9f7a7-b753-4d79-862f-98373a46e86a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:15.830428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9f7a7-b753-4d79-862f-98373a46e86a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:15.830804 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9f7a7-b753-4d79-862f-98373a46e86a None admin] PATH_INFO: `/v3/users/e63fb239a1a84cd8b20e63834a10fa57` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:15.832015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9f7a7-b753-4d79-862f-98373a46e86a None admin] RBAC: Authorizing `identity:get_user(user_id=e63fb239a1a84cd8b20e63834a10fa57)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:15.833498 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9f7a7-b753-4d79-862f-98373a46e86a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:15.835571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 118/228] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:15 2022] GET /identity/v3/users/e63fb239a1a84cd8b20e63834a10fa57 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:15.841467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9f7a7-b753-4d79-862f-98373a46e86a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:15.901596 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:15.904708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69833cce-c8ff-4b3f-9de6-b6c13a635788 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:15.913145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:15.940814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d22dc2-08b6-4587-8043-701d3de68eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:15.941514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22dc2-08b6-4587-8043-701d3de68eab None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:15.941769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22dc2-08b6-4587-8043-701d3de68eab None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:15.941978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22dc2-08b6-4587-8043-701d3de68eab None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:15.942644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d22dc2-08b6-4587-8043-701d3de68eab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:15.942940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d22dc2-08b6-4587-8043-701d3de68eab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:15.944324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d22dc2-08b6-4587-8043-701d3de68eab None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:15.953347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 111/229] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:15.955738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9f7a7-b753-4d79-862f-98373a46e86a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:15.959092 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d22dc2-08b6-4587-8043-701d3de68eab None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:15.992603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3105484-9142-4ccd-a838-b73385d4ee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:15.993739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105484-9142-4ccd-a838-b73385d4ee37 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:15.994305 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105484-9142-4ccd-a838-b73385d4ee37 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:15.994872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105484-9142-4ccd-a838-b73385d4ee37 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:15.996234 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3105484-9142-4ccd-a838-b73385d4ee37 None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:15.997958 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3105484-9142-4ccd-a838-b73385d4ee37 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:16.000530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 119/230] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:15 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:16.006327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3105484-9142-4ccd-a838-b73385d4ee37 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:16.133186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:16.146016 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d22dc2-08b6-4587-8043-701d3de68eab None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:16.151532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3105484-9142-4ccd-a838-b73385d4ee37 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:16.211007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd42c3-34fa-4866-9786-64e877cc1df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:16.211643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd42c3-34fa-4866-9786-64e877cc1df3 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:16.212261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd42c3-34fa-4866-9786-64e877cc1df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:16.212528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd42c3-34fa-4866-9786-64e877cc1df3 None admin] PATH_INFO: `/v3/users/e63fb239a1a84cd8b20e63834a10fa57` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:16.214159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd42c3-34fa-4866-9786-64e877cc1df3 None admin] RBAC: Authorizing `identity:get_user(user_id=e63fb239a1a84cd8b20e63834a10fa57)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:16.215585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd42c3-34fa-4866-9786-64e877cc1df3 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:16.221376 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 112/231] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:15 2022] GET /identity/v3/users/e63fb239a1a84cd8b20e63834a10fa57 => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:16.222114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d0037-4785-4f07-a0e2-86c462a9cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:16.222790 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d0037-4785-4f07-a0e2-86c462a9cdcd None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:16.223058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d0037-4785-4f07-a0e2-86c462a9cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:16.223323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d0037-4785-4f07-a0e2-86c462a9cdcd None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8/users/e63fb239a1a84cd8b20e63834a10fa57/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:16.225543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd42c3-34fa-4866-9786-64e877cc1df3 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:16.225745 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d0037-4785-4f07-a0e2-86c462a9cdcd None admin] RBAC: Authorizing `identity:create_grant(project_id=caeb95674dad43889d74cefec13b3ed8, user_id=e63fb239a1a84cd8b20e63834a10fa57, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:16.227174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d0037-4785-4f07-a0e2-86c462a9cdcd None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:16.252073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 120/232] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:02:16 2022] PUT /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8/users/e63fb239a1a84cd8b20e63834a10fa57/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:16.281752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:16.344871 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd42c3-34fa-4866-9786-64e877cc1df3 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:16.380524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fe3cb-09d8-44c5-a765-867bcc73e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:16.381088 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe3cb-09d8-44c5-a765-867bcc73e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:16.381409 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe3cb-09d8-44c5-a765-867bcc73e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:16.381673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe3cb-09d8-44c5-a765-867bcc73e6f0 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:16.382852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fe3cb-09d8-44c5-a765-867bcc73e6f0 None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:16.384436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fe3cb-09d8-44c5-a765-867bcc73e6f0 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:16.386458 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 113/233] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:16 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:16.392404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d0037-4785-4f07-a0e2-86c462a9cdcd None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:16.517277 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d0037-4785-4f07-a0e2-86c462a9cdcd None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:16.566246 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c39d3b-6605-4323-b660-b3f5b49551e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:16.566905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c39d3b-6605-4323-b660-b3f5b49551e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:16.567171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c39d3b-6605-4323-b660-b3f5b49551e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:16.567436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c39d3b-6605-4323-b660-b3f5b49551e9 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8/users/e63fb239a1a84cd8b20e63834a10fa57/roles/b3796e568aa342a1b3318b04d23a9cc0` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:16.571218 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c39d3b-6605-4323-b660-b3f5b49551e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=caeb95674dad43889d74cefec13b3ed8, user_id=e63fb239a1a84cd8b20e63834a10fa57, role_id=b3796e568aa342a1b3318b04d23a9cc0)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:16.572723 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c39d3b-6605-4323-b660-b3f5b49551e9 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:16.597354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 121/234] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:02:16 2022] PUT /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8/users/e63fb239a1a84cd8b20e63834a10fa57/roles/b3796e568aa342a1b3318b04d23a9cc0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:17.570971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fa945-3222-458b-8150-f55ecea50d4c None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:17.572040 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fa945-3222-458b-8150-f55ecea50d4c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:17.572543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fa945-3222-458b-8150-f55ecea50d4c None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:17.574420 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 114/235] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:17.591071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b46764-4faf-4dee-b878-cda64224ff13 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:17.591969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b46764-4faf-4dee-b878-cda64224ff13 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:17.592453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b46764-4faf-4dee-b878-cda64224ff13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:17.596634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae328b-b774-4991-933f-696e41c068a4 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:17.597866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae328b-b774-4991-933f-696e41c068a4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:17.598843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae328b-b774-4991-933f-696e41c068a4 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:17.604116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 122/236] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:17 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:17.610342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd259-bdfe-4d71-9d25-18e0118d20af None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:17.615079 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd259-bdfe-4d71-9d25-18e0118d20af None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:17.615584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd259-bdfe-4d71-9d25-18e0118d20af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:17.625533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-51b46764-4faf-4dee-b878-cda64224ff13 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:17.628448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-51b46764-4faf-4dee-b878-cda64224ff13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:17.647268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-f48dd259-bdfe-4d71-9d25-18e0118d20af None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:17.650707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f48dd259-bdfe-4d71-9d25-18e0118d20af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:17.662495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:17.746939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 115/237] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:17.755925 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 123/238] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:17.828417 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f6a3c-bfe4-4676-8281-d1d637856792 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:17.828586 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f6a3c-bfe4-4676-8281-d1d637856792 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:17.828857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f6a3c-bfe4-4676-8281-d1d637856792 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:17.830488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 116/239] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:17.835609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2d4dc-dd11-481c-823e-49a3475550c8 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:17.835885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2d4dc-dd11-481c-823e-49a3475550c8 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:17.836156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2d4dc-dd11-481c-823e-49a3475550c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:17.854633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-43f2d4dc-dd11-481c-823e-49a3475550c8 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:17.855786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-43f2d4dc-dd11-481c-823e-49a3475550c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:17.950120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 124/240] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:18.050207 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f6a3c-bfe4-4676-8281-d1d637856792 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:18.096586 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:18.172827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f6a3c-bfe4-4676-8281-d1d637856792 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:18.179808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2d4dc-dd11-481c-823e-49a3475550c8 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:18.210129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2d05d-31a0-4bbb-8589-b7085498e29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:18.210764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2d05d-31a0-4bbb-8589-b7085498e29a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:18.211039 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2d05d-31a0-4bbb-8589-b7085498e29a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:18.211340 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2d05d-31a0-4bbb-8589-b7085498e29a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:18.212914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2d05d-31a0-4bbb-8589-b7085498e29a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:18.214377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2d05d-31a0-4bbb-8589-b7085498e29a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:18.215969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 117/241] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:18.222126 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2d05d-31a0-4bbb-8589-b7085498e29a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:18.318052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:18.376229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2d4dc-dd11-481c-823e-49a3475550c8 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:18.388211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2d05d-31a0-4bbb-8589-b7085498e29a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:18.389790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:18.415182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f478e8b-59a6-4053-8b92-278c1d0c4396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:18.416159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f478e8b-59a6-4053-8b92-278c1d0c4396 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:18.416443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f478e8b-59a6-4053-8b92-278c1d0c4396 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:18.416711 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f478e8b-59a6-4053-8b92-278c1d0c4396 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:18.425415 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc346b68-1d75-417d-9967-608c436b33ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:18.426033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc346b68-1d75-417d-9967-608c436b33ce None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:18.426309 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc346b68-1d75-417d-9967-608c436b33ce None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:18.426576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc346b68-1d75-417d-9967-608c436b33ce None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:18.427235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc346b68-1d75-417d-9967-608c436b33ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:18.427514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f478e8b-59a6-4053-8b92-278c1d0c4396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:18.428670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc346b68-1d75-417d-9967-608c436b33ce None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-2f478e8b-59a6-4053-8b92-278c1d0c4396 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:18.432721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:18.433651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 125/242] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:18.435011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f478e8b-59a6-4053-8b92-278c1d0c4396 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:18.459334 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 118/243] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:02:18 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:02:18.460192 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc346b68-1d75-417d-9967-608c436b33ce None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:18.575202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f478e8b-59a6-4053-8b92-278c1d0c4396 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:18.622515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:18.632612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75848dc-4c7b-4163-a75c-3df0d43d897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:18.633178 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75848dc-4c7b-4163-a75c-3df0d43d897e None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:18.633509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75848dc-4c7b-4163-a75c-3df0d43d897e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:18.633775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75848dc-4c7b-4163-a75c-3df0d43d897e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:18.646169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75848dc-4c7b-4163-a75c-3df0d43d897e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-e75848dc-4c7b-4163-a75c-3df0d43d897e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:18.654646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:18.655574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:18.656833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:18.656833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:18.656833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:18.656833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:18.656833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:18.656833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:18.656833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:18.656833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:18.656833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:18.656833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:18.656833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:18.656833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:18.656833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 126/244] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:18.666068 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75848dc-4c7b-4163-a75c-3df0d43d897e None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:18.696654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc346b68-1d75-417d-9967-608c436b33ce None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:18.737043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ee0a2-9685-4806-b36d-80d3e0fc17a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:18.737724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ee0a2-9685-4806-b36d-80d3e0fc17a9 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:18.738002 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ee0a2-9685-4806-b36d-80d3e0fc17a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:18.738266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ee0a2-9685-4806-b36d-80d3e0fc17a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:18.738933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ee0a2-9685-4806-b36d-80d3e0fc17a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:18.739233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ee0a2-9685-4806-b36d-80d3e0fc17a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:18.740636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ee0a2-9685-4806-b36d-80d3e0fc17a9 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:18.754307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 119/245] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:18.760493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ee0a2-9685-4806-b36d-80d3e0fc17a9 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:18.794325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:18.818310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75848dc-4c7b-4163-a75c-3df0d43d897e None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:18.862803 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fea5d-5ec9-43dd-9810-da134824983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:18.863871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fea5d-5ec9-43dd-9810-da134824983c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:18.863871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fea5d-5ec9-43dd-9810-da134824983c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:18.864060 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fea5d-5ec9-43dd-9810-da134824983c None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:18.864684 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fea5d-5ec9-43dd-9810-da134824983c None admin] RBAC: Adding query filter params (name=member) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:18.864978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fea5d-5ec9-43dd-9810-da134824983c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:18.866434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fea5d-5ec9-43dd-9810-da134824983c None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:18.877810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 127/246] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:18.879504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b4e1d-e490-4476-ad1c-1bce43e61811 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:18.879785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b4e1d-e490-4476-ad1c-1bce43e61811 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:18.880056 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b4e1d-e490-4476-ad1c-1bce43e61811 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:18.881472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 128/247] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:18.886859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b4e1d-e490-4476-ad1c-1bce43e61811 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:18.905392 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ee0a2-9685-4806-b36d-80d3e0fc17a9 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:18.949441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd127c-43e1-4cbe-8696-a8b92c68eec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:18.950099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd127c-43e1-4cbe-8696-a8b92c68eec0 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:18.950373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd127c-43e1-4cbe-8696-a8b92c68eec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:18.950637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd127c-43e1-4cbe-8696-a8b92c68eec0 None admin] PATH_INFO: `/v3/users/de443ace79f04bf493c27bbf605803b7` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:18.961615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:18.965750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd127c-43e1-4cbe-8696-a8b92c68eec0 None admin] RBAC: Authorizing `identity:get_user(user_id=de443ace79f04bf493c27bbf605803b7)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:18.967215 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd127c-43e1-4cbe-8696-a8b92c68eec0 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:18.970216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 120/248] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:18 2022] GET /identity/v3/users/de443ace79f04bf493c27bbf605803b7 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:18.971641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337629f7-22e4-463f-a628-60f2fb93eb35 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:18.971919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337629f7-22e4-463f-a628-60f2fb93eb35 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:18.972187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337629f7-22e4-463f-a628-60f2fb93eb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:18.996741 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-337629f7-22e4-463f-a628-60f2fb93eb35 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:18.997959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-337629f7-22e4-463f-a628-60f2fb93eb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:19.013770 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b4e1d-e490-4476-ad1c-1bce43e61811 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:19.050753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8186989-24f3-49fd-9d8c-d911e6d1cd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:19.051456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8186989-24f3-49fd-9d8c-d911e6d1cd21 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:19.051866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8186989-24f3-49fd-9d8c-d911e6d1cd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:19.052104 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8186989-24f3-49fd-9d8c-d911e6d1cd21 None admin] PATH_INFO: `/v3/users/4d3ba9d153654772bba434644fe4c196` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:19.053926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8186989-24f3-49fd-9d8c-d911e6d1cd21 None admin] RBAC: Authorizing `identity:get_user(user_id=4d3ba9d153654772bba434644fe4c196)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:19.055902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8186989-24f3-49fd-9d8c-d911e6d1cd21 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:19.058507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 129/249] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:18 2022] GET /identity/v3/users/4d3ba9d153654772bba434644fe4c196 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:19.059501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8186989-24f3-49fd-9d8c-d911e6d1cd21 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:19.081295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 121/250] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:19.083094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dea1f-67b9-4c70-80cf-146850994f3c None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:19.083378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dea1f-67b9-4c70-80cf-146850994f3c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:19.083645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dea1f-67b9-4c70-80cf-146850994f3c None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:19.085306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 122/251] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:19.089230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dea1f-67b9-4c70-80cf-146850994f3c None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:19.100467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:19.183935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8186989-24f3-49fd-9d8c-d911e6d1cd21 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:19.209122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:19.226811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dea1f-67b9-4c70-80cf-146850994f3c None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:19.228211 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eba21-beeb-4795-8882-ceb2665a327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:19.229627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eba21-beeb-4795-8882-ceb2665a327a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:19.230102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eba21-beeb-4795-8882-ceb2665a327a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:19.230586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eba21-beeb-4795-8882-ceb2665a327a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:19.274939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b70b33-4786-4f68-9c4c-be5608b1fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:19.275575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70b33-4786-4f68-9c4c-be5608b1fdfa None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:19.275847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70b33-4786-4f68-9c4c-be5608b1fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:19.276111 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70b33-4786-4f68-9c4c-be5608b1fdfa None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:19.277304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b70b33-4786-4f68-9c4c-be5608b1fdfa None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:19.279324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b70b33-4786-4f68-9c4c-be5608b1fdfa None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:19.281929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 123/252] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:19 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:19.284257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a80b9-ea30-466a-a190-027840e33e61 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:19.284257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a80b9-ea30-466a-a190-027840e33e61 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:19.285298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a80b9-ea30-466a-a190-027840e33e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:19.310300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-872a80b9-ea30-466a-a190-027840e33e61 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:19.311477 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-872a80b9-ea30-466a-a190-027840e33e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:19.315275 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eba21-beeb-4795-8882-ceb2665a327a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:19.317039 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eba21-beeb-4795-8882-ceb2665a327a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:19.401334 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 124/253] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:19.402173 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a80b9-ea30-466a-a190-027840e33e61 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:19.413372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:19.466561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 130/254] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:19.472569 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eba21-beeb-4795-8882-ceb2665a327a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:19.506156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:19.540041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a80b9-ea30-466a-a190-027840e33e61 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:19.577951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e158205-6540-434c-95e5-4b19e1069c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:19.578722 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158205-6540-434c-95e5-4b19e1069c86 None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:19.579001 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158205-6540-434c-95e5-4b19e1069c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:19.579270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158205-6540-434c-95e5-4b19e1069c86 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8/users/4d3ba9d153654772bba434644fe4c196/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:19.581173 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e158205-6540-434c-95e5-4b19e1069c86 None admin] RBAC: Authorizing `identity:create_grant(project_id=caeb95674dad43889d74cefec13b3ed8, user_id=4d3ba9d153654772bba434644fe4c196, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:19.582858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e158205-6540-434c-95e5-4b19e1069c86 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:19.585563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eba21-beeb-4795-8882-ceb2665a327a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:19.604692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 125/255] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:02:19 2022] PUT /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8/users/4d3ba9d153654772bba434644fe4c196/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:19.605570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e158205-6540-434c-95e5-4b19e1069c86 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:19.625924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4e471-8507-461c-bf8e-f99c6263e3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:19.626674 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e471-8507-461c-bf8e-f99c6263e3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:19.626863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e471-8507-461c-bf8e-f99c6263e3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:19.627124 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e471-8507-461c-bf8e-f99c6263e3e2 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:19.628372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4e471-8507-461c-bf8e-f99c6263e3e2 None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:19.629979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4e471-8507-461c-bf8e-f99c6263e3e2 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:19.631663 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 131/256] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:19 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:19.639891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4e471-8507-461c-bf8e-f99c6263e3e2 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:19.780725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:19.865653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:19.872544 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4e471-8507-461c-bf8e-f99c6263e3e2 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:19.880128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e158205-6540-434c-95e5-4b19e1069c86 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:19.922652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96799d-f6d8-45ca-a2c5-4ea5906e0e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:19.924088 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96799d-f6d8-45ca-a2c5-4ea5906e0e00 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:19.925018 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96799d-f6d8-45ca-a2c5-4ea5906e0e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:19.925548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96799d-f6d8-45ca-a2c5-4ea5906e0e00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:19.926527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96799d-f6d8-45ca-a2c5-4ea5906e0e00 None admin] RBAC: Adding query filter params (role.id=86d6f10ad167487ab620bf591795470c, scope.project.id=caeb95674dad43889d74cefec13b3ed8, user.id=de443ace79f04bf493c27bbf605803b7) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:19.927032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96799d-f6d8-45ca-a2c5-4ea5906e0e00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:19.927203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5e649-6d97-4fdc-9a2c-05c297b4e4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:19.927879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5e649-6d97-4fdc-9a2c-05c297b4e4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:19.928156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5e649-6d97-4fdc-9a2c-05c297b4e4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:19.928425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5e649-6d97-4fdc-9a2c-05c297b4e4e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:19.929450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96799d-f6d8-45ca-a2c5-4ea5906e0e00 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:19.937876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 132/257] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:19 2022] GET /identity/v3/role_assignments?user.id=de443ace79f04bf493c27bbf605803b7&scope.project.id=caeb95674dad43889d74cefec13b3ed8&role.id=86d6f10ad167487ab620bf591795470c => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:19.938995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96799d-f6d8-45ca-a2c5-4ea5906e0e00 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:19.943086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5e649-6d97-4fdc-9a2c-05c297b4e4e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-13f5e649-6d97-4fdc-9a2c-05c297b4e4e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:19.949150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:19.950146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:19.950954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:19.950954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:19.950954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:19.950954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:19.950954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:19.950954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:19.950954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:19.950954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:19.950954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:19.950954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:19.950954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:19.950954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:19.950954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 126/258] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:02:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:19.956962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5e649-6d97-4fdc-9a2c-05c297b4e4e8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:20.143808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5e649-6d97-4fdc-9a2c-05c297b4e4e8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:20.194629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:20.203516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96799d-f6d8-45ca-a2c5-4ea5906e0e00 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:20.205583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261671b-4521-44dd-8d0a-365826366399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:20.213402 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261671b-4521-44dd-8d0a-365826366399 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:20.213764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261671b-4521-44dd-8d0a-365826366399 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:20.214344 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261671b-4521-44dd-8d0a-365826366399 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:20.214922 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261671b-4521-44dd-8d0a-365826366399 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:20.215275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261671b-4521-44dd-8d0a-365826366399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:20.216868 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261671b-4521-44dd-8d0a-365826366399 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:20.234029 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 127/259] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:20.239621 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261671b-4521-44dd-8d0a-365826366399 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:20.241627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a285a85-0c47-4e76-b4e4-20a5023bf8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:20.242519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a285a85-0c47-4e76-b4e4-20a5023bf8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:20.243139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a285a85-0c47-4e76-b4e4-20a5023bf8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:20.243620 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a285a85-0c47-4e76-b4e4-20a5023bf8c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:20.263377 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a285a85-0c47-4e76-b4e4-20a5023bf8c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-9a285a85-0c47-4e76-b4e4-20a5023bf8c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:20.269920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:20.270886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:20.271691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:20.271691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:20.271691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:20.271691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:20.271691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:20.271691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:20.271691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:20.271691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:20.271691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:20.271691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:20.271691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:20.271691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:20.274183 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 133/260] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:02:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:20.280400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a285a85-0c47-4e76-b4e4-20a5023bf8c3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:20.299154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:20.393516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a285a85-0c47-4e76-b4e4-20a5023bf8c3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:20.429519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e6dbf-2f55-4903-8784-49d39b5c2cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:20.430825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e6dbf-2f55-4903-8784-49d39b5c2cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:20.431325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e6dbf-2f55-4903-8784-49d39b5c2cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:20.431786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e6dbf-2f55-4903-8784-49d39b5c2cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:20.432794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e6dbf-2f55-4903-8784-49d39b5c2cd6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:20.433321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e6dbf-2f55-4903-8784-49d39b5c2cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:20.434930 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e6dbf-2f55-4903-8784-49d39b5c2cd6 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:20.435456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261671b-4521-44dd-8d0a-365826366399 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:20.444378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 134/261] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:20.450279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e6dbf-2f55-4903-8784-49d39b5c2cd6 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:20.503289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490fe5e-9a03-4cbc-90ee-9ad78e77f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:20.503938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490fe5e-9a03-4cbc-90ee-9ad78e77f8dd None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:20.504213 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490fe5e-9a03-4cbc-90ee-9ad78e77f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:20.504479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490fe5e-9a03-4cbc-90ee-9ad78e77f8dd None admin] PATH_INFO: `/v3/users/e63fb239a1a84cd8b20e63834a10fa57` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:20.510535 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490fe5e-9a03-4cbc-90ee-9ad78e77f8dd None admin] RBAC: Authorizing `identity:get_user(user_id=e63fb239a1a84cd8b20e63834a10fa57)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:20.512078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490fe5e-9a03-4cbc-90ee-9ad78e77f8dd None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:20.513913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 128/262] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:20 2022] GET /identity/v3/users/e63fb239a1a84cd8b20e63834a10fa57 => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:20.519601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490fe5e-9a03-4cbc-90ee-9ad78e77f8dd None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:20.545952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:20.562410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e6dbf-2f55-4903-8784-49d39b5c2cd6 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:20.599903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bfafb-dacd-4feb-a4e8-4b82536142dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:20.601060 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bfafb-dacd-4feb-a4e8-4b82536142dc None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:20.601609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bfafb-dacd-4feb-a4e8-4b82536142dc None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:20.602167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bfafb-dacd-4feb-a4e8-4b82536142dc None admin] PATH_INFO: `/v3/users/e63fb239a1a84cd8b20e63834a10fa57` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:20.603667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bfafb-dacd-4feb-a4e8-4b82536142dc None admin] RBAC: Authorizing `identity:get_user(user_id=e63fb239a1a84cd8b20e63834a10fa57)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:20.605363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bfafb-dacd-4feb-a4e8-4b82536142dc None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:20.607261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 135/263] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:20 2022] GET /identity/v3/users/e63fb239a1a84cd8b20e63834a10fa57 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:20.612969 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bfafb-dacd-4feb-a4e8-4b82536142dc None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:20.649657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:20.744138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bfafb-dacd-4feb-a4e8-4b82536142dc None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:20.775439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490fe5e-9a03-4cbc-90ee-9ad78e77f8dd None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:20.794609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d421ac-192e-4134-861e-199ffcbcb7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:20.795266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d421ac-192e-4134-861e-199ffcbcb7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:20.795541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d421ac-192e-4134-861e-199ffcbcb7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:20.795905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d421ac-192e-4134-861e-199ffcbcb7b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:20.819051 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:20.878525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a52e4c-fcdf-47d7-948e-a604217b88e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:20.879227 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52e4c-fcdf-47d7-948e-a604217b88e5 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:20.879421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52e4c-fcdf-47d7-948e-a604217b88e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:20.879681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52e4c-fcdf-47d7-948e-a604217b88e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:20.882434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d421ac-192e-4134-861e-199ffcbcb7b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:20.884294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d421ac-192e-4134-861e-199ffcbcb7b1 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:21.011257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a52e4c-fcdf-47d7-948e-a604217b88e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:21.013060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a52e4c-fcdf-47d7-948e-a604217b88e5 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:21.066877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 136/264] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:02:21.068599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0360a-cab0-4ac2-aa50-c1fe8cb1769a None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:21.069772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0360a-cab0-4ac2-aa50-c1fe8cb1769a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:21.070401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0360a-cab0-4ac2-aa50-c1fe8cb1769a None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:21.074148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 137/265] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:21.075724 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0360a-cab0-4ac2-aa50-c1fe8cb1769a None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:21.127984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:21.158364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:21.223427 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 129/266] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:02:21.230113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110f720-c58d-4f5b-9dd4-d7bd8cca853e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:21.230396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110f720-c58d-4f5b-9dd4-d7bd8cca853e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:21.230672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110f720-c58d-4f5b-9dd4-d7bd8cca853e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:21.269900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-1110f720-c58d-4f5b-9dd4-d7bd8cca853e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:21.271303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1110f720-c58d-4f5b-9dd4-d7bd8cca853e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:21.289051 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0360a-cab0-4ac2-aa50-c1fe8cb1769a None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:21.331973 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62457a-32cf-43ed-bfd6-2fdd48989adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:21.332617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62457a-32cf-43ed-bfd6-2fdd48989adb None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:21.332889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62457a-32cf-43ed-bfd6-2fdd48989adb None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:21.333155 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62457a-32cf-43ed-bfd6-2fdd48989adb None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:21.335666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62457a-32cf-43ed-bfd6-2fdd48989adb None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:21.337908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62457a-32cf-43ed-bfd6-2fdd48989adb None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:21.339578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 138/267] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:21 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:21.349346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62457a-32cf-43ed-bfd6-2fdd48989adb None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:21.384565 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 130/268] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:21.385599 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110f720-c58d-4f5b-9dd4-d7bd8cca853e None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:21.484716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:21.502263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110f720-c58d-4f5b-9dd4-d7bd8cca853e None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:21.542981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144fa66-6d42-44e7-b11a-04c93184f666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:21.543921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144fa66-6d42-44e7-b11a-04c93184f666 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:21.544845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144fa66-6d42-44e7-b11a-04c93184f666 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:21.545289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144fa66-6d42-44e7-b11a-04c93184f666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:21.546197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144fa66-6d42-44e7-b11a-04c93184f666 None admin] RBAC: Adding query filter params (role.id=b3796e568aa342a1b3318b04d23a9cc0, scope.project.id=caeb95674dad43889d74cefec13b3ed8, user.id=e63fb239a1a84cd8b20e63834a10fa57) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:21.546643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144fa66-6d42-44e7-b11a-04c93184f666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:21.548213 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144fa66-6d42-44e7-b11a-04c93184f666 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:21.555022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 131/269] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:21 2022] GET /identity/v3/role_assignments?user.id=e63fb239a1a84cd8b20e63834a10fa57&scope.project.id=caeb95674dad43889d74cefec13b3ed8&role.id=b3796e568aa342a1b3318b04d23a9cc0 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:21.615546 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62457a-32cf-43ed-bfd6-2fdd48989adb None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:21.638715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:21.667059 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968e3b9-a641-42de-a03c-bd3e504abacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:21.667872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968e3b9-a641-42de-a03c-bd3e504abacc None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:21.668146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968e3b9-a641-42de-a03c-bd3e504abacc None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:21.668410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968e3b9-a641-42de-a03c-bd3e504abacc None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:21.669804 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968e3b9-a641-42de-a03c-bd3e504abacc None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:21.671294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968e3b9-a641-42de-a03c-bd3e504abacc None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:21.673021 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 139/270] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:21 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:21.679350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144fa66-6d42-44e7-b11a-04c93184f666 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:21.824199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144fa66-6d42-44e7-b11a-04c93184f666 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:21.863401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51b9af-07c9-4d67-9823-fed2edb9ccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:21.864019 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51b9af-07c9-4d67-9823-fed2edb9ccfb None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:21.864353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51b9af-07c9-4d67-9823-fed2edb9ccfb None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:21.864626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51b9af-07c9-4d67-9823-fed2edb9ccfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:21.865393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51b9af-07c9-4d67-9823-fed2edb9ccfb None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=caeb95674dad43889d74cefec13b3ed8, user.id=e63fb239a1a84cd8b20e63834a10fa57) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:21.865701 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51b9af-07c9-4d67-9823-fed2edb9ccfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:21.867129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51b9af-07c9-4d67-9823-fed2edb9ccfb None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:21.873791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 132/271] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:21 2022] GET /identity/v3/role_assignments?user.id=e63fb239a1a84cd8b20e63834a10fa57&scope.project.id=caeb95674dad43889d74cefec13b3ed8&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:21.943034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968e3b9-a641-42de-a03c-bd3e504abacc None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:21.978248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a86de-0212-48de-a407-b9100e044d33 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:21.978780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a86de-0212-48de-a407-b9100e044d33 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:21.978780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a86de-0212-48de-a407-b9100e044d33 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:21.980421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 133/272] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:21.986638 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41ff9-0ea2-49f6-a6d4-c55e45695278 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:21.986924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41ff9-0ea2-49f6-a6d4-c55e45695278 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:21.987222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41ff9-0ea2-49f6-a6d4-c55e45695278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:22.013371 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c7d41ff9-0ea2-49f6-a6d4-c55e45695278 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:22.015382 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c7d41ff9-0ea2-49f6-a6d4-c55e45695278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:22.061636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:22.099108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968e3b9-a641-42de-a03c-bd3e504abacc None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:22.117489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 134/273] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:22.140549 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae9c5-c733-4f4f-8a6d-f3f3cf8b5dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:22.141189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae9c5-c733-4f4f-8a6d-f3f3cf8b5dcc None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:22.141491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae9c5-c733-4f4f-8a6d-f3f3cf8b5dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:22.141765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae9c5-c733-4f4f-8a6d-f3f3cf8b5dcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:22.152788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcae9c5-c733-4f4f-8a6d-f3f3cf8b5dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-adcae9c5-c733-4f4f-8a6d-f3f3cf8b5dcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:22.157999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:22.158864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:22.160041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:22.160041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:22.160041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:22.160041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:22.160041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:22.160041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:22.160041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:22.160041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:22.160041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:22.160041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:22.160041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:22.160041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:22.160041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 140/274] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:22.165431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d41ff9-0ea2-49f6-a6d4-c55e45695278 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:22.274690 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d41ff9-0ea2-49f6-a6d4-c55e45695278 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:22.316386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd0041-55c4-45c5-872d-ba98d2fd3862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:22.317012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd0041-55c4-45c5-872d-ba98d2fd3862 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:22.317320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd0041-55c4-45c5-872d-ba98d2fd3862 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:22.317597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd0041-55c4-45c5-872d-ba98d2fd3862 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:22.318273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd0041-55c4-45c5-872d-ba98d2fd3862 None admin] RBAC: Adding query filter params (name=member) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:22.318572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd0041-55c4-45c5-872d-ba98d2fd3862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:22.319950 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd0041-55c4-45c5-872d-ba98d2fd3862 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:22.328818 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 135/275] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:22.334439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae9c5-c733-4f4f-8a6d-f3f3cf8b5dcc None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:22.385347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:22.450808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae9c5-c733-4f4f-8a6d-f3f3cf8b5dcc None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:22.459418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28387d2-dd61-4d8a-8759-5e945eeddde7 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:22.459700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28387d2-dd61-4d8a-8759-5e945eeddde7 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:22.459971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28387d2-dd61-4d8a-8759-5e945eeddde7 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:22.461698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 136/276] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:22.468977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28387d2-dd61-4d8a-8759-5e945eeddde7 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:22.480180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:22.495889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab024133-f1a5-497a-9b83-49edeb4d79ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:22.496522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab024133-f1a5-497a-9b83-49edeb4d79ff None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:22.496794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab024133-f1a5-497a-9b83-49edeb4d79ff None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:22.497059 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab024133-f1a5-497a-9b83-49edeb4d79ff None admin] PATH_INFO: `/v3/users/edc085cef6b74720ac87419b34483bdb` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:22.510970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab024133-f1a5-497a-9b83-49edeb4d79ff None admin] RBAC: Authorizing `identity:get_user(user_id=edc085cef6b74720ac87419b34483bdb)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:22.512550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab024133-f1a5-497a-9b83-49edeb4d79ff None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:22.519258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 141/277] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:22 2022] GET /identity/v3/users/edc085cef6b74720ac87419b34483bdb => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:22.519258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d6cda-b202-47bd-b699-08f06f74998a None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:22.519258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d6cda-b202-47bd-b699-08f06f74998a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:22.519258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d6cda-b202-47bd-b699-08f06f74998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:22.535007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-678d6cda-b202-47bd-b699-08f06f74998a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:22.536161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-678d6cda-b202-47bd-b699-08f06f74998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:22.588073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28387d2-dd61-4d8a-8759-5e945eeddde7 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:22.606836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 142/278] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:22.607564 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d6cda-b202-47bd-b699-08f06f74998a None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:22.628865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64d99f-5ebb-4ce0-904c-913feadd7ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:22.629895 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d99f-5ebb-4ce0-904c-913feadd7ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:22.630367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d99f-5ebb-4ce0-904c-913feadd7ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:22.630807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d99f-5ebb-4ce0-904c-913feadd7ae4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:22.632158 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64d99f-5ebb-4ce0-904c-913feadd7ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:22.634108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64d99f-5ebb-4ce0-904c-913feadd7ae4 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:22.636257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 137/279] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:22.637346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75cf95-9a91-457a-a70f-2258fe7cdbf8 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:22.637799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75cf95-9a91-457a-a70f-2258fe7cdbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:22.638236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75cf95-9a91-457a-a70f-2258fe7cdbf8 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:22.639886 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 138/280] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:22.641085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75cf95-9a91-457a-a70f-2258fe7cdbf8 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:22.641740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:22.720058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d6cda-b202-47bd-b699-08f06f74998a None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:22.731930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:22.755335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ae177-1e7a-45ce-8b6a-e4d44aa7dd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:22.755943 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ae177-1e7a-45ce-8b6a-e4d44aa7dd50 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:22.756232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ae177-1e7a-45ce-8b6a-e4d44aa7dd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:22.756481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ae177-1e7a-45ce-8b6a-e4d44aa7dd50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:22.757199 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ae177-1e7a-45ce-8b6a-e4d44aa7dd50 None admin] RBAC: Adding query filter params (role.id=2dfbdb214b97432588648dba947cb07a, user.id=edc085cef6b74720ac87419b34483bdb, scope.system=all) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:22.757528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ae177-1e7a-45ce-8b6a-e4d44aa7dd50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:22.759217 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ae177-1e7a-45ce-8b6a-e4d44aa7dd50 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:22.760847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75cf95-9a91-457a-a70f-2258fe7cdbf8 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:22.765054 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 143/281] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Aug 31 00:02:22 2022] GET /identity/v3/role_assignments?user.id=edc085cef6b74720ac87419b34483bdb&scope.system=all&role.id=2dfbdb214b97432588648dba947cb07a => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:22.766231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279d966-10f1-4f7c-8bcf-77c1bb92ef42 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:22.766506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279d966-10f1-4f7c-8bcf-77c1bb92ef42 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:22.766770 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279d966-10f1-4f7c-8bcf-77c1bb92ef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:22.791594 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-8279d966-10f1-4f7c-8bcf-77c1bb92ef42 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:22.792795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8279d966-10f1-4f7c-8bcf-77c1bb92ef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:22.807420 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbe643-bf84-413a-9812-6c9d991be5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:22.808049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbe643-bf84-413a-9812-6c9d991be5b8 None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:22.808330 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbe643-bf84-413a-9812-6c9d991be5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:22.808601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbe643-bf84-413a-9812-6c9d991be5b8 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:22.809302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbe643-bf84-413a-9812-6c9d991be5b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:22.811072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbe643-bf84-413a-9812-6c9d991be5b8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:22.845272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 139/282] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:02:22 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:02:22.870749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbe643-bf84-413a-9812-6c9d991be5b8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:22.896387 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 144/283] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:22.997198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbe643-bf84-413a-9812-6c9d991be5b8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:23.028175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:23.034713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141c425-2752-47ed-963c-1fc3ba09ff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:23.035429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141c425-2752-47ed-963c-1fc3ba09ff3c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:23.036117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141c425-2752-47ed-963c-1fc3ba09ff3c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:23.036393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141c425-2752-47ed-963c-1fc3ba09ff3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:23.049608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141c425-2752-47ed-963c-1fc3ba09ff3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-c141c425-2752-47ed-963c-1fc3ba09ff3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:23.054912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:23.056094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:23.056879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:23.056879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:23.056879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:23.056879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:23.056879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:23.056879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:23.056879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:23.056879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:23.056879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:23.056879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:23.056879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:23.056879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:23.056879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 140/284] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:02:23.062193 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279d966-10f1-4f7c-8bcf-77c1bb92ef42 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:23.087343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:23.168728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279d966-10f1-4f7c-8bcf-77c1bb92ef42 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:23.189901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141c425-2752-47ed-963c-1fc3ba09ff3c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:23.206844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992a482-4005-428c-9810-dd0548eac942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:23.207461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992a482-4005-428c-9810-dd0548eac942 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:23.208274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992a482-4005-428c-9810-dd0548eac942 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:23.208274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992a482-4005-428c-9810-dd0548eac942 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:23.208655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992a482-4005-428c-9810-dd0548eac942 None admin] RBAC: Adding query filter params (name=member) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:23.208951 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992a482-4005-428c-9810-dd0548eac942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:23.210462 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992a482-4005-428c-9810-dd0548eac942 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:23.219810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 145/285] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:23.225160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992a482-4005-428c-9810-dd0548eac942 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:23.326649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:23.333938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141c425-2752-47ed-963c-1fc3ba09ff3c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:23.344818 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992a482-4005-428c-9810-dd0548eac942 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:23.380351 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc957b-7a0a-4da5-a7e3-cad1a27ff584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:23.380555 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f725ec-75c6-4a21-a6c4-68d4b93dbc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:23.380983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f725ec-75c6-4a21-a6c4-68d4b93dbc0a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:23.381107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc957b-7a0a-4da5-a7e3-cad1a27ff584 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:23.381298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f725ec-75c6-4a21-a6c4-68d4b93dbc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:23.381394 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc957b-7a0a-4da5-a7e3-cad1a27ff584 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:23.381554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f725ec-75c6-4a21-a6c4-68d4b93dbc0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:23.381646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc957b-7a0a-4da5-a7e3-cad1a27ff584 None admin] PATH_INFO: `/v3/users/4d3ba9d153654772bba434644fe4c196` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:23.382754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc957b-7a0a-4da5-a7e3-cad1a27ff584 None admin] RBAC: Authorizing `identity:get_user(user_id=4d3ba9d153654772bba434644fe4c196)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:23.384501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc957b-7a0a-4da5-a7e3-cad1a27ff584 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:23.386141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 146/286] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:23 2022] GET /identity/v3/users/4d3ba9d153654772bba434644fe4c196 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:23.391749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc957b-7a0a-4da5-a7e3-cad1a27ff584 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:23.400831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f725ec-75c6-4a21-a6c4-68d4b93dbc0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-c7f725ec-75c6-4a21-a6c4-68d4b93dbc0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:23.410582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:23.411616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:23.412401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:23.412401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:23.412401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:23.412401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:23.412401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:23.412401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:23.412401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:23.412401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:23.412401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:23.412401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:23.412401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:23.412401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:23.413521 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 141/287] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:23.419822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f725ec-75c6-4a21-a6c4-68d4b93dbc0a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:23.522256 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:23.552473 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc957b-7a0a-4da5-a7e3-cad1a27ff584 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:23.582831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f725ec-75c6-4a21-a6c4-68d4b93dbc0a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:23.605524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1afbb-1869-41a7-b3ca-263f6fe68012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:23.606504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1afbb-1869-41a7-b3ca-263f6fe68012 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:23.607098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1afbb-1869-41a7-b3ca-263f6fe68012 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:23.607665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1afbb-1869-41a7-b3ca-263f6fe68012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:23.618379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cd373-df6c-47bc-9a1d-b76d18253fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:23.625237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cd373-df6c-47bc-9a1d-b76d18253fbd None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:23.625237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cd373-df6c-47bc-9a1d-b76d18253fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:23.625237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cd373-df6c-47bc-9a1d-b76d18253fbd None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:23.625237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cd373-df6c-47bc-9a1d-b76d18253fbd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:23.625237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cd373-df6c-47bc-9a1d-b76d18253fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:23.625237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cd373-df6c-47bc-9a1d-b76d18253fbd None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:23.630987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 142/288] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:23.636762 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cd373-df6c-47bc-9a1d-b76d18253fbd None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:23.642709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:23.743343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cd373-df6c-47bc-9a1d-b76d18253fbd None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:23.757672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:23.778496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91557e0c-7360-4a61-9f0d-c4354753073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:23.779152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91557e0c-7360-4a61-9f0d-c4354753073c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:23.779429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91557e0c-7360-4a61-9f0d-c4354753073c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:23.779743 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91557e0c-7360-4a61-9f0d-c4354753073c None admin] PATH_INFO: `/v3/users/de443ace79f04bf493c27bbf605803b7` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:23.780873 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91557e0c-7360-4a61-9f0d-c4354753073c None admin] RBAC: Authorizing `identity:get_user(user_id=de443ace79f04bf493c27bbf605803b7)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:23.782790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91557e0c-7360-4a61-9f0d-c4354753073c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:23.784881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 143/289] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:23 2022] GET /identity/v3/users/de443ace79f04bf493c27bbf605803b7 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:23.788605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1afbb-1869-41a7-b3ca-263f6fe68012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:23.790043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91557e0c-7360-4a61-9f0d-c4354753073c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:23.791473 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1afbb-1869-41a7-b3ca-263f6fe68012 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:23.949169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91557e0c-7360-4a61-9f0d-c4354753073c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:23.983938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e54c0e-25c5-4c59-8324-6772cf2518c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:23.984723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e54c0e-25c5-4c59-8324-6772cf2518c4 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:23.985099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e54c0e-25c5-4c59-8324-6772cf2518c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:23.985517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e54c0e-25c5-4c59-8324-6772cf2518c4 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:23.986857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e54c0e-25c5-4c59-8324-6772cf2518c4 None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:23.988379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e54c0e-25c5-4c59-8324-6772cf2518c4 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:23.990251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 144/290] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:23 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:23.996118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e54c0e-25c5-4c59-8324-6772cf2518c4 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:24.048471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 147/291] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:02:24.049390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:24.056902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1afbb-1869-41a7-b3ca-263f6fe68012 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:24.142800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e54c0e-25c5-4c59-8324-6772cf2518c4 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:24.150108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:24.203866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1afbb-1869-41a7-b3ca-263f6fe68012 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:24.207161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33808c8d-ce4b-4d47-90ba-2f60cef13bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:24.207840 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33808c8d-ce4b-4d47-90ba-2f60cef13bad None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:24.208116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33808c8d-ce4b-4d47-90ba-2f60cef13bad None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:24.208445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33808c8d-ce4b-4d47-90ba-2f60cef13bad None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8/users/de443ace79f04bf493c27bbf605803b7/roles/86d6f10ad167487ab620bf591795470c` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:24.210398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33808c8d-ce4b-4d47-90ba-2f60cef13bad None admin] RBAC: Authorizing `identity:create_grant(project_id=caeb95674dad43889d74cefec13b3ed8, user_id=de443ace79f04bf493c27bbf605803b7, role_id=86d6f10ad167487ab620bf591795470c)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:24.211882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33808c8d-ce4b-4d47-90ba-2f60cef13bad None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:24.239013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 145/292] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:02:23 2022] PUT /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8/users/de443ace79f04bf493c27bbf605803b7/roles/86d6f10ad167487ab620bf591795470c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:24.241963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f24c62-9316-4208-84f1-79e9d2e2e28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:24.243168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f24c62-9316-4208-84f1-79e9d2e2e28e None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:24.243644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f24c62-9316-4208-84f1-79e9d2e2e28e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:24.244057 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f24c62-9316-4208-84f1-79e9d2e2e28e None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:24.245559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f24c62-9316-4208-84f1-79e9d2e2e28e None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:24.247312 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f24c62-9316-4208-84f1-79e9d2e2e28e None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:24.249700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 148/293] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:24 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:24.256081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33808c8d-ce4b-4d47-90ba-2f60cef13bad None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:24.404173 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33808c8d-ce4b-4d47-90ba-2f60cef13bad None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:24.414783 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:24.441533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06026a24-bebf-44be-ba69-69fbc12468eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:24.442153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06026a24-bebf-44be-ba69-69fbc12468eb None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:24.442428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06026a24-bebf-44be-ba69-69fbc12468eb None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:24.442694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06026a24-bebf-44be-ba69-69fbc12468eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:24.443428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06026a24-bebf-44be-ba69-69fbc12468eb None admin] RBAC: Adding query filter params (role.id=2dfbdb214b97432588648dba947cb07a, scope.project.id=caeb95674dad43889d74cefec13b3ed8, user.id=4d3ba9d153654772bba434644fe4c196) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:24.443731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06026a24-bebf-44be-ba69-69fbc12468eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:24.445180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06026a24-bebf-44be-ba69-69fbc12468eb None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:24.452547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 146/294] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:24 2022] GET /identity/v3/role_assignments?user.id=4d3ba9d153654772bba434644fe4c196&scope.project.id=caeb95674dad43889d74cefec13b3ed8&role.id=2dfbdb214b97432588648dba947cb07a => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:25.036399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89545f-f771-4393-ade1-153255181758 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:25.037085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89545f-f771-4393-ade1-153255181758 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:25.037581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89545f-f771-4393-ade1-153255181758 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:25.039484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 149/295] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:25.044502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7242f0-f216-446a-91da-de7cff2e2a86 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:25.045040 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7242f0-f216-446a-91da-de7cff2e2a86 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:25.045574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7242f0-f216-446a-91da-de7cff2e2a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:25.067126 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-da7242f0-f216-446a-91da-de7cff2e2a86 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:25.069104 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-da7242f0-f216-446a-91da-de7cff2e2a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:25.162830 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 147/296] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:25.242571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cb0c1-13f4-4eec-bbfe-ab357cbb2d54 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:25.243191 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cb0c1-13f4-4eec-bbfe-ab357cbb2d54 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:25.243191 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cb0c1-13f4-4eec-bbfe-ab357cbb2d54 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:25.244708 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 150/297] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:25.249969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d77e0-189e-46ad-ac7e-3bf2bd799085 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:25.250250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d77e0-189e-46ad-ac7e-3bf2bd799085 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:25.250515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d77e0-189e-46ad-ac7e-3bf2bd799085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:25.278752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-fe8d77e0-189e-46ad-ac7e-3bf2bd799085 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:25.279936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-fe8d77e0-189e-46ad-ac7e-3bf2bd799085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:25.317232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1674e-b180-4835-89e4-a9cef087420a None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:25.317468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1674e-b180-4835-89e4-a9cef087420a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:25.317707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1674e-b180-4835-89e4-a9cef087420a None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:25.319213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 151/298] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:02:25.324763 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe780-0979-4be9-a301-3fb47b3e4813 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:25.325041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe780-0979-4be9-a301-3fb47b3e4813 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:25.325666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe780-0979-4be9-a301-3fb47b3e4813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:25.344156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-cb6fe780-0979-4be9-a301-3fb47b3e4813 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:25.345363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-cb6fe780-0979-4be9-a301-3fb47b3e4813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:25.361261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 148/299] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:25.416066 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 152/300] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:25.431203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d77e0-189e-46ad-ac7e-3bf2bd799085 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:25.470978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:25.536975 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d77e0-189e-46ad-ac7e-3bf2bd799085 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:25.572224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9fab5-28ad-4195-b399-18c10bb465ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:25.572771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9fab5-28ad-4195-b399-18c10bb465ea None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:25.573039 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9fab5-28ad-4195-b399-18c10bb465ea None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:25.573378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9fab5-28ad-4195-b399-18c10bb465ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:25.583524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9fab5-28ad-4195-b399-18c10bb465ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-aed9fab5-28ad-4195-b399-18c10bb465ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:25.588449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:25.589364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:25.590157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:25.590157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:25.590157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:25.590157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:25.590157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:25.590157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:25.590157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:25.590157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:25.590157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:25.590157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:25.590157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:25.590157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:25.590157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 149/301] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:25.595527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fe780-0979-4be9-a301-3fb47b3e4813 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:25.650058 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9fab5-28ad-4195-b399-18c10bb465ea None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:25.653556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:25.717645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fe780-0979-4be9-a301-3fb47b3e4813 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:25.750169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:25.752467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dff46a-4a05-4069-b2e5-36180db6d07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:25.753057 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff46a-4a05-4069-b2e5-36180db6d07d None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:25.753360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff46a-4a05-4069-b2e5-36180db6d07d None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:25.753660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff46a-4a05-4069-b2e5-36180db6d07d None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:25.754320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dff46a-4a05-4069-b2e5-36180db6d07d None admin] RBAC: Adding query filter params (name=member) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:25.754613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dff46a-4a05-4069-b2e5-36180db6d07d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:25.755978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dff46a-4a05-4069-b2e5-36180db6d07d None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:25.760165 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9fab5-28ad-4195-b399-18c10bb465ea None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:25.769249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 153/302] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:25.769249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dff46a-4a05-4069-b2e5-36180db6d07d None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:25.796764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aa99a-eacc-472e-84c5-9e4d5764a0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:25.797570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa99a-eacc-472e-84c5-9e4d5764a0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:25.797849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa99a-eacc-472e-84c5-9e4d5764a0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:25.798123 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa99a-eacc-472e-84c5-9e4d5764a0e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:25.808896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4aa99a-eacc-472e-84c5-9e4d5764a0e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-cb4aa99a-eacc-472e-84c5-9e4d5764a0e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:25.814163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:25.815224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 150/303] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:02:25.816028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aa99a-eacc-472e-84c5-9e4d5764a0e8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:25.884824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dff46a-4a05-4069-b2e5-36180db6d07d None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:25.899182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:25.917975 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aa99a-eacc-472e-84c5-9e4d5764a0e8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:25.927461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb760aad-2697-4ff2-b095-5c4e2425757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:25.928343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760aad-2697-4ff2-b095-5c4e2425757f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:25.929297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760aad-2697-4ff2-b095-5c4e2425757f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:25.929743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760aad-2697-4ff2-b095-5c4e2425757f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:25.931855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb760aad-2697-4ff2-b095-5c4e2425757f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:25.934471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb760aad-2697-4ff2-b095-5c4e2425757f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:25.936782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 154/304] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:25.938130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb760aad-2697-4ff2-b095-5c4e2425757f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:25.955405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd55a28-80ab-4585-9bb2-0ae84efb3215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:25.956152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd55a28-80ab-4585-9bb2-0ae84efb3215 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:25.956425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd55a28-80ab-4585-9bb2-0ae84efb3215 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:25.956809 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd55a28-80ab-4585-9bb2-0ae84efb3215 None admin] PATH_INFO: `/v3/users/edc085cef6b74720ac87419b34483bdb` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:25.957954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd55a28-80ab-4585-9bb2-0ae84efb3215 None admin] RBAC: Authorizing `identity:get_user(user_id=edc085cef6b74720ac87419b34483bdb)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:25.959398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd55a28-80ab-4585-9bb2-0ae84efb3215 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:25.960985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 151/305] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:25 2022] GET /identity/v3/users/edc085cef6b74720ac87419b34483bdb => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:25.961811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd55a28-80ab-4585-9bb2-0ae84efb3215 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:25.988862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:26.050616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb760aad-2697-4ff2-b095-5c4e2425757f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:26.078375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd55a28-80ab-4585-9bb2-0ae84efb3215 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:26.088468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888a601-6d25-4b61-8ed0-4be5d66d0899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:26.089089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888a601-6d25-4b61-8ed0-4be5d66d0899 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:26.089392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888a601-6d25-4b61-8ed0-4be5d66d0899 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:26.089754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888a601-6d25-4b61-8ed0-4be5d66d0899 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:26.090630 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888a601-6d25-4b61-8ed0-4be5d66d0899 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:26.090783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888a601-6d25-4b61-8ed0-4be5d66d0899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:26.092187 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888a601-6d25-4b61-8ed0-4be5d66d0899 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:26.102481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 155/306] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:26.103477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888a601-6d25-4b61-8ed0-4be5d66d0899 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:26.116475 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9e7e-33b7-4518-9bed-73f2412fb826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:26.117086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9e7e-33b7-4518-9bed-73f2412fb826 None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:26.117516 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9e7e-33b7-4518-9bed-73f2412fb826 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:26.117785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9e7e-33b7-4518-9bed-73f2412fb826 None admin] PATH_INFO: `/v3/groups` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:26.118644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9e7e-33b7-4518-9bed-73f2412fb826 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:26.120178 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9e7e-33b7-4518-9bed-73f2412fb826 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:26.137568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 152/307] 10.222.0.60 () {60 vars in 1134 bytes} [Wed Aug 31 00:02:25 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:02:26.150395 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9e7e-33b7-4518-9bed-73f2412fb826 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:26.152850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:26.221578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888a601-6d25-4b61-8ed0-4be5d66d0899 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:26.267520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ab85d-c96a-42fe-b560-6f9a5d9fcaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:26.268946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ab85d-c96a-42fe-b560-6f9a5d9fcaf2 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:26.269580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ab85d-c96a-42fe-b560-6f9a5d9fcaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:26.270026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ab85d-c96a-42fe-b560-6f9a5d9fcaf2 None admin] PATH_INFO: `/v3/system/users/edc085cef6b74720ac87419b34483bdb/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:26.272504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ab85d-c96a-42fe-b560-6f9a5d9fcaf2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=edc085cef6b74720ac87419b34483bdb, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:26.275338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ab85d-c96a-42fe-b560-6f9a5d9fcaf2 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:26.278115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:26.294402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 156/308] 10.222.0.60 () {58 vars in 1334 bytes} [Wed Aug 31 00:02:26 2022] PUT /identity/v3/system/users/edc085cef6b74720ac87419b34483bdb/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:26.304508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9e7e-33b7-4518-9bed-73f2412fb826 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:26.348608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aac8c4-e24f-42a3-bce5-fc6da6f296d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:26.349351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aac8c4-e24f-42a3-bce5-fc6da6f296d0 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:26.349700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aac8c4-e24f-42a3-bce5-fc6da6f296d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:26.349977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aac8c4-e24f-42a3-bce5-fc6da6f296d0 None admin] PATH_INFO: `/v3/users/bb5848772db34c62948982a886a0bc3f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:26.370178 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aac8c4-e24f-42a3-bce5-fc6da6f296d0 None admin] RBAC: Authorizing `identity:get_user(user_id=bb5848772db34c62948982a886a0bc3f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:26.371680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aac8c4-e24f-42a3-bce5-fc6da6f296d0 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:26.374005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 153/309] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:26 2022] GET /identity/v3/users/bb5848772db34c62948982a886a0bc3f => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:26.379990 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ab85d-c96a-42fe-b560-6f9a5d9fcaf2 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:26.447646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c5aaa-dc96-4f55-b89f-a28cc016262e None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:26.448249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c5aaa-dc96-4f55-b89f-a28cc016262e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:26.448687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c5aaa-dc96-4f55-b89f-a28cc016262e None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:26.450307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 154/310] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:02:26.456131 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe270b-3593-4b81-8818-3e146fe9438b None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:26.456404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe270b-3593-4b81-8818-3e146fe9438b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:26.456668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe270b-3593-4b81-8818-3e146fe9438b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:26.482251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-6cbe270b-3593-4b81-8818-3e146fe9438b None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:26.483454 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-6cbe270b-3593-4b81-8818-3e146fe9438b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:26.497442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ab85d-c96a-42fe-b560-6f9a5d9fcaf2 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:26.505050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:26.534220 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac64c7-99ca-48b0-9c82-5c30fbee08a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:26.534921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac64c7-99ca-48b0-9c82-5c30fbee08a9 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:26.535515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac64c7-99ca-48b0-9c82-5c30fbee08a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:26.535515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac64c7-99ca-48b0-9c82-5c30fbee08a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:26.536383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac64c7-99ca-48b0-9c82-5c30fbee08a9 None admin] RBAC: Adding query filter params (role.id=86d6f10ad167487ab620bf591795470c, user.id=bb5848772db34c62948982a886a0bc3f, scope.system=all) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:26.536778 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac64c7-99ca-48b0-9c82-5c30fbee08a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:26.538336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac64c7-99ca-48b0-9c82-5c30fbee08a9 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:26.544535 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 157/311] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Aug 31 00:02:26 2022] GET /identity/v3/role_assignments?user.id=bb5848772db34c62948982a886a0bc3f&scope.system=all&role.id=86d6f10ad167487ab620bf591795470c => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:26.563653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 155/312] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:26.833860 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac64c7-99ca-48b0-9c82-5c30fbee08a9 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:26.939728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac64c7-99ca-48b0-9c82-5c30fbee08a9 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:26.975598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b967bf0-0b86-4b97-b493-c67a8181f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:26.976237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b967bf0-0b86-4b97-b493-c67a8181f494 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:26.976509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b967bf0-0b86-4b97-b493-c67a8181f494 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:26.976811 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b967bf0-0b86-4b97-b493-c67a8181f494 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:26.987648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b967bf0-0b86-4b97-b493-c67a8181f494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-0b967bf0-0b86-4b97-b493-c67a8181f494 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:26.992722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:26.993637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:26.994426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:26.994426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:26.994426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:26.994426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:26.994426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:26.994426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:26.994426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:26.994426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:26.994426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:26.994426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:26.994426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:26.994426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:26.994426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 158/313] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:27.000184 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe270b-3593-4b81-8818-3e146fe9438b None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:27.076681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:27.111688 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe270b-3593-4b81-8818-3e146fe9438b None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:27.146108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548026b-d746-4099-8d41-cfea4790b4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:27.146745 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548026b-d746-4099-8d41-cfea4790b4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:27.147014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548026b-d746-4099-8d41-cfea4790b4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:27.147274 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548026b-d746-4099-8d41-cfea4790b4f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:27.147938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548026b-d746-4099-8d41-cfea4790b4f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:27.148229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548026b-d746-4099-8d41-cfea4790b4f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:27.149738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548026b-d746-4099-8d41-cfea4790b4f1 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:27.158796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 156/314] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:27.166567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b967bf0-0b86-4b97-b493-c67a8181f494 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:27.199889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:27.274244 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b967bf0-0b86-4b97-b493-c67a8181f494 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:27.310038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b3af5-2237-4019-8d76-d4307e2e1add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:27.311058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3af5-2237-4019-8d76-d4307e2e1add None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:27.311520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3af5-2237-4019-8d76-d4307e2e1add None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:27.311989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3af5-2237-4019-8d76-d4307e2e1add None admin] PATH_INFO: `/v3/users/de443ace79f04bf493c27bbf605803b7` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:27.313341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b3af5-2237-4019-8d76-d4307e2e1add None admin] RBAC: Authorizing `identity:get_user(user_id=de443ace79f04bf493c27bbf605803b7)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:27.314975 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b3af5-2237-4019-8d76-d4307e2e1add None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:27.317100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 159/315] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:27 2022] GET /identity/v3/users/de443ace79f04bf493c27bbf605803b7 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:27.322708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548026b-d746-4099-8d41-cfea4790b4f1 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:27.433535 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548026b-d746-4099-8d41-cfea4790b4f1 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:27.464078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:27.470685 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8ee4-3fe9-4435-8a0e-01ff24ea17d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:27.471653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8ee4-3fe9-4435-8a0e-01ff24ea17d6 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:27.472118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8ee4-3fe9-4435-8a0e-01ff24ea17d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:27.472592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8ee4-3fe9-4435-8a0e-01ff24ea17d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:27.543306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc8ee4-3fe9-4435-8a0e-01ff24ea17d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:27.545082 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc8ee4-3fe9-4435-8a0e-01ff24ea17d6 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:27.648905 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 157/316] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:02:27.654310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b3af5-2237-4019-8d76-d4307e2e1add None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:27.754687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:27.758930 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b3af5-2237-4019-8d76-d4307e2e1add None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:27.794691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe980df-df74-4293-9052-694c120744ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:27.795675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe980df-df74-4293-9052-694c120744ae None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:27.796136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe980df-df74-4293-9052-694c120744ae None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:27.796590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe980df-df74-4293-9052-694c120744ae None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:27.797997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe980df-df74-4293-9052-694c120744ae None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:27.799673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe980df-df74-4293-9052-694c120744ae None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:27.801871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 160/317] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:27 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:27.807651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8ee4-3fe9-4435-8a0e-01ff24ea17d6 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:27.840505 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:27.913706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8ee4-3fe9-4435-8a0e-01ff24ea17d6 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:27.949200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a1294-b16c-4676-9192-b0a87142b660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:27.950202 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a1294-b16c-4676-9192-b0a87142b660 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:27.950671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a1294-b16c-4676-9192-b0a87142b660 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:27.951129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a1294-b16c-4676-9192-b0a87142b660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:27.952077 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a1294-b16c-4676-9192-b0a87142b660 None admin] RBAC: Adding query filter params (role.id=86d6f10ad167487ab620bf591795470c, scope.project.id=caeb95674dad43889d74cefec13b3ed8, user.id=de443ace79f04bf493c27bbf605803b7) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:27.952591 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a1294-b16c-4676-9192-b0a87142b660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:27.954220 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a1294-b16c-4676-9192-b0a87142b660 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:27.961093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 158/318] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:27 2022] GET /identity/v3/role_assignments?user.id=de443ace79f04bf493c27bbf605803b7&scope.project.id=caeb95674dad43889d74cefec13b3ed8&role.id=86d6f10ad167487ab620bf591795470c => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:28.278036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a49366-4f76-448a-a504-ca334cbd2f67 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:28.278583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a49366-4f76-448a-a504-ca334cbd2f67 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:28.278583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a49366-4f76-448a-a504-ca334cbd2f67 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:28.280068 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 161/319] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:28.285487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eea5a-c124-446c-b3ee-0b07bb62e08b None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:28.285731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eea5a-c124-446c-b3ee-0b07bb62e08b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:28.286024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eea5a-c124-446c-b3ee-0b07bb62e08b None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:28.286518 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b9747-c2b4-4616-a119-2142202a7576 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:28.286942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b9747-c2b4-4616-a119-2142202a7576 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:28.287015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b9747-c2b4-4616-a119-2142202a7576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:28.287490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 162/320] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:02:28.292935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb318c-17ff-4021-bd6b-34a6c95a5591 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:28.293177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb318c-17ff-4021-bd6b-34a6c95a5591 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:28.293505 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb318c-17ff-4021-bd6b-34a6c95a5591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:28.306372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-6b7b9747-c2b4-4616-a119-2142202a7576 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:28.307578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-6b7b9747-c2b4-4616-a119-2142202a7576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:28.312961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-98bb318c-17ff-4021-bd6b-34a6c95a5591 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:28.314176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-98bb318c-17ff-4021-bd6b-34a6c95a5591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:28.380183 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 159/321] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:28.386109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 163/322] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:28.436797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06870c1-fb03-41c6-b5b1-0fd9c0cab770 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:28.437039 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06870c1-fb03-41c6-b5b1-0fd9c0cab770 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:28.437375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06870c1-fb03-41c6-b5b1-0fd9c0cab770 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:28.438709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 160/323] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:28.443930 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6efc-fe63-4f02-a7ad-36ee8c1bf273 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:28.444208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6efc-fe63-4f02-a7ad-36ee8c1bf273 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:28.444474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6efc-fe63-4f02-a7ad-36ee8c1bf273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:28.467976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-10bb6efc-fe63-4f02-a7ad-36ee8c1bf273 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:28.469154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-10bb6efc-fe63-4f02-a7ad-36ee8c1bf273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:28.537979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 164/324] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:28.649752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06870c1-fb03-41c6-b5b1-0fd9c0cab770 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:28.650395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb6efc-fe63-4f02-a7ad-36ee8c1bf273 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:28.678774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:28.679940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:28.758369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb6efc-fe63-4f02-a7ad-36ee8c1bf273 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:28.768376 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06870c1-fb03-41c6-b5b1-0fd9c0cab770 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:28.793225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b5607-5f1c-4abd-964c-3a79de8f19a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:28.793837 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5607-5f1c-4abd-964c-3a79de8f19a4 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:28.794111 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5607-5f1c-4abd-964c-3a79de8f19a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:28.794409 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5607-5f1c-4abd-964c-3a79de8f19a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:28.803464 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58da28-c0d2-4984-ad1e-70323f1dc527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:28.804108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58da28-c0d2-4984-ad1e-70323f1dc527 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:28.804384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58da28-c0d2-4984-ad1e-70323f1dc527 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:28.804641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58da28-c0d2-4984-ad1e-70323f1dc527 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:28.804918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b5607-5f1c-4abd-964c-3a79de8f19a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:28.805799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58da28-c0d2-4984-ad1e-70323f1dc527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:28.807239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58da28-c0d2-4984-ad1e-70323f1dc527 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:28.808990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 161/325] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-db3b5607-5f1c-4abd-964c-3a79de8f19a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:28.810032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:28.810874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:28.811685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:28.811685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:28.811685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:28.811685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:28.811685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:28.811685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:28.811685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:28.811685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:28.811685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:28.811685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:28.811685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:28.811685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:28.811685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 165/326] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:02:28.814364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58da28-c0d2-4984-ad1e-70323f1dc527 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:28.814844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b5607-5f1c-4abd-964c-3a79de8f19a4 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:28.901331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:28.909508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:28.917650 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b5607-5f1c-4abd-964c-3a79de8f19a4 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:28.918719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58da28-c0d2-4984-ad1e-70323f1dc527 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:28.950595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe4568-3b01-4207-86bb-f82595eca1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:28.951213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4568-3b01-4207-86bb-f82595eca1df None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:28.951466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4568-3b01-4207-86bb-f82595eca1df None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:28.951724 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4568-3b01-4207-86bb-f82595eca1df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:28.953013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d5531-8ece-4a08-887c-ef742eb6562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:28.953645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d5531-8ece-4a08-887c-ef742eb6562b None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:28.953918 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d5531-8ece-4a08-887c-ef742eb6562b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:28.954185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d5531-8ece-4a08-887c-ef742eb6562b None admin] PATH_INFO: `/v3/groups` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:28.954808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d5531-8ece-4a08-887c-ef742eb6562b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:28.956226 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d5531-8ece-4a08-887c-ef742eb6562b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:28.962088 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe4568-3b01-4207-86bb-f82595eca1df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-e2fe4568-3b01-4207-86bb-f82595eca1df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:28.967250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:28.968197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 166/327] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:02:28.970232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe4568-3b01-4207-86bb-f82595eca1df None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:28.974054 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 162/328] 10.222.0.60 () {60 vars in 1134 bytes} [Wed Aug 31 00:02:28 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:02:28.974881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d5531-8ece-4a08-887c-ef742eb6562b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:29.088739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe4568-3b01-4207-86bb-f82595eca1df None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:29.121295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d5531-8ece-4a08-887c-ef742eb6562b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:29.130572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576aaf7-f0cc-4d7c-9b69-4c65de528e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:29.131189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576aaf7-f0cc-4d7c-9b69-4c65de528e00 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:29.131454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576aaf7-f0cc-4d7c-9b69-4c65de528e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:29.131718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576aaf7-f0cc-4d7c-9b69-4c65de528e00 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:29.132386 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576aaf7-f0cc-4d7c-9b69-4c65de528e00 None admin] RBAC: Adding query filter params (name=member) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:29.132678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576aaf7-f0cc-4d7c-9b69-4c65de528e00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:29.134668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576aaf7-f0cc-4d7c-9b69-4c65de528e00 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:29.143887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 167/329] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:29.149978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576aaf7-f0cc-4d7c-9b69-4c65de528e00 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:29.162092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:29.164229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0ad59-700b-4de5-b7fa-cdf5279c38e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:29.164922 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0ad59-700b-4de5-b7fa-cdf5279c38e7 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:29.165473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0ad59-700b-4de5-b7fa-cdf5279c38e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:29.168078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0ad59-700b-4de5-b7fa-cdf5279c38e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:29.168078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0ad59-700b-4de5-b7fa-cdf5279c38e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:29.168078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0ad59-700b-4de5-b7fa-cdf5279c38e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:29.168322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0ad59-700b-4de5-b7fa-cdf5279c38e7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:29.178157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 163/330] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:29.184273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0ad59-700b-4de5-b7fa-cdf5279c38e7 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:29.202369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:29.280212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576aaf7-f0cc-4d7c-9b69-4c65de528e00 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:29.309418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0ad59-700b-4de5-b7fa-cdf5279c38e7 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:29.321311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d34b14-1f8f-466f-977e-cd40576c9419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:29.321958 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d34b14-1f8f-466f-977e-cd40576c9419 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:29.322242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d34b14-1f8f-466f-977e-cd40576c9419 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:29.322495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d34b14-1f8f-466f-977e-cd40576c9419 None admin] PATH_INFO: `/v3/users/edc085cef6b74720ac87419b34483bdb` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:29.323719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d34b14-1f8f-466f-977e-cd40576c9419 None admin] RBAC: Authorizing `identity:get_user(user_id=edc085cef6b74720ac87419b34483bdb)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:29.325090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d34b14-1f8f-466f-977e-cd40576c9419 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:29.326724 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 168/331] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:29 2022] GET /identity/v3/users/edc085cef6b74720ac87419b34483bdb => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:29.332745 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d34b14-1f8f-466f-977e-cd40576c9419 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:29.352341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602eed-feae-4d89-9398-5f2826696cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:29.354452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602eed-feae-4d89-9398-5f2826696cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:29.354729 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602eed-feae-4d89-9398-5f2826696cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:29.355265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602eed-feae-4d89-9398-5f2826696cc7 None admin] PATH_INFO: `/v3/users/bb5848772db34c62948982a886a0bc3f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:29.357356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea602eed-feae-4d89-9398-5f2826696cc7 None admin] RBAC: Authorizing `identity:get_user(user_id=bb5848772db34c62948982a886a0bc3f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:29.358875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea602eed-feae-4d89-9398-5f2826696cc7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:29.360730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 164/332] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:29 2022] GET /identity/v3/users/bb5848772db34c62948982a886a0bc3f => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:29.366277 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602eed-feae-4d89-9398-5f2826696cc7 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:29.451383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:29.485703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d34b14-1f8f-466f-977e-cd40576c9419 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:29.488499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:29.513110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602eed-feae-4d89-9398-5f2826696cc7 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:29.530277 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252cbe3-eab9-4b4e-9397-fb7ec92c16d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:29.531209 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252cbe3-eab9-4b4e-9397-fb7ec92c16d0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:29.531480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252cbe3-eab9-4b4e-9397-fb7ec92c16d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:29.531750 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252cbe3-eab9-4b4e-9397-fb7ec92c16d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:29.532751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252cbe3-eab9-4b4e-9397-fb7ec92c16d0 None admin] RBAC: Adding query filter params (role.id=2dfbdb214b97432588648dba947cb07a, user.id=edc085cef6b74720ac87419b34483bdb, scope.system=all) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:29.533059 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252cbe3-eab9-4b4e-9397-fb7ec92c16d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:29.534783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252cbe3-eab9-4b4e-9397-fb7ec92c16d0 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:29.553314 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 169/333] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Aug 31 00:02:29 2022] GET /identity/v3/role_assignments?user.id=edc085cef6b74720ac87419b34483bdb&scope.system=all&role.id=2dfbdb214b97432588648dba947cb07a => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:29.571227 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e3f6a-e222-4860-a43f-88fb688a4831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:29.571927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e3f6a-e222-4860-a43f-88fb688a4831 None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:29.572196 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e3f6a-e222-4860-a43f-88fb688a4831 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:29.572471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e3f6a-e222-4860-a43f-88fb688a4831 None admin] PATH_INFO: `/v3/system/users/bb5848772db34c62948982a886a0bc3f/roles/86d6f10ad167487ab620bf591795470c` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:29.573926 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e3f6a-e222-4860-a43f-88fb688a4831 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bb5848772db34c62948982a886a0bc3f, role_id=86d6f10ad167487ab620bf591795470c)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:29.575303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e3f6a-e222-4860-a43f-88fb688a4831 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:29.592067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 165/334] 10.222.0.60 () {58 vars in 1334 bytes} [Wed Aug 31 00:02:29 2022] PUT /identity/v3/system/users/bb5848772db34c62948982a886a0bc3f/roles/86d6f10ad167487ab620bf591795470c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:02:31.119325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40498ab-21fc-48f1-abea-279755fc86b0 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:31.119884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40498ab-21fc-48f1-abea-279755fc86b0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:31.119884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40498ab-21fc-48f1-abea-279755fc86b0 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:31.121404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 170/335] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:31.139193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd3860-af65-466b-9959-c64cf088e7de None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:31.140117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd3860-af65-466b-9959-c64cf088e7de None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:31.140588 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd3860-af65-466b-9959-c64cf088e7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:31.166343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-50bd3860-af65-466b-9959-c64cf088e7de None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:31.167858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-50bd3860-af65-466b-9959-c64cf088e7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:31.253421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 166/336] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:31.535228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2a368-adea-4ee5-80c7-b1e7eaba7535 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:31.535600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2a368-adea-4ee5-80c7-b1e7eaba7535 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:31.535772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2a368-adea-4ee5-80c7-b1e7eaba7535 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:31.537395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 171/337] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:31.543105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bec93e-bf3a-454c-b4fb-0bc5b33f9e13 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:31.543414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bec93e-bf3a-454c-b4fb-0bc5b33f9e13 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:31.543689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bec93e-bf3a-454c-b4fb-0bc5b33f9e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:31.568303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d2bec93e-bf3a-454c-b4fb-0bc5b33f9e13 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:31.569577 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d2bec93e-bf3a-454c-b4fb-0bc5b33f9e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:31.656169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 167/338] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:31.708233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2a368-adea-4ee5-80c7-b1e7eaba7535 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:31.830935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2a368-adea-4ee5-80c7-b1e7eaba7535 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:31.873022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc84a9-3be6-41d2-adfb-17de280956f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:31.873695 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc84a9-3be6-41d2-adfb-17de280956f0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:31.873970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc84a9-3be6-41d2-adfb-17de280956f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:31.874240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc84a9-3be6-41d2-adfb-17de280956f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:31.881501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:31.890050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc84a9-3be6-41d2-adfb-17de280956f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-7edc84a9-3be6-41d2-adfb-17de280956f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:31.894861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:31.895728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:31.896507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:31.896507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:31.896507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:31.896507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:31.896507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:31.896507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:31.896507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:31.896507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:31.896507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:31.896507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:31.896507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:31.896507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:31.898071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 172/339] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:31.903955 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bec93e-bf3a-454c-b4fb-0bc5b33f9e13 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:31.914710 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:32.016719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc84a9-3be6-41d2-adfb-17de280956f0 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:32.017768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bec93e-bf3a-454c-b4fb-0bc5b33f9e13 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:32.068944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db314f2-0862-4a83-b469-cba959b86519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:32.069620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db314f2-0862-4a83-b469-cba959b86519 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:32.069899 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db314f2-0862-4a83-b469-cba959b86519 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:32.070203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db314f2-0862-4a83-b469-cba959b86519 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:32.071010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db314f2-0862-4a83-b469-cba959b86519 None admin] RBAC: Adding query filter params (name=member) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:32.071424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db314f2-0862-4a83-b469-cba959b86519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:32.072800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db314f2-0862-4a83-b469-cba959b86519 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:32.102252 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 168/340] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:32.102923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d5e76-e419-4d51-84a1-2ea0fb88c30d None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:32.103209 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d5e76-e419-4d51-84a1-2ea0fb88c30d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:32.103480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d5e76-e419-4d51-84a1-2ea0fb88c30d None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:32.104827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 169/341] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:32.105581 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d5e76-e419-4d51-84a1-2ea0fb88c30d None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:32.182733 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc84a9-3be6-41d2-adfb-17de280956f0 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:32.233183 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42442d13-a86d-442f-b6cb-3381fc5858e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:32.233884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42442d13-a86d-442f-b6cb-3381fc5858e2 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:32.234162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42442d13-a86d-442f-b6cb-3381fc5858e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:32.234433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42442d13-a86d-442f-b6cb-3381fc5858e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:32.245499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:32.251428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42442d13-a86d-442f-b6cb-3381fc5858e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-42442d13-a86d-442f-b6cb-3381fc5858e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:32.259645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:32.260581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:32.261447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:32.261447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:32.261447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:32.261447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:32.261447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:32.261447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:32.261447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:32.261447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:32.261447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:32.261447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:32.261447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:32.261447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:32.266050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 173/342] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:02:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:02:32.268278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13bedb-806c-4666-b2c6-af55f72d3fa9 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:32.269020 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13bedb-806c-4666-b2c6-af55f72d3fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:32.269553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13bedb-806c-4666-b2c6-af55f72d3fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:32.298142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d5e76-e419-4d51-84a1-2ea0fb88c30d None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:32.299295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-df13bedb-806c-4666-b2c6-af55f72d3fa9 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:32.301122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-df13bedb-806c-4666-b2c6-af55f72d3fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:32.354695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5941fa-83e6-47dd-9853-72e2051ecbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:32.355236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5941fa-83e6-47dd-9853-72e2051ecbfd None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:32.355510 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5941fa-83e6-47dd-9853-72e2051ecbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:32.355775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5941fa-83e6-47dd-9853-72e2051ecbfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:32.383965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:32.405053 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 174/343] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:32.406982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a99a6-39d9-4828-b368-20c9ceddcfb0 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:32.407481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a99a6-39d9-4828-b368-20c9ceddcfb0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:32.408000 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a99a6-39d9-4828-b368-20c9ceddcfb0 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:32.409454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 175/344] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:32.410369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a99a6-39d9-4828-b368-20c9ceddcfb0 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:32.442443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5941fa-83e6-47dd-9853-72e2051ecbfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:32.443892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5941fa-83e6-47dd-9853-72e2051ecbfd None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:32.522357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a99a6-39d9-4828-b368-20c9ceddcfb0 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:32.539644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:32.561506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eeb8e7-b51b-40ec-8e33-2da2c69b382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:32.562519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eeb8e7-b51b-40ec-8e33-2da2c69b382c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:32.563029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eeb8e7-b51b-40ec-8e33-2da2c69b382c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:32.563488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eeb8e7-b51b-40ec-8e33-2da2c69b382c None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:32.564348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eeb8e7-b51b-40ec-8e33-2da2c69b382c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:32.564835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eeb8e7-b51b-40ec-8e33-2da2c69b382c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:32.566448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eeb8e7-b51b-40ec-8e33-2da2c69b382c None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:32.576309 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 176/345] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:32.577872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071fbfb-e592-40d9-af18-c9466ee6c68f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:32.578345 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071fbfb-e592-40d9-af18-c9466ee6c68f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:32.578807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071fbfb-e592-40d9-af18-c9466ee6c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:32.597328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 170/346] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:32.600100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-e071fbfb-e592-40d9-af18-c9466ee6c68f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:32.601761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e071fbfb-e592-40d9-af18-c9466ee6c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:32.603426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5941fa-83e6-47dd-9853-72e2051ecbfd None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:32.649426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:32.677227 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 177/347] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:32.678445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071fbfb-e592-40d9-af18-c9466ee6c68f None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:32.753372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5941fa-83e6-47dd-9853-72e2051ecbfd None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:32.798846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071fbfb-e592-40d9-af18-c9466ee6c68f None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:32.814026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b768c71-bf17-4197-b2b5-658244119225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:32.814577 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b768c71-bf17-4197-b2b5-658244119225 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:32.814853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b768c71-bf17-4197-b2b5-658244119225 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:32.815123 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b768c71-bf17-4197-b2b5-658244119225 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:32.846770 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af202d31-aa08-4693-915c-999dbf097dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:32.847769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af202d31-aa08-4693-915c-999dbf097dfe None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:32.848237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af202d31-aa08-4693-915c-999dbf097dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:32.848755 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af202d31-aa08-4693-915c-999dbf097dfe None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:32.850150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af202d31-aa08-4693-915c-999dbf097dfe None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:32.851900 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af202d31-aa08-4693-915c-999dbf097dfe None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:32.853846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 178/348] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:32 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:32.859495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af202d31-aa08-4693-915c-999dbf097dfe None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:32.873759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:32.913490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:32.924007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b768c71-bf17-4197-b2b5-658244119225 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:32.925506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b768c71-bf17-4197-b2b5-658244119225 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:32.976741 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af202d31-aa08-4693-915c-999dbf097dfe None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:33.015003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083e28-9a23-43da-91a9-d9ca298392d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:33.016106 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083e28-9a23-43da-91a9-d9ca298392d6 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:33.016590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083e28-9a23-43da-91a9-d9ca298392d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:33.017049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083e28-9a23-43da-91a9-d9ca298392d6 None admin] PATH_INFO: `/v3/groups/801d032c2d134926afc53308ff0d77d6` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:33.023889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a083e28-9a23-43da-91a9-d9ca298392d6 None admin] RBAC: Authorizing `identity:get_group(group_id=801d032c2d134926afc53308ff0d77d6)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:33.025801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a083e28-9a23-43da-91a9-d9ca298392d6 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:33.027986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 179/349] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:32 2022] GET /identity/v3/groups/801d032c2d134926afc53308ff0d77d6 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:33.033858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083e28-9a23-43da-91a9-d9ca298392d6 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:33.065554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 171/350] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:02:33.067519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b768c71-bf17-4197-b2b5-658244119225 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:33.145545 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083e28-9a23-43da-91a9-d9ca298392d6 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:33.156020 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:33.171668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:33.187592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dbdfd-7c7a-45b3-882d-5b8533c8d98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:33.188907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dbdfd-7c7a-45b3-882d-5b8533c8d98b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:33.189399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dbdfd-7c7a-45b3-882d-5b8533c8d98b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:33.189932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dbdfd-7c7a-45b3-882d-5b8533c8d98b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:33.190850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928dbdfd-7c7a-45b3-882d-5b8533c8d98b None admin] RBAC: Adding query filter params (group.id=801d032c2d134926afc53308ff0d77d6, role.id=2dfbdb214b97432588648dba947cb07a, scope.project.id=39be93f42044484fa6db903b2c759bba) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:33.191346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928dbdfd-7c7a-45b3-882d-5b8533c8d98b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:33.193174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928dbdfd-7c7a-45b3-882d-5b8533c8d98b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:33.200256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 180/351] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 31 00:02:33 2022] GET /identity/v3/role_assignments?group.id=801d032c2d134926afc53308ff0d77d6&scope.project.id=39be93f42044484fa6db903b2c759bba&role.id=2dfbdb214b97432588648dba947cb07a => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:33.201539 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dbdfd-7c7a-45b3-882d-5b8533c8d98b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:33.219713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b768c71-bf17-4197-b2b5-658244119225 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:33.274926 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3e60d-84cb-47ec-92fe-5f743ff60942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:33.275568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e60d-84cb-47ec-92fe-5f743ff60942 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:33.276733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e60d-84cb-47ec-92fe-5f743ff60942 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:33.276733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e60d-84cb-47ec-92fe-5f743ff60942 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:33.278637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3e60d-84cb-47ec-92fe-5f743ff60942 None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:33.280135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3e60d-84cb-47ec-92fe-5f743ff60942 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:33.282266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 172/352] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:33 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:33.284909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3e60d-84cb-47ec-92fe-5f743ff60942 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:33.390536 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dbdfd-7c7a-45b3-882d-5b8533c8d98b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:33.433925 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d46e48-0db2-48f7-812c-98f206730b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:33.435012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d46e48-0db2-48f7-812c-98f206730b42 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:33.435520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d46e48-0db2-48f7-812c-98f206730b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:33.435969 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d46e48-0db2-48f7-812c-98f206730b42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:33.448195 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d46e48-0db2-48f7-812c-98f206730b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:33.453093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3e60d-84cb-47ec-92fe-5f743ff60942 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-54d46e48-0db2-48f7-812c-98f206730b42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:33.454488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:33.455371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:33.456179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:33.456179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:33.456179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:33.456179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:33.456179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:33.456179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:33.456179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:33.456179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:33.456179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:33.456179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:33.456179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:33.456179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:33.458606 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 181/353] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:33.459638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d46e48-0db2-48f7-812c-98f206730b42 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:33.498553 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019620ac-60d2-40b7-b894-9393732710c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:33.499117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019620ac-60d2-40b7-b894-9393732710c0 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:33.499391 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019620ac-60d2-40b7-b894-9393732710c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:33.499660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019620ac-60d2-40b7-b894-9393732710c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:33.501654 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:33.502618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:33.514571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019620ac-60d2-40b7-b894-9393732710c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-019620ac-60d2-40b7-b894-9393732710c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:33.520513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:33.521450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:33.522237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:33.522237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:33.522237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:33.522237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:33.522237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:33.522237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:33.522237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:33.522237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:33.522237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:33.522237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:33.522237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:02:33.522237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:33.522237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 173/354] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:33.524611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992203d-5b4e-45db-9395-b481ba52b9cc None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:33.524611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992203d-5b4e-45db-9395-b481ba52b9cc None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:33.524611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992203d-5b4e-45db-9395-b481ba52b9cc None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:33.533678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 174/355] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:33.533678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992203d-5b4e-45db-9395-b481ba52b9cc None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:33.602660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d46e48-0db2-48f7-812c-98f206730b42 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:33.660210 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40763d7d-4d6c-4343-9ff7-af8e9b88517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:33.661262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992203d-5b4e-45db-9395-b481ba52b9cc None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:33.661589 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763d7d-4d6c-4343-9ff7-af8e9b88517b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:33.662057 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763d7d-4d6c-4343-9ff7-af8e9b88517b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:33.662516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763d7d-4d6c-4343-9ff7-af8e9b88517b None admin] PATH_INFO: `/v3/groups/801d032c2d134926afc53308ff0d77d6` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:33.663963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40763d7d-4d6c-4343-9ff7-af8e9b88517b None admin] RBAC: Authorizing `identity:get_group(group_id=801d032c2d134926afc53308ff0d77d6)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:33.665626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40763d7d-4d6c-4343-9ff7-af8e9b88517b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:33.668617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 182/356] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:33 2022] GET /identity/v3/groups/801d032c2d134926afc53308ff0d77d6 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:33.669514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40763d7d-4d6c-4343-9ff7-af8e9b88517b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:33.733284 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ba09f-4609-46ee-a8f3-6a0455368851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:33.735217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ba09f-4609-46ee-a8f3-6a0455368851 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:33.735217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ba09f-4609-46ee-a8f3-6a0455368851 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:33.735217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ba09f-4609-46ee-a8f3-6a0455368851 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:33.736074 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ba09f-4609-46ee-a8f3-6a0455368851 None admin] RBAC: Adding query filter params (name=member) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:33.736442 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ba09f-4609-46ee-a8f3-6a0455368851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:33.737928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ba09f-4609-46ee-a8f3-6a0455368851 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:33.749879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 175/357] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:33.750872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ece6b-6ce0-49bc-9a65-ae61db7b1248 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:33.751212 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ece6b-6ce0-49bc-9a65-ae61db7b1248 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:33.751701 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ece6b-6ce0-49bc-9a65-ae61db7b1248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:33.776168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-a76ece6b-6ce0-49bc-9a65-ae61db7b1248 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:33.777599 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a76ece6b-6ce0-49bc-9a65-ae61db7b1248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:33.812702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:33.815729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40763d7d-4d6c-4343-9ff7-af8e9b88517b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:33.846139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:33.862814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f02bf-ef67-4336-8217-bb3b3427b80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:33.863580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f02bf-ef67-4336-8217-bb3b3427b80a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:33.863947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f02bf-ef67-4336-8217-bb3b3427b80a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:33.864324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f02bf-ef67-4336-8217-bb3b3427b80a None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:33.864995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f02bf-ef67-4336-8217-bb3b3427b80a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:33.865335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f02bf-ef67-4336-8217-bb3b3427b80a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:33.866725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f02bf-ef67-4336-8217-bb3b3427b80a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:33.866846 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 176/358] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:33.867654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ece6b-6ce0-49bc-9a65-ae61db7b1248 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:33.878219 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 183/359] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:33.879623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f02bf-ef67-4336-8217-bb3b3427b80a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:33.992091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ece6b-6ce0-49bc-9a65-ae61db7b1248 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:34.007830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f02bf-ef67-4336-8217-bb3b3427b80a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:34.040816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0735459-b541-4738-b548-a28202fb8fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:34.041763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0735459-b541-4738-b548-a28202fb8fbf None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:34.042038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0735459-b541-4738-b548-a28202fb8fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:34.042407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0735459-b541-4738-b548-a28202fb8fbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:34.043078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0735459-b541-4738-b548-a28202fb8fbf None admin] RBAC: Adding query filter params (group.id=801d032c2d134926afc53308ff0d77d6, role.id=b3796e568aa342a1b3318b04d23a9cc0, scope.project.id=39be93f42044484fa6db903b2c759bba) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:34.043384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0735459-b541-4738-b548-a28202fb8fbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:34.044816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0735459-b541-4738-b548-a28202fb8fbf None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:34.045313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d86d7-6bbd-4638-9f43-7ea516517a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:34.045928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d86d7-6bbd-4638-9f43-7ea516517a36 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:34.046203 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d86d7-6bbd-4638-9f43-7ea516517a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:34.046471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d86d7-6bbd-4638-9f43-7ea516517a36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:34.051912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 177/360] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 31 00:02:33 2022] GET /identity/v3/role_assignments?group.id=801d032c2d134926afc53308ff0d77d6&scope.project.id=39be93f42044484fa6db903b2c759bba&role.id=b3796e568aa342a1b3318b04d23a9cc0 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:34.053164 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be5cfb-ac37-4254-a083-f45556f09555 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:34.057686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be5cfb-ac37-4254-a083-f45556f09555 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:34.057960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be5cfb-ac37-4254-a083-f45556f09555 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:34.059655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 178/361] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:34.060410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be5cfb-ac37-4254-a083-f45556f09555 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:34.109628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:34.141554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d86d7-6bbd-4638-9f43-7ea516517a36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:34.143102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d86d7-6bbd-4638-9f43-7ea516517a36 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:34.165689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:34.234947 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be5cfb-ac37-4254-a083-f45556f09555 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:34.267000 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 184/362] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:34.268488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7bb27-5261-4924-88e1-f947681a8367 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:34.268769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7bb27-5261-4924-88e1-f947681a8367 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:34.269038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7bb27-5261-4924-88e1-f947681a8367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:34.283793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570009ac-8a21-4f58-acc6-a7fa4aaa66f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:34.284477 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570009ac-8a21-4f58-acc6-a7fa4aaa66f0 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:34.284732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570009ac-8a21-4f58-acc6-a7fa4aaa66f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:34.285003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570009ac-8a21-4f58-acc6-a7fa4aaa66f0 None admin] PATH_INFO: `/v3/users/bb5848772db34c62948982a886a0bc3f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:34.286275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570009ac-8a21-4f58-acc6-a7fa4aaa66f0 None admin] RBAC: Authorizing `identity:get_user(user_id=bb5848772db34c62948982a886a0bc3f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:34.287727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570009ac-8a21-4f58-acc6-a7fa4aaa66f0 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:34.290934 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-91b7bb27-5261-4924-88e1-f947681a8367 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:34.291420 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 179/363] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:02:34 2022] GET /identity/v3/users/bb5848772db34c62948982a886a0bc3f => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:34.292137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-91b7bb27-5261-4924-88e1-f947681a8367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:34.292344 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570009ac-8a21-4f58-acc6-a7fa4aaa66f0 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:34.368224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:34.383838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 185/364] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:34.385366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7bb27-5261-4924-88e1-f947681a8367 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:34.418697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570009ac-8a21-4f58-acc6-a7fa4aaa66f0 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:34.442192 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:34.458995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1880f03-2c86-4d0f-b28b-d1156bdf97c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:34.459995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1880f03-2c86-4d0f-b28b-d1156bdf97c0 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:34.460487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1880f03-2c86-4d0f-b28b-d1156bdf97c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:34.461148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1880f03-2c86-4d0f-b28b-d1156bdf97c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:34.473513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1880f03-2c86-4d0f-b28b-d1156bdf97c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-e1880f03-2c86-4d0f-b28b-d1156bdf97c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:34.479959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:34.480889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:34.481738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:34.481738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:34.481738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:34.481738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:34.481738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:34.481738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:34.481738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:34.481738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:34.481738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:34.481738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:34.481738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:34.481738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:34.484057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 180/365] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:02:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:34.485140 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1880f03-2c86-4d0f-b28b-d1156bdf97c0 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:34.501001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7bb27-5261-4924-88e1-f947681a8367 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:34.539436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e250c75-2821-4e6a-aa78-41ee166d50c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:34.539840 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e250c75-2821-4e6a-aa78-41ee166d50c1 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:34.540118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e250c75-2821-4e6a-aa78-41ee166d50c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:34.540381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e250c75-2821-4e6a-aa78-41ee166d50c1 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:34.541613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e250c75-2821-4e6a-aa78-41ee166d50c1 None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:34.543154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e250c75-2821-4e6a-aa78-41ee166d50c1 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:34.545121 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 186/366] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:34 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:34.546016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e250c75-2821-4e6a-aa78-41ee166d50c1 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:34.608828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:34.629731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1880f03-2c86-4d0f-b28b-d1156bdf97c0 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:34.677626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e250c75-2821-4e6a-aa78-41ee166d50c1 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:34.699790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869ee5f-d0ea-4305-83ec-3044dd4f9bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:34.700393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869ee5f-d0ea-4305-83ec-3044dd4f9bac None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:34.700664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869ee5f-d0ea-4305-83ec-3044dd4f9bac None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:34.700929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869ee5f-d0ea-4305-83ec-3044dd4f9bac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:34.701680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869ee5f-d0ea-4305-83ec-3044dd4f9bac None admin] RBAC: Adding query filter params (role.id=86d6f10ad167487ab620bf591795470c, user.id=bb5848772db34c62948982a886a0bc3f, scope.system=all) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:34.701983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869ee5f-d0ea-4305-83ec-3044dd4f9bac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:34.703416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869ee5f-d0ea-4305-83ec-3044dd4f9bac None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:34.722902 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 181/367] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Aug 31 00:02:34 2022] GET /identity/v3/role_assignments?user.id=bb5848772db34c62948982a886a0bc3f&scope.system=all&role.id=86d6f10ad167487ab620bf591795470c => generated 510 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:34.723746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869ee5f-d0ea-4305-83ec-3044dd4f9bac None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:34.754373 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902ac16-d56f-4941-b15c-f9285e61ea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:34.755949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902ac16-d56f-4941-b15c-f9285e61ea5e None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:34.756428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902ac16-d56f-4941-b15c-f9285e61ea5e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:34.756927 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902ac16-d56f-4941-b15c-f9285e61ea5e None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:34.757941 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902ac16-d56f-4941-b15c-f9285e61ea5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:34.758503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902ac16-d56f-4941-b15c-f9285e61ea5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:34.763924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902ac16-d56f-4941-b15c-f9285e61ea5e None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:34.782027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 187/368] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:34.782997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902ac16-d56f-4941-b15c-f9285e61ea5e None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:34.842695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:34.944163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869ee5f-d0ea-4305-83ec-3044dd4f9bac None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:34.947561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902ac16-d56f-4941-b15c-f9285e61ea5e None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:34.987351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fcbd8-e884-4478-b0f6-9e735e94d8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:34.988077 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fcbd8-e884-4478-b0f6-9e735e94d8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:34.988351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fcbd8-e884-4478-b0f6-9e735e94d8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:34.988622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fcbd8-e884-4478-b0f6-9e735e94d8f1 None admin] PATH_INFO: `/v3/groups/801d032c2d134926afc53308ff0d77d6` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:34.989843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fcbd8-e884-4478-b0f6-9e735e94d8f1 None admin] RBAC: Authorizing `identity:get_group(group_id=801d032c2d134926afc53308ff0d77d6)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:34.991308 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fcbd8-e884-4478-b0f6-9e735e94d8f1 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:34.994341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 182/369] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:34 2022] GET /identity/v3/groups/801d032c2d134926afc53308ff0d77d6 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:34.995092 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fcbd8-e884-4478-b0f6-9e735e94d8f1 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:35.005150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:35.020863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028670a5-9ee7-4384-a009-5f56d0d5c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:35.021627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028670a5-9ee7-4384-a009-5f56d0d5c2ce None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:35.021896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028670a5-9ee7-4384-a009-5f56d0d5c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:35.022158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028670a5-9ee7-4384-a009-5f56d0d5c2ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:35.035117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028670a5-9ee7-4384-a009-5f56d0d5c2ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-028670a5-9ee7-4384-a009-5f56d0d5c2ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:35.040816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:35.041774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:35.042979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:35.042979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:35.042979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:35.042979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:35.042979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:35.042979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:35.042979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:35.042979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:35.042979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:35.042979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:35.042979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:35.042979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:35.042979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 188/370] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:02:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:35.043656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028670a5-9ee7-4384-a009-5f56d0d5c2ce None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:35.112271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fcbd8-e884-4478-b0f6-9e735e94d8f1 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:35.120859 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:35.155305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0747809-0763-44ca-85ce-308169e1d772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:35.156350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0747809-0763-44ca-85ce-308169e1d772 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:35.156688 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0747809-0763-44ca-85ce-308169e1d772 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:35.157066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0747809-0763-44ca-85ce-308169e1d772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:35.210360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028670a5-9ee7-4384-a009-5f56d0d5c2ce None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:35.234026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0747809-0763-44ca-85ce-308169e1d772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:35.235544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0747809-0763-44ca-85ce-308169e1d772 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:35.251390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6470ad-1e1a-4f92-ba30-5614b62faa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:35.252004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6470ad-1e1a-4f92-ba30-5614b62faa5e None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:35.252271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6470ad-1e1a-4f92-ba30-5614b62faa5e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:35.252531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6470ad-1e1a-4f92-ba30-5614b62faa5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:35.253270 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6470ad-1e1a-4f92-ba30-5614b62faa5e None admin] RBAC: Adding query filter params (group.id=801d032c2d134926afc53308ff0d77d6, role.id=2dfbdb214b97432588648dba947cb07a, scope.project.id=caeb95674dad43889d74cefec13b3ed8) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:35.253571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6470ad-1e1a-4f92-ba30-5614b62faa5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:35.254988 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6470ad-1e1a-4f92-ba30-5614b62faa5e None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:35.263760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 189/371] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 31 00:02:35 2022] GET /identity/v3/role_assignments?group.id=801d032c2d134926afc53308ff0d77d6&scope.project.id=caeb95674dad43889d74cefec13b3ed8&role.id=2dfbdb214b97432588648dba947cb07a => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:35.264688 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6470ad-1e1a-4f92-ba30-5614b62faa5e None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:35.354769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 183/372] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:35.362545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0747809-0763-44ca-85ce-308169e1d772 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:35.372098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:35.379871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:35.482383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6470ad-1e1a-4f92-ba30-5614b62faa5e None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:35.485122 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0747809-0763-44ca-85ce-308169e1d772 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:35.520341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee51db-ae76-44ec-b889-e879dc3b3c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:35.520972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee51db-ae76-44ec-b889-e879dc3b3c47 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:35.521301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee51db-ae76-44ec-b889-e879dc3b3c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:35.521578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee51db-ae76-44ec-b889-e879dc3b3c47 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:35.522103 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5fd61-a634-4ffe-b8cf-4aa3b9d3e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:35.522233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee51db-ae76-44ec-b889-e879dc3b3c47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:35.522533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee51db-ae76-44ec-b889-e879dc3b3c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:35.522994 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5fd61-a634-4ffe-b8cf-4aa3b9d3e6df None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:35.523497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5fd61-a634-4ffe-b8cf-4aa3b9d3e6df None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:35.523964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee51db-ae76-44ec-b889-e879dc3b3c47 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:35.524083 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5fd61-a634-4ffe-b8cf-4aa3b9d3e6df None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:35.525419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5fd61-a634-4ffe-b8cf-4aa3b9d3e6df None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:35.526926 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5fd61-a634-4ffe-b8cf-4aa3b9d3e6df None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:35.528957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 184/373] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:35 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:35.533751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 190/374] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:35.534883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5fd61-a634-4ffe-b8cf-4aa3b9d3e6df None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:35.539612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee51db-ae76-44ec-b889-e879dc3b3c47 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:35.629669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:35.658920 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5fd61-a634-4ffe-b8cf-4aa3b9d3e6df None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:35.687685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee51db-ae76-44ec-b889-e879dc3b3c47 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:35.697446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:35.712572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606fde2-8935-4145-9021-566b522af5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:35.713427 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606fde2-8935-4145-9021-566b522af5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:35.713807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606fde2-8935-4145-9021-566b522af5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:35.714211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606fde2-8935-4145-9021-566b522af5b4 None admin] PATH_INFO: `/v3/groups/801d032c2d134926afc53308ff0d77d6` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:35.715587 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606fde2-8935-4145-9021-566b522af5b4 None admin] RBAC: Authorizing `identity:get_group(group_id=801d032c2d134926afc53308ff0d77d6)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:35.717412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606fde2-8935-4145-9021-566b522af5b4 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:35.719502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 185/375] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:35 2022] GET /identity/v3/groups/801d032c2d134926afc53308ff0d77d6 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:35.720887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a19e63-7c9f-4450-94ea-1c81ac26c16e None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:35.721333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a19e63-7c9f-4450-94ea-1c81ac26c16e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:35.721701 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a19e63-7c9f-4450-94ea-1c81ac26c16e None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:35.727780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 186/376] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:35.729781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990566dc-1981-4eda-953f-f55001fc6830 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:35.730066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990566dc-1981-4eda-953f-f55001fc6830 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:35.730339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990566dc-1981-4eda-953f-f55001fc6830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:35.746669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91b7be-f2a1-4967-b4f6-546991a118c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:35.747699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b7be-f2a1-4967-b4f6-546991a118c5 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:35.748174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b7be-f2a1-4967-b4f6-546991a118c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:35.748658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b7be-f2a1-4967-b4f6-546991a118c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:35.753045 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-990566dc-1981-4eda-953f-f55001fc6830 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:35.754564 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-990566dc-1981-4eda-953f-f55001fc6830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:35.844040 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91b7be-f2a1-4967-b4f6-546991a118c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:35.846800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91b7be-f2a1-4967-b4f6-546991a118c5 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:35.857743 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 187/377] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:35.858979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990566dc-1981-4eda-953f-f55001fc6830 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:35.996116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 191/378] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:36.015710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91b7be-f2a1-4967-b4f6-546991a118c5 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:36.030193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:36.034618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:36.073339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990566dc-1981-4eda-953f-f55001fc6830 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:36.124008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c66b-a1b9-4abe-9283-2d1f552ef90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:36.125469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c66b-a1b9-4abe-9283-2d1f552ef90c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:36.125919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c66b-a1b9-4abe-9283-2d1f552ef90c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:36.126353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c66b-a1b9-4abe-9283-2d1f552ef90c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:36.127245 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499c66b-a1b9-4abe-9283-2d1f552ef90c None admin] RBAC: Adding query filter params (group.id=801d032c2d134926afc53308ff0d77d6, role.id=b3796e568aa342a1b3318b04d23a9cc0, scope.project.id=caeb95674dad43889d74cefec13b3ed8) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:36.127978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499c66b-a1b9-4abe-9283-2d1f552ef90c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:36.131246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499c66b-a1b9-4abe-9283-2d1f552ef90c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:36.138872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 188/379] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 31 00:02:35 2022] GET /identity/v3/role_assignments?group.id=801d032c2d134926afc53308ff0d77d6&scope.project.id=caeb95674dad43889d74cefec13b3ed8&role.id=b3796e568aa342a1b3318b04d23a9cc0 => generated 260 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:36.183672 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91b7be-f2a1-4967-b4f6-546991a118c5 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:36.220236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c66b-a1b9-4abe-9283-2d1f552ef90c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:36.242261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbdcef-b4f6-4ada-a97d-c1827940ce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:36.244794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbdcef-b4f6-4ada-a97d-c1827940ce32 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:36.245548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbdcef-b4f6-4ada-a97d-c1827940ce32 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:36.246876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbdcef-b4f6-4ada-a97d-c1827940ce32 None admin] PATH_INFO: `/v3/projects/59c418df945e4be9ac1404a45cc7dcfd` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:36.248611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbdcef-b4f6-4ada-a97d-c1827940ce32 None admin] RBAC: Authorizing `identity:get_project(project_id=59c418df945e4be9ac1404a45cc7dcfd)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:36.253600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbdcef-b4f6-4ada-a97d-c1827940ce32 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:36.256035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 192/380] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:36 2022] GET /identity/v3/projects/59c418df945e4be9ac1404a45cc7dcfd => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:36.262550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbdcef-b4f6-4ada-a97d-c1827940ce32 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:36.388699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c66b-a1b9-4abe-9283-2d1f552ef90c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:36.411385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:36.432689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189da0ee-2259-4e32-bd18-791c4a0c7868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:36.432689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189da0ee-2259-4e32-bd18-791c4a0c7868 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:36.432689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189da0ee-2259-4e32-bd18-791c4a0c7868 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:36.432689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189da0ee-2259-4e32-bd18-791c4a0c7868 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189da0ee-2259-4e32-bd18-791c4a0c7868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-189da0ee-2259-4e32-bd18-791c4a0c7868 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:36.448928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:36.449832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 189/381] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:02:36.450675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:36.453812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbdcef-b4f6-4ada-a97d-c1827940ce32 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:36.459071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189da0ee-2259-4e32-bd18-791c4a0c7868 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:36.552293 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7c78a-2db5-400c-b4f7-cbccc32422f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:36.553089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7c78a-2db5-400c-b4f7-cbccc32422f1 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:36.553398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7c78a-2db5-400c-b4f7-cbccc32422f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:36.553670 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7c78a-2db5-400c-b4f7-cbccc32422f1 None admin] PATH_INFO: `/v3/groups/3003ad448a084bbcb8d9e5bb6f8ad252` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:36.564333 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7c78a-2db5-400c-b4f7-cbccc32422f1 None admin] RBAC: Authorizing `identity:get_group(group_id=3003ad448a084bbcb8d9e5bb6f8ad252)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:36.565902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7c78a-2db5-400c-b4f7-cbccc32422f1 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:36.571256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 193/382] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:36 2022] GET /identity/v3/groups/3003ad448a084bbcb8d9e5bb6f8ad252 => generated 229 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:36.576545 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7c78a-2db5-400c-b4f7-cbccc32422f1 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:36.635924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189da0ee-2259-4e32-bd18-791c4a0c7868 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:36.681490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab1df7-a6ae-4eaf-8e45-d4a39de571af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:36.682115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab1df7-a6ae-4eaf-8e45-d4a39de571af None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:36.682392 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab1df7-a6ae-4eaf-8e45-d4a39de571af None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:36.682663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab1df7-a6ae-4eaf-8e45-d4a39de571af None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:36.683336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab1df7-a6ae-4eaf-8e45-d4a39de571af None admin] RBAC: Adding query filter params (name=member) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:36.683638 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab1df7-a6ae-4eaf-8e45-d4a39de571af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:36.685031 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab1df7-a6ae-4eaf-8e45-d4a39de571af None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:36.707260 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 190/383] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:36.719338 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab1df7-a6ae-4eaf-8e45-d4a39de571af None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:36.748847 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7c78a-2db5-400c-b4f7-cbccc32422f1 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:36.792834 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b39dc-b656-473d-865a-1f53afeaf402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:36.793098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:36.793984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b39dc-b656-473d-865a-1f53afeaf402 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:36.794273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b39dc-b656-473d-865a-1f53afeaf402 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:36.794616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b39dc-b656-473d-865a-1f53afeaf402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:36.795407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b39dc-b656-473d-865a-1f53afeaf402 None admin] RBAC: Adding query filter params (group.id=3003ad448a084bbcb8d9e5bb6f8ad252, role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=59c418df945e4be9ac1404a45cc7dcfd) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:36.795706 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b39dc-b656-473d-865a-1f53afeaf402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:36.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b39dc-b656-473d-865a-1f53afeaf402 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:36.812861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 194/384] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 31 00:02:36 2022] GET /identity/v3/role_assignments?group.id=3003ad448a084bbcb8d9e5bb6f8ad252&scope.project.id=59c418df945e4be9ac1404a45cc7dcfd&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:36.814598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b3a49-2323-4276-ba14-f3ca116c97a4 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:36.814876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b3a49-2323-4276-ba14-f3ca116c97a4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:36.815181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b3a49-2323-4276-ba14-f3ca116c97a4 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:36.816773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 195/385] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:36.822909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c059fa-eedb-43c2-a613-9f3b47ddf6a8 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:36.823216 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c059fa-eedb-43c2-a613-9f3b47ddf6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:36.823438 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c059fa-eedb-43c2-a613-9f3b47ddf6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:36.840262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:36.846982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab1df7-a6ae-4eaf-8e45-d4a39de571af None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:36.856944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d5c059fa-eedb-43c2-a613-9f3b47ddf6a8 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:36.858244 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d5c059fa-eedb-43c2-a613-9f3b47ddf6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:36.889390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88281bc7-56e7-4f7b-bdfe-cb867e463c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:36.890048 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88281bc7-56e7-4f7b-bdfe-cb867e463c00 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:36.890321 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88281bc7-56e7-4f7b-bdfe-cb867e463c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:36.890592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88281bc7-56e7-4f7b-bdfe-cb867e463c00 None admin] PATH_INFO: `/v3/groups/801d032c2d134926afc53308ff0d77d6` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:36.892682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88281bc7-56e7-4f7b-bdfe-cb867e463c00 None admin] RBAC: Authorizing `identity:get_group(group_id=801d032c2d134926afc53308ff0d77d6)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:36.894150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88281bc7-56e7-4f7b-bdfe-cb867e463c00 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:36.895798 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 191/386] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:36 2022] GET /identity/v3/groups/801d032c2d134926afc53308ff0d77d6 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:36.904114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88281bc7-56e7-4f7b-bdfe-cb867e463c00 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:37.009700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 196/387] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:37.052845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88281bc7-56e7-4f7b-bdfe-cb867e463c00 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:37.080465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:37.092885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5186c-13ce-4167-9aea-377ed28bdeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:37.093645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5186c-13ce-4167-9aea-377ed28bdeeb None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:37.093987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5186c-13ce-4167-9aea-377ed28bdeeb None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:37.094323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5186c-13ce-4167-9aea-377ed28bdeeb None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:37.095544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5186c-13ce-4167-9aea-377ed28bdeeb None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:37.097044 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5186c-13ce-4167-9aea-377ed28bdeeb None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:37.099096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 192/388] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:36 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:37.105885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c059fa-eedb-43c2-a613-9f3b47ddf6a8 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:37.241466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c059fa-eedb-43c2-a613-9f3b47ddf6a8 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:37.277503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2214102-8411-43a4-8d22-33da7aede049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:37.278169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2214102-8411-43a4-8d22-33da7aede049 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:37.278437 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2214102-8411-43a4-8d22-33da7aede049 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:37.278700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2214102-8411-43a4-8d22-33da7aede049 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba/groups/801d032c2d134926afc53308ff0d77d6/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:37.280928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2214102-8411-43a4-8d22-33da7aede049 None admin] RBAC: Authorizing `identity:create_grant(project_id=39be93f42044484fa6db903b2c759bba, group_id=801d032c2d134926afc53308ff0d77d6, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:37.282403 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2214102-8411-43a4-8d22-33da7aede049 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:37.284681 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:37.305533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 197/389] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 31 00:02:37 2022] PUT /identity/v3/projects/39be93f42044484fa6db903b2c759bba/groups/801d032c2d134926afc53308ff0d77d6/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:37.330259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5186c-13ce-4167-9aea-377ed28bdeeb None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:37.458910 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5186c-13ce-4167-9aea-377ed28bdeeb None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:37.503874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c72d99-cd79-4da0-b6fa-c163c24a57cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:37.504530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c72d99-cd79-4da0-b6fa-c163c24a57cf None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:37.504804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c72d99-cd79-4da0-b6fa-c163c24a57cf None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:37.505072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c72d99-cd79-4da0-b6fa-c163c24a57cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:37.523572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c72d99-cd79-4da0-b6fa-c163c24a57cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-60c72d99-cd79-4da0-b6fa-c163c24a57cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:37.528559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:37.529562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:37.530349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:37.530349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:37.530349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:37.530349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:37.530349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:37.530349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:37.530349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:37.530349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:37.530349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:37.530349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:37.530349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:37.530349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:37.530349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 193/390] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:02:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:37.540353 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2214102-8411-43a4-8d22-33da7aede049 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:37.668700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2214102-8411-43a4-8d22-33da7aede049 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:37.712476 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31323b25-c870-47b9-b9c0-f704727eeab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:37.713073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31323b25-c870-47b9-b9c0-f704727eeab2 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:37.713395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31323b25-c870-47b9-b9c0-f704727eeab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:37.713660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31323b25-c870-47b9-b9c0-f704727eeab2 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:37.714327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31323b25-c870-47b9-b9c0-f704727eeab2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:37.714617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31323b25-c870-47b9-b9c0-f704727eeab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:37.715970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31323b25-c870-47b9-b9c0-f704727eeab2 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:37.724963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 198/391] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:37.730755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c72d99-cd79-4da0-b6fa-c163c24a57cf None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:37.812715 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:37.860471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c72d99-cd79-4da0-b6fa-c163c24a57cf None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:37.904714 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3831ce4-5be4-4971-ba6e-aee2cdb2721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:37.905386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3831ce4-5be4-4971-ba6e-aee2cdb2721c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:37.905978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3831ce4-5be4-4971-ba6e-aee2cdb2721c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:37.906245 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3831ce4-5be4-4971-ba6e-aee2cdb2721c None admin] PATH_INFO: `/v3/groups/801d032c2d134926afc53308ff0d77d6` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:37.907374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3831ce4-5be4-4971-ba6e-aee2cdb2721c None admin] RBAC: Authorizing `identity:get_group(group_id=801d032c2d134926afc53308ff0d77d6)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:37.908869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3831ce4-5be4-4971-ba6e-aee2cdb2721c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:37.910803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 194/392] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:37 2022] GET /identity/v3/groups/801d032c2d134926afc53308ff0d77d6 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:37.917933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31323b25-c870-47b9-b9c0-f704727eeab2 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:37.927253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7faa89-2d42-4816-86d4-0483df0a17ec None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:37.927546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7faa89-2d42-4816-86d4-0483df0a17ec None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:37.927795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7faa89-2d42-4816-86d4-0483df0a17ec None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:37.929809 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 195/393] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:37.935426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f0d3d-8bcf-4232-8889-93d19f4690ff None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:37.935704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f0d3d-8bcf-4232-8889-93d19f4690ff None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:37.936085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f0d3d-8bcf-4232-8889-93d19f4690ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:37.970463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e76f0d3d-8bcf-4232-8889-93d19f4690ff None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:37.972071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e76f0d3d-8bcf-4232-8889-93d19f4690ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:38.022392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:38.072939 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31323b25-c870-47b9-b9c0-f704727eeab2 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:38.111710 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 196/394] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:38.134051 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b79bf9-b712-48dd-b072-78b17f8372f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:38.134703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b79bf9-b712-48dd-b072-78b17f8372f1 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:38.134980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b79bf9-b712-48dd-b072-78b17f8372f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:38.135249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b79bf9-b712-48dd-b072-78b17f8372f1 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:38.136473 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b79bf9-b712-48dd-b072-78b17f8372f1 None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:38.137956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b79bf9-b712-48dd-b072-78b17f8372f1 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:38.139929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 199/395] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:37 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:38.145611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f0d3d-8bcf-4232-8889-93d19f4690ff None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:38.238263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:38.292547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f0d3d-8bcf-4232-8889-93d19f4690ff None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:38.330351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac3982-36f3-4a06-826c-a94da80e2a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:38.331020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac3982-36f3-4a06-826c-a94da80e2a3f None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:38.331291 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac3982-36f3-4a06-826c-a94da80e2a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:38.331559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac3982-36f3-4a06-826c-a94da80e2a3f None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba/groups/801d032c2d134926afc53308ff0d77d6/roles/b3796e568aa342a1b3318b04d23a9cc0` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:38.333720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac3982-36f3-4a06-826c-a94da80e2a3f None admin] RBAC: Authorizing `identity:create_grant(project_id=39be93f42044484fa6db903b2c759bba, group_id=801d032c2d134926afc53308ff0d77d6, role_id=b3796e568aa342a1b3318b04d23a9cc0)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:38.335155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac3982-36f3-4a06-826c-a94da80e2a3f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:38.354660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 197/396] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 31 00:02:38 2022] PUT /identity/v3/projects/39be93f42044484fa6db903b2c759bba/groups/801d032c2d134926afc53308ff0d77d6/roles/b3796e568aa342a1b3318b04d23a9cc0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:38.541821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b79bf9-b712-48dd-b072-78b17f8372f1 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:38.659625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b79bf9-b712-48dd-b072-78b17f8372f1 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:38.692628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:38.705784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602ea84-8b41-4ca2-9a3b-90d5b481b619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:38.706418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602ea84-8b41-4ca2-9a3b-90d5b481b619 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:38.706691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602ea84-8b41-4ca2-9a3b-90d5b481b619 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:38.706961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602ea84-8b41-4ca2-9a3b-90d5b481b619 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:38.712423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fd1c6-b747-44cb-bb45-3fb4469e37ad None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:38.712891 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fd1c6-b747-44cb-bb45-3fb4469e37ad None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:38.712965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fd1c6-b747-44cb-bb45-3fb4469e37ad None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:38.714416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 198/397] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:02:38.719722 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523390ef-5ba3-417f-bbdb-93bbf301a734 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:38.720006 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523390ef-5ba3-417f-bbdb-93bbf301a734 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:38.720276 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523390ef-5ba3-417f-bbdb-93bbf301a734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:38.725968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602ea84-8b41-4ca2-9a3b-90d5b481b619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-1602ea84-8b41-4ca2-9a3b-90d5b481b619 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:38.732855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:38.733986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:38.734986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:38.734986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:38.734986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:38.734986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:38.734986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:38.734986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:38.734986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:38.734986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:38.734986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:38.734986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:38.734986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:38.734986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:38.741540 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 200/398] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:38.744200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602ea84-8b41-4ca2-9a3b-90d5b481b619 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:38.766265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-523390ef-5ba3-417f-bbdb-93bbf301a734 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:38.769253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-523390ef-5ba3-417f-bbdb-93bbf301a734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:38.869410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602ea84-8b41-4ca2-9a3b-90d5b481b619 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:38.914786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914ca5b-f530-4b03-ae23-060f9ae0b77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:38.915401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914ca5b-f530-4b03-ae23-060f9ae0b77c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:38.915674 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914ca5b-f530-4b03-ae23-060f9ae0b77c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:38.915939 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914ca5b-f530-4b03-ae23-060f9ae0b77c None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:38.916609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914ca5b-f530-4b03-ae23-060f9ae0b77c None admin] RBAC: Adding query filter params (name=member) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:38.916902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914ca5b-f530-4b03-ae23-060f9ae0b77c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:38.918336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914ca5b-f530-4b03-ae23-060f9ae0b77c None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:38.936529 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 201/399] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:38.940648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914ca5b-f530-4b03-ae23-060f9ae0b77c None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:38.958842 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 199/400] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:39.003585 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:39.059278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914ca5b-f530-4b03-ae23-060f9ae0b77c None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:39.110831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f558fa-5546-402a-85f4-7d61d20f1f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:39.111474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f558fa-5546-402a-85f4-7d61d20f1f07 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:39.111746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f558fa-5546-402a-85f4-7d61d20f1f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:39.112009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f558fa-5546-402a-85f4-7d61d20f1f07 None admin] PATH_INFO: `/v3/groups/801d032c2d134926afc53308ff0d77d6` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:39.113162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f558fa-5546-402a-85f4-7d61d20f1f07 None admin] RBAC: Authorizing `identity:get_group(group_id=801d032c2d134926afc53308ff0d77d6)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:39.114621 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f558fa-5546-402a-85f4-7d61d20f1f07 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:39.116429 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 202/401] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:38 2022] GET /identity/v3/groups/801d032c2d134926afc53308ff0d77d6 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:39.122857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523390ef-5ba3-417f-bbdb-93bbf301a734 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:39.194847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:39.262751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523390ef-5ba3-417f-bbdb-93bbf301a734 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:39.303779 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01126a-e721-4c6e-8e4d-960497fcb243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:39.304645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01126a-e721-4c6e-8e4d-960497fcb243 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:39.305005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01126a-e721-4c6e-8e4d-960497fcb243 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:39.305370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01126a-e721-4c6e-8e4d-960497fcb243 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:39.306459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01126a-e721-4c6e-8e4d-960497fcb243 None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:39.307893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01126a-e721-4c6e-8e4d-960497fcb243 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:39.309562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 200/402] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:39 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:39.318291 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f558fa-5546-402a-85f4-7d61d20f1f07 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:39.364492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d3fc8-a569-4cab-aa55-47ce72deff8c None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:39.364817 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d3fc8-a569-4cab-aa55-47ce72deff8c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:39.365068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d3fc8-a569-4cab-aa55-47ce72deff8c None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:39.366966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 201/403] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:02:39.372923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bacd36-4d97-4299-8719-9b662488eadf None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:39.373990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bacd36-4d97-4299-8719-9b662488eadf None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:39.374261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bacd36-4d97-4299-8719-9b662488eadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:39.394544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d2bacd36-4d97-4299-8719-9b662488eadf None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:39.395919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d2bacd36-4d97-4299-8719-9b662488eadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:39.478085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f558fa-5546-402a-85f4-7d61d20f1f07 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:39.487262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 202/404] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:39.488492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bacd36-4d97-4299-8719-9b662488eadf None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:39.497574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:39.537301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8deda-6a4b-4c6c-b3af-a1ad4d40c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:39.538248 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8deda-6a4b-4c6c-b3af-a1ad4d40c4e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:39.539475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8deda-6a4b-4c6c-b3af-a1ad4d40c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:39.539977 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8deda-6a4b-4c6c-b3af-a1ad4d40c4e8 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8/groups/801d032c2d134926afc53308ff0d77d6/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:39.544046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8deda-6a4b-4c6c-b3af-a1ad4d40c4e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=caeb95674dad43889d74cefec13b3ed8, group_id=801d032c2d134926afc53308ff0d77d6, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:39.546184 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8deda-6a4b-4c6c-b3af-a1ad4d40c4e8 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:39.565088 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 203/405] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 31 00:02:39 2022] PUT /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8/groups/801d032c2d134926afc53308ff0d77d6/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:39.577656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:39.649968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bacd36-4d97-4299-8719-9b662488eadf None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:39.696235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd272123-a754-4276-a6cf-02b67b5e21fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:39.697125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd272123-a754-4276-a6cf-02b67b5e21fc None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:39.697566 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd272123-a754-4276-a6cf-02b67b5e21fc None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:39.698152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd272123-a754-4276-a6cf-02b67b5e21fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:39.710286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd272123-a754-4276-a6cf-02b67b5e21fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-cd272123-a754-4276-a6cf-02b67b5e21fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:39.716407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:39.717940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:39.718919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:39.718919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:39.718919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:39.718919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:39.718919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:39.718919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:39.718919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:39.718919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:39.718919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:39.718919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:39.718919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:39.718919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:39.724799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 203/406] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:02:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:39.728528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8deda-6a4b-4c6c-b3af-a1ad4d40c4e8 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:39.848493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8deda-6a4b-4c6c-b3af-a1ad4d40c4e8 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:39.851254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd272123-a754-4276-a6cf-02b67b5e21fc None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:39.892433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b58f6-5fe6-4d62-907d-db965585e5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:39.893377 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b58f6-5fe6-4d62-907d-db965585e5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:39.893791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b58f6-5fe6-4d62-907d-db965585e5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:39.894220 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b58f6-5fe6-4d62-907d-db965585e5a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:39.895024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b58f6-5fe6-4d62-907d-db965585e5a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:39.895460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b58f6-5fe6-4d62-907d-db965585e5a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:39.897030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b58f6-5fe6-4d62-907d-db965585e5a6 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:39.908992 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 204/407] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:39.915064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b58f6-5fe6-4d62-907d-db965585e5a6 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:39.956549 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:39.968569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:39.971474 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd272123-a754-4276-a6cf-02b67b5e21fc None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:40.026296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1015647-868f-4127-9934-4699fa6a677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:40.027268 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1015647-868f-4127-9934-4699fa6a677f None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:40.027765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1015647-868f-4127-9934-4699fa6a677f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:40.028957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1015647-868f-4127-9934-4699fa6a677f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:40.047195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1015647-868f-4127-9934-4699fa6a677f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:40.049200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b58f6-5fe6-4d62-907d-db965585e5a6 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-b1015647-868f-4127-9934-4699fa6a677f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:40.052597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:40.053593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:40.055050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:40.055050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:40.055050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:40.055050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:40.055050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:40.055050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:40.055050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:40.055050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:40.055050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:40.055050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:40.055050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:40.055050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:40.055050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 204/408] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:02:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:40.057153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70440ca-6196-41ea-bc1a-3c80517b9a89 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:40.057577 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70440ca-6196-41ea-bc1a-3c80517b9a89 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:40.057945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70440ca-6196-41ea-bc1a-3c80517b9a89 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:40.063701 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 205/409] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:40.064647 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70440ca-6196-41ea-bc1a-3c80517b9a89 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:40.107928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffba70-3397-48de-8c1a-f36277be7590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:40.108810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffba70-3397-48de-8c1a-f36277be7590 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:40.109427 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffba70-3397-48de-8c1a-f36277be7590 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:40.109829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffba70-3397-48de-8c1a-f36277be7590 None admin] PATH_INFO: `/v3/groups/801d032c2d134926afc53308ff0d77d6` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:40.112332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffba70-3397-48de-8c1a-f36277be7590 None admin] RBAC: Authorizing `identity:get_group(group_id=801d032c2d134926afc53308ff0d77d6)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:40.114032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffba70-3397-48de-8c1a-f36277be7590 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:40.121581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 205/410] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:39 2022] GET /identity/v3/groups/801d032c2d134926afc53308ff0d77d6 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:40.121581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e43d-04b7-4b69-8501-b17c2c74ee25 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:40.121581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e43d-04b7-4b69-8501-b17c2c74ee25 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:40.121581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e43d-04b7-4b69-8501-b17c2c74ee25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:40.143783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-1e71e43d-04b7-4b69-8501-b17c2c74ee25 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:40.144959 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1e71e43d-04b7-4b69-8501-b17c2c74ee25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:40.206425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70440ca-6196-41ea-bc1a-3c80517b9a89 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:40.226172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 206/411] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:40.234130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71e43d-04b7-4b69-8501-b17c2c74ee25 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:40.252959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a11650-0c15-446e-a21d-e08b74cf8197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:40.253954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a11650-0c15-446e-a21d-e08b74cf8197 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:40.254447 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a11650-0c15-446e-a21d-e08b74cf8197 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:40.255258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a11650-0c15-446e-a21d-e08b74cf8197 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:40.256221 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a11650-0c15-446e-a21d-e08b74cf8197 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:40.256724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a11650-0c15-446e-a21d-e08b74cf8197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:40.259992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a11650-0c15-446e-a21d-e08b74cf8197 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:40.270895 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 206/412] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:40.277362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a11650-0c15-446e-a21d-e08b74cf8197 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:40.308259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:40.316349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:40.397526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a11650-0c15-446e-a21d-e08b74cf8197 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:40.438249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacf795-006c-4d2c-bc7b-5811dc688c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:40.439082 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacf795-006c-4d2c-bc7b-5811dc688c06 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:40.439363 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacf795-006c-4d2c-bc7b-5811dc688c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:40.439983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacf795-006c-4d2c-bc7b-5811dc688c06 None admin] PATH_INFO: `/v3/groups/3003ad448a084bbcb8d9e5bb6f8ad252` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:40.441275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacf795-006c-4d2c-bc7b-5811dc688c06 None admin] RBAC: Authorizing `identity:get_group(group_id=3003ad448a084bbcb8d9e5bb6f8ad252)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:40.443076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacf795-006c-4d2c-bc7b-5811dc688c06 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:40.445935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 207/413] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:40 2022] GET /identity/v3/groups/3003ad448a084bbcb8d9e5bb6f8ad252 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:40.450961 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacf795-006c-4d2c-bc7b-5811dc688c06 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:40.485453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71e43d-04b7-4b69-8501-b17c2c74ee25 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:40.554967 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:40.565428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacf795-006c-4d2c-bc7b-5811dc688c06 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:40.574512 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee6325-7956-4b22-921e-f7411e265836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:40.576187 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee6325-7956-4b22-921e-f7411e265836 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:40.576686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee6325-7956-4b22-921e-f7411e265836 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:40.577166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee6325-7956-4b22-921e-f7411e265836 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:40.579152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee6325-7956-4b22-921e-f7411e265836 None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:40.580619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee6325-7956-4b22-921e-f7411e265836 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:40.587172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 207/414] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:40 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:40.588046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee6325-7956-4b22-921e-f7411e265836 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:40.606551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f14d1-57b0-4e3a-8896-d697aebeaff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:40.607645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f14d1-57b0-4e3a-8896-d697aebeaff3 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:40.608162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f14d1-57b0-4e3a-8896-d697aebeaff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:40.608628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f14d1-57b0-4e3a-8896-d697aebeaff3 None admin] PATH_INFO: `/v3/projects/59c418df945e4be9ac1404a45cc7dcfd` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:40.610081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f14d1-57b0-4e3a-8896-d697aebeaff3 None admin] RBAC: Authorizing `identity:get_project(project_id=59c418df945e4be9ac1404a45cc7dcfd)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:40.611858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f14d1-57b0-4e3a-8896-d697aebeaff3 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:40.614339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 208/415] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:40 2022] GET /identity/v3/projects/59c418df945e4be9ac1404a45cc7dcfd => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:40.615448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f14d1-57b0-4e3a-8896-d697aebeaff3 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:40.688708 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee6325-7956-4b22-921e-f7411e265836 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:40.690291 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:40.724786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64335d-af64-4dbc-87de-673f60b1bffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:40.725448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64335d-af64-4dbc-87de-673f60b1bffe None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:40.725716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64335d-af64-4dbc-87de-673f60b1bffe None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:40.726038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64335d-af64-4dbc-87de-673f60b1bffe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:40.731134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f14d1-57b0-4e3a-8896-d697aebeaff3 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:40.737028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64335d-af64-4dbc-87de-673f60b1bffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-5d64335d-af64-4dbc-87de-673f60b1bffe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:40.742194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:40.743240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:40.744022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:40.744022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:40.744022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:40.744022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:40.744022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:40.744022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:40.744022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:40.744022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:40.744022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:40.744022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:40.744022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:40.744022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:40.744022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 208/416] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:40.744711 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64335d-af64-4dbc-87de-673f60b1bffe None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:40.780321 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3753ad-dccb-442b-8303-db0b3e76aed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:40.781767 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3753ad-dccb-442b-8303-db0b3e76aed8 None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:40.782326 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3753ad-dccb-442b-8303-db0b3e76aed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:40.782813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3753ad-dccb-442b-8303-db0b3e76aed8 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8/groups/801d032c2d134926afc53308ff0d77d6/roles/b3796e568aa342a1b3318b04d23a9cc0` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:40.785483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3753ad-dccb-442b-8303-db0b3e76aed8 None admin] RBAC: Authorizing `identity:create_grant(project_id=caeb95674dad43889d74cefec13b3ed8, group_id=801d032c2d134926afc53308ff0d77d6, role_id=b3796e568aa342a1b3318b04d23a9cc0)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:40.787273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3753ad-dccb-442b-8303-db0b3e76aed8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:40.803003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 209/417] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 31 00:02:40 2022] PUT /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8/groups/801d032c2d134926afc53308ff0d77d6/roles/b3796e568aa342a1b3318b04d23a9cc0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:40.804234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3753ad-dccb-442b-8303-db0b3e76aed8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:40.827004 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:40.924168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3753ad-dccb-442b-8303-db0b3e76aed8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:40.927287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64335d-af64-4dbc-87de-673f60b1bffe None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:40.963887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320969c-94db-48c7-9373-b60b7b56edc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:40.964525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320969c-94db-48c7-9373-b60b7b56edc3 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:40.964805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320969c-94db-48c7-9373-b60b7b56edc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:40.965079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320969c-94db-48c7-9373-b60b7b56edc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:40.965874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320969c-94db-48c7-9373-b60b7b56edc3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:40.966214 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320969c-94db-48c7-9373-b60b7b56edc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:40.967609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320969c-94db-48c7-9373-b60b7b56edc3 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:40.980163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 210/418] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:40.986156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320969c-94db-48c7-9373-b60b7b56edc3 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:41.038469 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c70532-0ed2-490d-ac77-58aca69dfbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:41.040114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c70532-0ed2-490d-ac77-58aca69dfbe7 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:41.040455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c70532-0ed2-490d-ac77-58aca69dfbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:41.040792 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c70532-0ed2-490d-ac77-58aca69dfbe7 None admin] PATH_INFO: `/v3/projects/59c418df945e4be9ac1404a45cc7dcfd/groups/3003ad448a084bbcb8d9e5bb6f8ad252/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:41.042960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c70532-0ed2-490d-ac77-58aca69dfbe7 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c418df945e4be9ac1404a45cc7dcfd, group_id=3003ad448a084bbcb8d9e5bb6f8ad252, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:41.044477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c70532-0ed2-490d-ac77-58aca69dfbe7 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:41.060273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 209/419] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 31 00:02:40 2022] PUT /identity/v3/projects/59c418df945e4be9ac1404a45cc7dcfd/groups/3003ad448a084bbcb8d9e5bb6f8ad252/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:02:41.061869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52add54-9952-45b6-a9a7-554c14646f01 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:41.062334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52add54-9952-45b6-a9a7-554c14646f01 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:41.062780 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52add54-9952-45b6-a9a7-554c14646f01 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:41.064212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 210/420] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:41.070797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e0ba7-3a11-4339-81cb-ae6f42a7ce60 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:41.071458 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e0ba7-3a11-4339-81cb-ae6f42a7ce60 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:41.071933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e0ba7-3a11-4339-81cb-ae6f42a7ce60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:41.092230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-240e0ba7-3a11-4339-81cb-ae6f42a7ce60 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:41.093878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-240e0ba7-3a11-4339-81cb-ae6f42a7ce60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:41.099965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:41.117915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:41.131457 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320969c-94db-48c7-9373-b60b7b56edc3 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:41.183064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2a159-fb81-437c-a777-a669d58e774c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:41.185258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a159-fb81-437c-a777-a669d58e774c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:41.186581 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a159-fb81-437c-a777-a669d58e774c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:41.187107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a159-fb81-437c-a777-a669d58e774c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:41.220532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 211/421] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:41.296441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2a159-fb81-437c-a777-a669d58e774c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:41.298330 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2a159-fb81-437c-a777-a669d58e774c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:41.382271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:41.406363 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 211/422] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:02:41.417096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e0ba7-3a11-4339-81cb-ae6f42a7ce60 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:41.565600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e0ba7-3a11-4339-81cb-ae6f42a7ce60 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:41.615248 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322260e-029c-4080-90a6-c84dba51e258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:41.615878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322260e-029c-4080-90a6-c84dba51e258 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:41.616137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322260e-029c-4080-90a6-c84dba51e258 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:41.616413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322260e-029c-4080-90a6-c84dba51e258 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:41.617789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322260e-029c-4080-90a6-c84dba51e258 None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:41.619232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322260e-029c-4080-90a6-c84dba51e258 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:41.620855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 212/423] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:41 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:41.626568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2a159-fb81-437c-a777-a669d58e774c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:41.645082 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322260e-029c-4080-90a6-c84dba51e258 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:41.685423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:41.741258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2a159-fb81-437c-a777-a669d58e774c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:41.787285 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322260e-029c-4080-90a6-c84dba51e258 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:41.798136 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1adcf-fbc0-4101-96b7-72d8d48213a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:41.799107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1adcf-fbc0-4101-96b7-72d8d48213a8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:41.799600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1adcf-fbc0-4101-96b7-72d8d48213a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:41.800064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1adcf-fbc0-4101-96b7-72d8d48213a8 None admin] PATH_INFO: `/v3/groups/801d032c2d134926afc53308ff0d77d6` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:41.803883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1adcf-fbc0-4101-96b7-72d8d48213a8 None admin] RBAC: Authorizing `identity:get_group(group_id=801d032c2d134926afc53308ff0d77d6)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:41.805650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1adcf-fbc0-4101-96b7-72d8d48213a8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:41.807456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 212/424] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:41 2022] GET /identity/v3/groups/801d032c2d134926afc53308ff0d77d6 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:41.814935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1adcf-fbc0-4101-96b7-72d8d48213a8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:41.829678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f0153-5e1e-4afa-89c0-fd1c2bf86799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:41.830560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f0153-5e1e-4afa-89c0-fd1c2bf86799 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:41.830560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f0153-5e1e-4afa-89c0-fd1c2bf86799 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:41.830756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f0153-5e1e-4afa-89c0-fd1c2bf86799 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:41.842668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f0153-5e1e-4afa-89c0-fd1c2bf86799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-924f0153-5e1e-4afa-89c0-fd1c2bf86799 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:41.851067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:41.852186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:41.853257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:41.853257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:41.853257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:41.853257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:41.853257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:41.853257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:41.853257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:41.853257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:41.853257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:41.853257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:41.853257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:41.853257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:41.860085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 213/425] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:02:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:41.866577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f0153-5e1e-4afa-89c0-fd1c2bf86799 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:41.891725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:41.946159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1adcf-fbc0-4101-96b7-72d8d48213a8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:41.988833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cf4da-ec4b-4b76-90c7-38c039bcdda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:41.989478 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cf4da-ec4b-4b76-90c7-38c039bcdda7 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:41.989758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cf4da-ec4b-4b76-90c7-38c039bcdda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:41.990091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cf4da-ec4b-4b76-90c7-38c039bcdda7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:41.991253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cf4da-ec4b-4b76-90c7-38c039bcdda7 None admin] RBAC: Adding query filter params (group.id=801d032c2d134926afc53308ff0d77d6, role.id=2dfbdb214b97432588648dba947cb07a, scope.project.id=39be93f42044484fa6db903b2c759bba) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:41.991720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cf4da-ec4b-4b76-90c7-38c039bcdda7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:41.993800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cf4da-ec4b-4b76-90c7-38c039bcdda7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:42.002224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 213/426] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 31 00:02:41 2022] GET /identity/v3/role_assignments?group.id=801d032c2d134926afc53308ff0d77d6&scope.project.id=39be93f42044484fa6db903b2c759bba&role.id=2dfbdb214b97432588648dba947cb07a => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:42.003581 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ef468-5096-45aa-899a-686771d3c3fc None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:42.003862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ef468-5096-45aa-899a-686771d3c3fc None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:42.004132 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ef468-5096-45aa-899a-686771d3c3fc None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:42.005930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 214/427] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:42.009712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:42.012420 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4666617-e6d0-4880-b7b7-8f1cd45e2463 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:42.012703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4666617-e6d0-4880-b7b7-8f1cd45e2463 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:42.012970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4666617-e6d0-4880-b7b7-8f1cd45e2463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:42.044966 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f0153-5e1e-4afa-89c0-fd1c2bf86799 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:42.047007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-a4666617-e6d0-4880-b7b7-8f1cd45e2463 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:42.048234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a4666617-e6d0-4880-b7b7-8f1cd45e2463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:42.135088 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9125c-40cf-4922-9707-7671cdfcafc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:42.135715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9125c-40cf-4922-9707-7671cdfcafc1 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:42.135986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9125c-40cf-4922-9707-7671cdfcafc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:42.136250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9125c-40cf-4922-9707-7671cdfcafc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:42.136924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9125c-40cf-4922-9707-7671cdfcafc1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:42.137233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9125c-40cf-4922-9707-7671cdfcafc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:42.138646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9125c-40cf-4922-9707-7671cdfcafc1 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:42.162032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 214/428] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:42.167935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9125c-40cf-4922-9707-7671cdfcafc1 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:42.180386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 215/429] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:42.298385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9125c-40cf-4922-9707-7671cdfcafc1 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:42.333989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb1c72-0f67-498a-a980-c49f7918a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:42.334605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb1c72-0f67-498a-a980-c49f7918a3ed None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:42.334879 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb1c72-0f67-498a-a980-c49f7918a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:42.335170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb1c72-0f67-498a-a980-c49f7918a3ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:42.348084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:42.407758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb1c72-0f67-498a-a980-c49f7918a3ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:42.409278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb1c72-0f67-498a-a980-c49f7918a3ed None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:42.496559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4666617-e6d0-4880-b7b7-8f1cd45e2463 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:42.517356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 215/430] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:02:42.519879 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb1c72-0f67-498a-a980-c49f7918a3ed None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:42.561593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:42.563982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:42.625789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb1c72-0f67-498a-a980-c49f7918a3ed None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:42.632492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4666617-e6d0-4880-b7b7-8f1cd45e2463 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:42.663702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d394de2-8e7a-4984-a4ad-264d41125bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:42.664443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d394de2-8e7a-4984-a4ad-264d41125bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:42.664789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d394de2-8e7a-4984-a4ad-264d41125bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:42.665126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d394de2-8e7a-4984-a4ad-264d41125bb2 None admin] PATH_INFO: `/v3/projects/39be93f42044484fa6db903b2c759bba` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:42.668004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d394de2-8e7a-4984-a4ad-264d41125bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=39be93f42044484fa6db903b2c759bba)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:42.669557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d394de2-8e7a-4984-a4ad-264d41125bb2 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:42.670905 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f5f1d-8b00-41c9-aabc-211616a3661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:42.671607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f5f1d-8b00-41c9-aabc-211616a3661a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:42.671947 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f5f1d-8b00-41c9-aabc-211616a3661a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:42.672282 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f5f1d-8b00-41c9-aabc-211616a3661a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:42.675795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 216/431] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:42 2022] GET /identity/v3/projects/39be93f42044484fa6db903b2c759bba => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:42.677001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d394de2-8e7a-4984-a4ad-264d41125bb2 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:42.683435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f5f1d-8b00-41c9-aabc-211616a3661a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-660f5f1d-8b00-41c9-aabc-211616a3661a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:42.689413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:42.690342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:42.691148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:42.691148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:42.691148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:42.691148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:42.691148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:42.691148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:42.691148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:42.691148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:42.691148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:42.691148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:42.691148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:02:42.691148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:42.691148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 216/432] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:42.697828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f5f1d-8b00-41c9-aabc-211616a3661a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:42.800922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d394de2-8e7a-4984-a4ad-264d41125bb2 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:42.828570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f5f1d-8b00-41c9-aabc-211616a3661a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:42.829510 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:42.830440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:42.850781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cecf2-0153-406e-87c4-7f9ae7c1a4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:42.851893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cecf2-0153-406e-87c4-7f9ae7c1a4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:42.852420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cecf2-0153-406e-87c4-7f9ae7c1a4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:42.852885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cecf2-0153-406e-87c4-7f9ae7c1a4a3 None admin] PATH_INFO: `/v3/groups/801d032c2d134926afc53308ff0d77d6` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:42.854308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cecf2-0153-406e-87c4-7f9ae7c1a4a3 None admin] RBAC: Authorizing `identity:get_group(group_id=801d032c2d134926afc53308ff0d77d6)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:42.856488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cecf2-0153-406e-87c4-7f9ae7c1a4a3 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:42.858652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 217/433] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:42 2022] GET /identity/v3/groups/801d032c2d134926afc53308ff0d77d6 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:42.864341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cecf2-0153-406e-87c4-7f9ae7c1a4a3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:42.872236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b1c2-b1f3-4297-8adc-30b8107fe1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:42.872881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b1c2-b1f3-4297-8adc-30b8107fe1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:42.873154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b1c2-b1f3-4297-8adc-30b8107fe1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:42.873445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b1c2-b1f3-4297-8adc-30b8107fe1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:42.874108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362b1c2-b1f3-4297-8adc-30b8107fe1b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:42.874407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362b1c2-b1f3-4297-8adc-30b8107fe1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:42.875766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362b1c2-b1f3-4297-8adc-30b8107fe1b9 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:42.888126 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 217/434] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:02:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:42.894094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b1c2-b1f3-4297-8adc-30b8107fe1b9 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:43.008404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cecf2-0153-406e-87c4-7f9ae7c1a4a3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:43.045681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b1c2-b1f3-4297-8adc-30b8107fe1b9 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:43.063910 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047f615-998f-46dd-96c5-54d8178adb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:43.065110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047f615-998f-46dd-96c5-54d8178adb09 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:43.065864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047f615-998f-46dd-96c5-54d8178adb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:43.066362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047f615-998f-46dd-96c5-54d8178adb09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:43.067670 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047f615-998f-46dd-96c5-54d8178adb09 None admin] RBAC: Adding query filter params (group.id=801d032c2d134926afc53308ff0d77d6, role.id=b3796e568aa342a1b3318b04d23a9cc0, scope.project.id=39be93f42044484fa6db903b2c759bba) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:43.068197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047f615-998f-46dd-96c5-54d8178adb09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:43.070417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047f615-998f-46dd-96c5-54d8178adb09 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:43.079949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 218/435] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 31 00:02:42 2022] GET /identity/v3/role_assignments?group.id=801d032c2d134926afc53308ff0d77d6&scope.project.id=39be93f42044484fa6db903b2c759bba&role.id=b3796e568aa342a1b3318b04d23a9cc0 => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:43.086924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab3148-8851-48c6-bdb6-54f7922071db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:43.087950 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab3148-8851-48c6-bdb6-54f7922071db None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:43.088456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab3148-8851-48c6-bdb6-54f7922071db None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:43.088980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab3148-8851-48c6-bdb6-54f7922071db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:43.124774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:43.129454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795835a5-644d-4a8c-8292-8524b9059e79 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:43.129768 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795835a5-644d-4a8c-8292-8524b9059e79 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:43.130026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795835a5-644d-4a8c-8292-8524b9059e79 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:43.131616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 219/436] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:43.137479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a5d7-187d-4fe2-a03f-65f126b2e7c8 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:43.137774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a5d7-187d-4fe2-a03f-65f126b2e7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:43.138012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a5d7-187d-4fe2-a03f-65f126b2e7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:43.160260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-e1c8a5d7-187d-4fe2-a03f-65f126b2e7c8 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:43.161704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e1c8a5d7-187d-4fe2-a03f-65f126b2e7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:43.175085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab3148-8851-48c6-bdb6-54f7922071db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:43.176690 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab3148-8851-48c6-bdb6-54f7922071db None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:43.207206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:43.257685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 220/437] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:43.300726 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 218/438] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:43.306468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a5d7-187d-4fe2-a03f-65f126b2e7c8 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:43.410876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a5d7-187d-4fe2-a03f-65f126b2e7c8 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:43.419819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a603572-581d-445d-ae17-2d270c5b778e None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:43.420147 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a603572-581d-445d-ae17-2d270c5b778e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:43.420361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a603572-581d-445d-ae17-2d270c5b778e None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:43.421898 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 219/439] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:02:43.427274 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522af9f2-cf02-4fdf-8036-739db6cef719 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:43.429169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522af9f2-cf02-4fdf-8036-739db6cef719 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:43.429169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522af9f2-cf02-4fdf-8036-739db6cef719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:43.447414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-522af9f2-cf02-4fdf-8036-739db6cef719 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:43.448952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-522af9f2-cf02-4fdf-8036-739db6cef719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:43.456322 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206c003-8129-4af7-a4f5-36212ad65aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:43.456956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206c003-8129-4af7-a4f5-36212ad65aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:43.457686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206c003-8129-4af7-a4f5-36212ad65aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:43.457965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206c003-8129-4af7-a4f5-36212ad65aa3 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:43.459095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206c003-8129-4af7-a4f5-36212ad65aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:43.462326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206c003-8129-4af7-a4f5-36212ad65aa3 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:43.463668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 221/440] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:43 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:43.469934 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206c003-8129-4af7-a4f5-36212ad65aa3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:43.522181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:43.523392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:43.534570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 220/441] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:43.535659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522af9f2-cf02-4fdf-8036-739db6cef719 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:43.587212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206c003-8129-4af7-a4f5-36212ad65aa3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:43.633028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3284241-b669-497f-bb74-3cceed53bf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:43.633741 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3284241-b669-497f-bb74-3cceed53bf82 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:43.634143 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3284241-b669-497f-bb74-3cceed53bf82 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:43.634416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3284241-b669-497f-bb74-3cceed53bf82 None admin] PATH_INFO: `/v3/groups/801d032c2d134926afc53308ff0d77d6` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:43.635572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3284241-b669-497f-bb74-3cceed53bf82 None admin] RBAC: Authorizing `identity:get_group(group_id=801d032c2d134926afc53308ff0d77d6)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:43.636988 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3284241-b669-497f-bb74-3cceed53bf82 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:43.638735 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 222/442] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:43 2022] GET /identity/v3/groups/801d032c2d134926afc53308ff0d77d6 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:43.644163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3284241-b669-497f-bb74-3cceed53bf82 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:43.660519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522af9f2-cf02-4fdf-8036-739db6cef719 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:43.696832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1668536-254e-4c12-bf3f-cc266236d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:43.697410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1668536-254e-4c12-bf3f-cc266236d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:43.697686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1668536-254e-4c12-bf3f-cc266236d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:43.697952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1668536-254e-4c12-bf3f-cc266236d8c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:43.708146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1668536-254e-4c12-bf3f-cc266236d8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-b1668536-254e-4c12-bf3f-cc266236d8c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:43.713024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:43.713954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:43.714786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:43.714786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:43.714786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:43.714786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:43.714786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:43.714786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:43.714786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:43.714786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:43.714786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:43.714786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:43.714786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:43.714786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:43.714786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 221/443] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:02:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:43.719673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1668536-254e-4c12-bf3f-cc266236d8c8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:43.749476 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3284241-b669-497f-bb74-3cceed53bf82 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:43.760546 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:43.774985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:43.790217 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8ccfe-7a07-4d5a-928a-bc44518e7209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:43.790819 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8ccfe-7a07-4d5a-928a-bc44518e7209 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:43.791089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8ccfe-7a07-4d5a-928a-bc44518e7209 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:43.791352 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8ccfe-7a07-4d5a-928a-bc44518e7209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:43.792069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8ccfe-7a07-4d5a-928a-bc44518e7209 None admin] RBAC: Adding query filter params (group.id=801d032c2d134926afc53308ff0d77d6, role.id=2dfbdb214b97432588648dba947cb07a, scope.project.id=caeb95674dad43889d74cefec13b3ed8) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:43.792369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8ccfe-7a07-4d5a-928a-bc44518e7209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:43.793851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8ccfe-7a07-4d5a-928a-bc44518e7209 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:43.809249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 223/444] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 31 00:02:43 2022] GET /identity/v3/role_assignments?group.id=801d032c2d134926afc53308ff0d77d6&scope.project.id=caeb95674dad43889d74cefec13b3ed8&role.id=2dfbdb214b97432588648dba947cb07a => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:43.809249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8ccfe-7a07-4d5a-928a-bc44518e7209 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:43.830203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1668536-254e-4c12-bf3f-cc266236d8c8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:43.874790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a7199-f769-4b1b-97db-bfaac19d4f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:43.875576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a7199-f769-4b1b-97db-bfaac19d4f21 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:43.875861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a7199-f769-4b1b-97db-bfaac19d4f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:43.876467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a7199-f769-4b1b-97db-bfaac19d4f21 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:43.877461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a7199-f769-4b1b-97db-bfaac19d4f21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:43.877765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a7199-f769-4b1b-97db-bfaac19d4f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:43.879166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a7199-f769-4b1b-97db-bfaac19d4f21 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:43.895936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 222/445] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:43.897388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a7199-f769-4b1b-97db-bfaac19d4f21 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:43.919140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8ccfe-7a07-4d5a-928a-bc44518e7209 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:43.956709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2c2db-ef00-444d-90f6-a330b1727d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:43.957285 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2c2db-ef00-444d-90f6-a330b1727d6c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:43.957580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2c2db-ef00-444d-90f6-a330b1727d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:43.957845 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2c2db-ef00-444d-90f6-a330b1727d6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:43.970036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2c2db-ef00-444d-90f6-a330b1727d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-56a2c2db-ef00-444d-90f6-a330b1727d6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:43.975371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:43.976349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:43.978417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:43.978417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:43.978417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:43.978417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:43.978417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:43.978417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:43.978417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:43.978417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:43.978417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:43.978417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:43.978417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:02:43.978417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:43.978417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 224/446] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:02:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:02:43.982391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2c2db-ef00-444d-90f6-a330b1727d6c None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:44.020738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:44.028715 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a7199-f769-4b1b-97db-bfaac19d4f21 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:44.048461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:44.071738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3dba2-9d8a-4e1d-afc9-7b80444d5676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:44.072331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3dba2-9d8a-4e1d-afc9-7b80444d5676 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:44.072606 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3dba2-9d8a-4e1d-afc9-7b80444d5676 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:44.072869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3dba2-9d8a-4e1d-afc9-7b80444d5676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:44.109061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2c2db-ef00-444d-90f6-a330b1727d6c None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:44.148271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f858d6c-9a7d-4d40-aa18-e4e3333b7560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:44.148878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f858d6c-9a7d-4d40-aa18-e4e3333b7560 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:44.150013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f858d6c-9a7d-4d40-aa18-e4e3333b7560 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:44.150013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f858d6c-9a7d-4d40-aa18-e4e3333b7560 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:44.150197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f858d6c-9a7d-4d40-aa18-e4e3333b7560 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:44.150367 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f858d6c-9a7d-4d40-aa18-e4e3333b7560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:44.151746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f858d6c-9a7d-4d40-aa18-e4e3333b7560 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:44.160824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 225/447] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:44.162208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3dba2-9d8a-4e1d-afc9-7b80444d5676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:44.164058 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3dba2-9d8a-4e1d-afc9-7b80444d5676 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:44.166580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f858d6c-9a7d-4d40-aa18-e4e3333b7560 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:44.258961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:44.266582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f858d6c-9a7d-4d40-aa18-e4e3333b7560 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:44.266748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 223/448] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:44.272501 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3dba2-9d8a-4e1d-afc9-7b80444d5676 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:44.289718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:44.303096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bda785-de46-4bc1-a794-50f72ad94e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:44.303698 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda785-de46-4bc1-a794-50f72ad94e93 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:44.304056 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda785-de46-4bc1-a794-50f72ad94e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:44.304400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda785-de46-4bc1-a794-50f72ad94e93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:44.372539 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bda785-de46-4bc1-a794-50f72ad94e93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:44.373682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3dba2-9d8a-4e1d-afc9-7b80444d5676 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:44.374020 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bda785-de46-4bc1-a794-50f72ad94e93 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:44.407332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837fa41-9ada-44e3-89ca-6bd4034d1790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:44.407981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837fa41-9ada-44e3-89ca-6bd4034d1790 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:44.408242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837fa41-9ada-44e3-89ca-6bd4034d1790 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:44.408508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837fa41-9ada-44e3-89ca-6bd4034d1790 None admin] PATH_INFO: `/v3/projects/caeb95674dad43889d74cefec13b3ed8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:44.409658 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837fa41-9ada-44e3-89ca-6bd4034d1790 None admin] RBAC: Authorizing `identity:get_project(project_id=caeb95674dad43889d74cefec13b3ed8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:44.411123 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837fa41-9ada-44e3-89ca-6bd4034d1790 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:44.412745 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 224/449] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:44 2022] GET /identity/v3/projects/caeb95674dad43889d74cefec13b3ed8 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:44.418482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837fa41-9ada-44e3-89ca-6bd4034d1790 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:44.467848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:44.476258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 226/450] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:02:44.482136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bda785-de46-4bc1-a794-50f72ad94e93 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:44.504478 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:44.520606 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837fa41-9ada-44e3-89ca-6bd4034d1790 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:44.555663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107b6dc-3071-4a8e-b2e4-c869733aed71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:44.556281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107b6dc-3071-4a8e-b2e4-c869733aed71 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:44.556551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107b6dc-3071-4a8e-b2e4-c869733aed71 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:44.556812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107b6dc-3071-4a8e-b2e4-c869733aed71 None admin] PATH_INFO: `/v3/groups/801d032c2d134926afc53308ff0d77d6` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:44.557935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107b6dc-3071-4a8e-b2e4-c869733aed71 None admin] RBAC: Authorizing `identity:get_group(group_id=801d032c2d134926afc53308ff0d77d6)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:44.559361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107b6dc-3071-4a8e-b2e4-c869733aed71 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:44.560907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 225/451] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:44 2022] GET /identity/v3/groups/801d032c2d134926afc53308ff0d77d6 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:44.566644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107b6dc-3071-4a8e-b2e4-c869733aed71 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:44.582105 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bda785-de46-4bc1-a794-50f72ad94e93 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:44.617310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8f373-8102-4f20-8873-0f4288e4db5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:44.617903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8f373-8102-4f20-8873-0f4288e4db5c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:44.618177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8f373-8102-4f20-8873-0f4288e4db5c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:44.618443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8f373-8102-4f20-8873-0f4288e4db5c None admin] PATH_INFO: `/v3/projects/59c418df945e4be9ac1404a45cc7dcfd` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:44.619562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8f373-8102-4f20-8873-0f4288e4db5c None admin] RBAC: Authorizing `identity:get_project(project_id=59c418df945e4be9ac1404a45cc7dcfd)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:44.621011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8f373-8102-4f20-8873-0f4288e4db5c None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:44.622805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 227/452] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:02:44 2022] GET /identity/v3/projects/59c418df945e4be9ac1404a45cc7dcfd => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:44.628150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8f373-8102-4f20-8873-0f4288e4db5c None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:44.666530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107b6dc-3071-4a8e-b2e4-c869733aed71 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:44.691929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:44.701159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef69622-73c1-41fb-9e87-59122bb12f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:44.701799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef69622-73c1-41fb-9e87-59122bb12f87 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:44.702068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef69622-73c1-41fb-9e87-59122bb12f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:44.702334 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef69622-73c1-41fb-9e87-59122bb12f87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:44.703086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef69622-73c1-41fb-9e87-59122bb12f87 None admin] RBAC: Adding query filter params (group.id=801d032c2d134926afc53308ff0d77d6, role.id=b3796e568aa342a1b3318b04d23a9cc0, scope.project.id=caeb95674dad43889d74cefec13b3ed8) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:44.703390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef69622-73c1-41fb-9e87-59122bb12f87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:44.704890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef69622-73c1-41fb-9e87-59122bb12f87 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:44.711225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 226/453] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 31 00:02:44 2022] GET /identity/v3/role_assignments?group.id=801d032c2d134926afc53308ff0d77d6&scope.project.id=caeb95674dad43889d74cefec13b3ed8&role.id=b3796e568aa342a1b3318b04d23a9cc0 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:44.732241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8f373-8102-4f20-8873-0f4288e4db5c None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:44.769877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1948b-9745-448e-896c-5f870a188ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:44.770572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1948b-9745-448e-896c-5f870a188ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:44.770911 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1948b-9745-448e-896c-5f870a188ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:44.771126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1948b-9745-448e-896c-5f870a188ea7 None admin] PATH_INFO: `/v3/groups/3003ad448a084bbcb8d9e5bb6f8ad252` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:44.772343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1948b-9745-448e-896c-5f870a188ea7 None admin] RBAC: Authorizing `identity:get_group(group_id=3003ad448a084bbcb8d9e5bb6f8ad252)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:44.773898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1948b-9745-448e-896c-5f870a188ea7 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:44.775527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 228/454] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 31 00:02:44 2022] GET /identity/v3/groups/3003ad448a084bbcb8d9e5bb6f8ad252 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:44.782184 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef69622-73c1-41fb-9e87-59122bb12f87 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:44.801897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:44.893373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef69622-73c1-41fb-9e87-59122bb12f87 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:44.927174 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550fad5-0ae2-4058-933f-57af1d895746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:44.927782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550fad5-0ae2-4058-933f-57af1d895746 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:44.928061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550fad5-0ae2-4058-933f-57af1d895746 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:44.928330 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550fad5-0ae2-4058-933f-57af1d895746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:44.929122 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550fad5-0ae2-4058-933f-57af1d895746 None admin] RBAC: Adding query filter params (group.id=3003ad448a084bbcb8d9e5bb6f8ad252, role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=59c418df945e4be9ac1404a45cc7dcfd) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:44.929452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550fad5-0ae2-4058-933f-57af1d895746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:44.930876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550fad5-0ae2-4058-933f-57af1d895746 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:44.936816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 227/455] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 31 00:02:44 2022] GET /identity/v3/role_assignments?group.id=3003ad448a084bbcb8d9e5bb6f8ad252&scope.project.id=59c418df945e4be9ac1404a45cc7dcfd&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:47.198810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab943751-63b8-4eb4-82f5-6fdf09a7f016 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:47.198810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab943751-63b8-4eb4-82f5-6fdf09a7f016 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:47.198810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab943751-63b8-4eb4-82f5-6fdf09a7f016 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:47.198810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 229/456] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:47.205006 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba48eb-b068-4913-a49d-694468c8d67d None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:47.205419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba48eb-b068-4913-a49d-694468c8d67d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:47.205613 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba48eb-b068-4913-a49d-694468c8d67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:47.230214 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-58ba48eb-b068-4913-a49d-694468c8d67d None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:47.231417 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-58ba48eb-b068-4913-a49d-694468c8d67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:47.318989 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 228/457] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:47.421331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dce87-5706-4b67-a7ef-450537cfc3d4 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:47.421331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dce87-5706-4b67-a7ef-450537cfc3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:47.421331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dce87-5706-4b67-a7ef-450537cfc3d4 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:47.421994 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 230/458] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:47.426768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113750b-6dae-434d-a472-b9e477b6cc94 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:47.427056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113750b-6dae-434d-a472-b9e477b6cc94 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:47.427331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113750b-6dae-434d-a472-b9e477b6cc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:47.454276 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-4113750b-6dae-434d-a472-b9e477b6cc94 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:47.455469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-4113750b-6dae-434d-a472-b9e477b6cc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:47.458476 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:47.550832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 229/459] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:47.745744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dce87-5706-4b67-a7ef-450537cfc3d4 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:47.868983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dce87-5706-4b67-a7ef-450537cfc3d4 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:47.899219 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:47.905083 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c0032-386c-461a-ac18-14baa11c90b3 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:47.905680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e81f4-ecc5-4944-9b27-8d13bcdb0fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:47.905911 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c0032-386c-461a-ac18-14baa11c90b3 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:47.906138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c0032-386c-461a-ac18-14baa11c90b3 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:47.906321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e81f4-ecc5-4944-9b27-8d13bcdb0fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:47.906578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e81f4-ecc5-4944-9b27-8d13bcdb0fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:47.906901 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e81f4-ecc5-4944-9b27-8d13bcdb0fd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:47.912928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 230/460] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:02:47.918353 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e81f4-ecc5-4944-9b27-8d13bcdb0fd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:47.919505 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d34a-1e09-47a5-b35c-f5a7cf9d9a21 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:47.919775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d34a-1e09-47a5-b35c-f5a7cf9d9a21 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:47.919874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e81f4-ecc5-4944-9b27-8d13bcdb0fd5 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:47.920027 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d34a-1e09-47a5-b35c-f5a7cf9d9a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-4f0e81f4-ecc5-4944-9b27-8d13bcdb0fd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:47.937194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:47.938181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:47.939047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:47.939047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:47.939047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:47.943679 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 231/461] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:47.944679 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e81f4-ecc5-4944-9b27-8d13bcdb0fd5 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:47.954429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-0cf6d34a-1e09-47a5-b35c-f5a7cf9d9a21 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:47.955649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0cf6d34a-1e09-47a5-b35c-f5a7cf9d9a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:48.044150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 231/462] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:48.045143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d34a-1e09-47a5-b35c-f5a7cf9d9a21 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:48.074671 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e81f4-ecc5-4944-9b27-8d13bcdb0fd5 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:48.124578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb8e96-a1c6-4027-8cb1-17b633d46568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:48.125184 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb8e96-a1c6-4027-8cb1-17b633d46568 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:48.125644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb8e96-a1c6-4027-8cb1-17b633d46568 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:48.126564 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb8e96-a1c6-4027-8cb1-17b633d46568 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:48.127375 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb8e96-a1c6-4027-8cb1-17b633d46568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:48.127816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb8e96-a1c6-4027-8cb1-17b633d46568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:48.129368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb8e96-a1c6-4027-8cb1-17b633d46568 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:48.149447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 232/463] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:48.156729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb8e96-a1c6-4027-8cb1-17b633d46568 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:48.189555 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:48.215287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:48.227337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d34a-1e09-47a5-b35c-f5a7cf9d9a21 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:48.265187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0150f-52e5-49ae-92ae-94ffbb6d4352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:48.266078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0150f-52e5-49ae-92ae-94ffbb6d4352 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:48.266592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0150f-52e5-49ae-92ae-94ffbb6d4352 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:48.267032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0150f-52e5-49ae-92ae-94ffbb6d4352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:48.278481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0150f-52e5-49ae-92ae-94ffbb6d4352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:48.280573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0150f-52e5-49ae-92ae-94ffbb6d4352 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:48.289011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb8e96-a1c6-4027-8cb1-17b633d46568 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-36e0150f-52e5-49ae-92ae-94ffbb6d4352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:48.296795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:48.297974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:48.298818 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:48.298818 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:48.298818 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:48.300692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 232/464] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:48.302116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb19b7-0ef8-48c3-bd0f-5895cfc82b4b None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:48.302629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb19b7-0ef8-48c3-bd0f-5895cfc82b4b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:48.303109 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb19b7-0ef8-48c3-bd0f-5895cfc82b4b None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:48.308895 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 233/465] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:48.310400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3785e89-ccbe-49a7-a486-8e8db2759b1a None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:48.311041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3785e89-ccbe-49a7-a486-8e8db2759b1a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:48.311525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3785e89-ccbe-49a7-a486-8e8db2759b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:48.331761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e3785e89-ccbe-49a7-a486-8e8db2759b1a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:48.333119 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083915a-ec61-4996-81a1-8899df3c6f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:48.333759 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083915a-ec61-4996-81a1-8899df3c6f3d None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:48.333986 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e3785e89-ccbe-49a7-a486-8e8db2759b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:48.334087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083915a-ec61-4996-81a1-8899df3c6f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:48.334282 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083915a-ec61-4996-81a1-8899df3c6f3d None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:48.334951 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083915a-ec61-4996-81a1-8899df3c6f3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:48.336455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083915a-ec61-4996-81a1-8899df3c6f3d None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:48.370538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 233/466] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:02:48 2022] POST /identity/v3/users => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:02:48.371400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083915a-ec61-4996-81a1-8899df3c6f3d None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:48.416357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 234/467] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:48.417743 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3785e89-ccbe-49a7-a486-8e8db2759b1a None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:48.478731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:48.531966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3785e89-ccbe-49a7-a486-8e8db2759b1a None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:48.569655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc073-a5e7-485b-9570-7b5c87268568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:48.570412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc073-a5e7-485b-9570-7b5c87268568 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:48.570690 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc073-a5e7-485b-9570-7b5c87268568 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:48.570959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc073-a5e7-485b-9570-7b5c87268568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:48.575073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083915a-ec61-4996-81a1-8899df3c6f3d None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:48.577492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:48.582352 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bc073-a5e7-485b-9570-7b5c87268568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:48.583806 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bc073-a5e7-485b-9570-7b5c87268568 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-927bc073-a5e7-485b-9570-7b5c87268568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:48.602517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:48.603452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:48.604306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:48.604306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:48.604306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:48.604306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 235/468] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:48.610698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc073-a5e7-485b-9570-7b5c87268568 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:48.617571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae3132-8fa0-42fa-975c-45f1204cf1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:48.618186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3132-8fa0-42fa-975c-45f1204cf1fb None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:48.618521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3132-8fa0-42fa-975c-45f1204cf1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:48.618799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3132-8fa0-42fa-975c-45f1204cf1fb None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:48.619467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae3132-8fa0-42fa-975c-45f1204cf1fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:48.619751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae3132-8fa0-42fa-975c-45f1204cf1fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:48.621614 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae3132-8fa0-42fa-975c-45f1204cf1fb None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:48.638726 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 234/469] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:48.644560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae3132-8fa0-42fa-975c-45f1204cf1fb None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:48.734933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc073-a5e7-485b-9570-7b5c87268568 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:48.738792 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:48.777465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae3132-8fa0-42fa-975c-45f1204cf1fb None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:48.782589 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fdc17-336c-48d9-824a-80044c9e48c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:48.783200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fdc17-336c-48d9-824a-80044c9e48c7 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:48.783476 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fdc17-336c-48d9-824a-80044c9e48c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:48.783744 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fdc17-336c-48d9-824a-80044c9e48c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:48.784383 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fdc17-336c-48d9-824a-80044c9e48c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:48.784684 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fdc17-336c-48d9-824a-80044c9e48c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:48.786533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fdc17-336c-48d9-824a-80044c9e48c7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:48.802877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 236/470] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:48.808259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fdc17-336c-48d9-824a-80044c9e48c7 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:48.822893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff94bd-5499-4155-95fe-3c39404fc0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:48.823559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff94bd-5499-4155-95fe-3c39404fc0bc None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:48.824134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff94bd-5499-4155-95fe-3c39404fc0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:48.824384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff94bd-5499-4155-95fe-3c39404fc0bc None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:48.825177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff94bd-5499-4155-95fe-3c39404fc0bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:48.826752 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff94bd-5499-4155-95fe-3c39404fc0bc None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:48.853513 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 235/471] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:02:48 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:02:48.854503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff94bd-5499-4155-95fe-3c39404fc0bc None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:48.877912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:48.948097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fdc17-336c-48d9-824a-80044c9e48c7 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:49.002531 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8b6ec-5d17-4d27-81ba-ad6c4e5c8071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:49.003508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8b6ec-5d17-4d27-81ba-ad6c4e5c8071 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:49.003990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8b6ec-5d17-4d27-81ba-ad6c4e5c8071 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:49.004532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8b6ec-5d17-4d27-81ba-ad6c4e5c8071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:49.011177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff94bd-5499-4155-95fe-3c39404fc0bc None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:49.019328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8b6ec-5d17-4d27-81ba-ad6c4e5c8071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:49.020790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8b6ec-5d17-4d27-81ba-ad6c4e5c8071 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-feb8b6ec-5d17-4d27-81ba-ad6c4e5c8071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:49.038711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:49.039683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:49.040515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:49.040515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:49.040515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:49.040515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 237/472] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:49.041853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bd50e-98ba-4a21-a01c-05ce33b2f34b None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:49.041955 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bd50e-98ba-4a21-a01c-05ce33b2f34b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:49.042187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bd50e-98ba-4a21-a01c-05ce33b2f34b None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:49.043613 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 238/473] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:49.050014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f12c7-100b-406e-9616-05a96ec9cbda None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:49.050292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f12c7-100b-406e-9616-05a96ec9cbda None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:49.050560 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f12c7-100b-406e-9616-05a96ec9cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:49.064890 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126e283-01c4-44a8-ad2a-02904409fab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:49.067017 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e283-01c4-44a8-ad2a-02904409fab3 None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:49.067302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e283-01c4-44a8-ad2a-02904409fab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:49.067583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e283-01c4-44a8-ad2a-02904409fab3 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:49.068320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126e283-01c4-44a8-ad2a-02904409fab3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:49.069824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126e283-01c4-44a8-ad2a-02904409fab3 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:49.083132 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-424f12c7-100b-406e-9616-05a96ec9cbda None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:49.084749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-424f12c7-100b-406e-9616-05a96ec9cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:49.097449 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 236/474] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:02:48 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:02:49.099029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126e283-01c4-44a8-ad2a-02904409fab3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:49.107217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:49.194215 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 239/475] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:49.195228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:49.239121 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126e283-01c4-44a8-ad2a-02904409fab3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:49.290553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731f02c-39e4-4ea0-beaf-a81f8fca2763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:49.291998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f02c-39e4-4ea0-beaf-a81f8fca2763 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:49.291998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f02c-39e4-4ea0-beaf-a81f8fca2763 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:49.291998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f02c-39e4-4ea0-beaf-a81f8fca2763 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:49.292460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731f02c-39e4-4ea0-beaf-a81f8fca2763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:49.292759 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731f02c-39e4-4ea0-beaf-a81f8fca2763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:49.294171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731f02c-39e4-4ea0-beaf-a81f8fca2763 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:49.309243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 237/476] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:49.314682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f12c7-100b-406e-9616-05a96ec9cbda None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:49.482007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f12c7-100b-406e-9616-05a96ec9cbda None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:49.531232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011978e-6139-44f2-a127-b9b82941aae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:49.532210 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011978e-6139-44f2-a127-b9b82941aae5 None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:49.532682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011978e-6139-44f2-a127-b9b82941aae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:49.533145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011978e-6139-44f2-a127-b9b82941aae5 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:49.534149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011978e-6139-44f2-a127-b9b82941aae5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:49.535785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011978e-6139-44f2-a127-b9b82941aae5 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:49.550706 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731f02c-39e4-4ea0-beaf-a81f8fca2763 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:49.569092 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 240/477] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:02:49 2022] POST /identity/v3/users => generated 249 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:02:49.710360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731f02c-39e4-4ea0-beaf-a81f8fca2763 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:49.745670 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:49.754728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad94bf-da3a-491c-83ca-9dd8b307f036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:49.755726 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad94bf-da3a-491c-83ca-9dd8b307f036 None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:49.756400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad94bf-da3a-491c-83ca-9dd8b307f036 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:49.756683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad94bf-da3a-491c-83ca-9dd8b307f036 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:49.757433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad94bf-da3a-491c-83ca-9dd8b307f036 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:49.758830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad94bf-da3a-491c-83ca-9dd8b307f036 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:49.774460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.sql.core [None req-87ad94bf-da3a-491c-83ca-9dd8b307f036 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:02:49.774460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 00:02:49.774460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [parameters: {'id': '7daef180cc0549b9a0e3278be6974ef9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 00:02:49.774460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81710) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-87ad94bf-da3a-491c-83ca-9dd8b307f036 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application result.read() Aug 31 00:02:49.797177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:02:49.798151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application yield resource Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise self.value Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application session.commit() Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:02:49.799089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:02:49.799985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:02:49.800883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application result.read() Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:02:49.803667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [parameters: {'id': '7daef180cc0549b9a0e3278be6974ef9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:49.806340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 00:02:49.808125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:49.814975 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 238/478] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 31 00:02:49 2022] POST /identity/v3/roles => generated 144 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:49.815067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011978e-6139-44f2-a127-b9b82941aae5 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:49.815067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:49.938778 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011978e-6139-44f2-a127-b9b82941aae5 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:49.976497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d9d6c-6c7a-4f2c-b3d1-e9e3266d0d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:49.977448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9d6c-6c7a-4f2c-b3d1-e9e3266d0d9c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:49.977751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9d6c-6c7a-4f2c-b3d1-e9e3266d0d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:49.978028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9d6c-6c7a-4f2c-b3d1-e9e3266d0d9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:49.991495 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d9d6c-6c7a-4f2c-b3d1-e9e3266d0d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-ed8d9d6c-6c7a-4f2c-b3d1-e9e3266d0d9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:49.997508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:49.999065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:50.000208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:50.000208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:50.000208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:50.000208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:50.000208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:50.000208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:50.000208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:50.000208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:50.000208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:50.000208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:50.000208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:02:50.000208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:50.000208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 241/479] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:02:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:50.005438 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad94bf-da3a-491c-83ca-9dd8b307f036 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:50.124151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad94bf-da3a-491c-83ca-9dd8b307f036 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:50.161788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf21df4-f188-444d-b4cc-a8abd99dcca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:50.162403 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf21df4-f188-444d-b4cc-a8abd99dcca1 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:50.162671 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf21df4-f188-444d-b4cc-a8abd99dcca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:50.163027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf21df4-f188-444d-b4cc-a8abd99dcca1 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:50.164269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf21df4-f188-444d-b4cc-a8abd99dcca1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:50.164655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf21df4-f188-444d-b4cc-a8abd99dcca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:50.166552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf21df4-f188-444d-b4cc-a8abd99dcca1 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:50.179193 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 239/480] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:50.953724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c8e8-8d0b-4ace-895e-e2ba91854083 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:50.954456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c8e8-8d0b-4ace-895e-e2ba91854083 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:50.954456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c8e8-8d0b-4ace-895e-e2ba91854083 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:50.955862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 242/481] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:50.961555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b007fdd-9edc-42f2-a8db-32b7f92d5113 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:50.962081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b007fdd-9edc-42f2-a8db-32b7f92d5113 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:50.962285 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b007fdd-9edc-42f2-a8db-32b7f92d5113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:50.989729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-5b007fdd-9edc-42f2-a8db-32b7f92d5113 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:50.990934 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-5b007fdd-9edc-42f2-a8db-32b7f92d5113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:51.074445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:51.095447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 240/482] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:51.420053 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd83e3d-7aec-4316-947f-8bc422b8ca50 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:51.420449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd83e3d-7aec-4316-947f-8bc422b8ca50 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:51.420622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd83e3d-7aec-4316-947f-8bc422b8ca50 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:51.422222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 243/483] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:51.427342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5eec2-24d5-493d-a6d5-af01ee7a76d7 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:51.427618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5eec2-24d5-493d-a6d5-af01ee7a76d7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:51.427875 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5eec2-24d5-493d-a6d5-af01ee7a76d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:51.446775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-0ca5eec2-24d5-493d-a6d5-af01ee7a76d7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:51.447944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0ca5eec2-24d5-493d-a6d5-af01ee7a76d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:51.525680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd83e3d-7aec-4316-947f-8bc422b8ca50 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:51.540701 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 241/484] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:51.604538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:51.658857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd83e3d-7aec-4316-947f-8bc422b8ca50 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:51.700745 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20ce32-03fd-43e3-9856-ac8bdb38394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:51.701323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20ce32-03fd-43e3-9856-ac8bdb38394c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:51.701602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20ce32-03fd-43e3-9856-ac8bdb38394c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:51.701873 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20ce32-03fd-43e3-9856-ac8bdb38394c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:51.719003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20ce32-03fd-43e3-9856-ac8bdb38394c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-cb20ce32-03fd-43e3-9856-ac8bdb38394c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:51.723812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:51.724695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:51.726449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:51.726449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:51.726449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:51.726449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:51.726449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:51.726449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:51.726449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:51.726449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:51.726449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:51.726449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:51.726449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:51.726449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:51.726449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 244/485] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:02:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:02:51.731151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5eec2-24d5-493d-a6d5-af01ee7a76d7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:51.860009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc9530-5737-418e-9f4a-da515ea30e1f None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:51.860338 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc9530-5737-418e-9f4a-da515ea30e1f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:51.860552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc9530-5737-418e-9f4a-da515ea30e1f None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:51.862272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 245/486] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:51.867985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ef2c-ee5d-48b9-946e-af97182f16df None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:51.868260 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ef2c-ee5d-48b9-946e-af97182f16df None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:51.868642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ef2c-ee5d-48b9-946e-af97182f16df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:51.871416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5eec2-24d5-493d-a6d5-af01ee7a76d7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:51.888264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7744ef2c-ee5d-48b9-946e-af97182f16df None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:51.889784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:51.890040 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7744ef2c-ee5d-48b9-946e-af97182f16df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:51.910019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bfdc8-75f3-4801-9638-a50b3fbb9989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:51.910640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bfdc8-75f3-4801-9638-a50b3fbb9989 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:51.910912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bfdc8-75f3-4801-9638-a50b3fbb9989 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:51.911226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bfdc8-75f3-4801-9638-a50b3fbb9989 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:51.911900 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bfdc8-75f3-4801-9638-a50b3fbb9989 None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:51.912195 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bfdc8-75f3-4801-9638-a50b3fbb9989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:51.913675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bfdc8-75f3-4801-9638-a50b3fbb9989 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:51.927150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 242/487] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:02:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:51.927150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bfdc8-75f3-4801-9638-a50b3fbb9989 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:51.987191 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 246/488] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:02:51.988157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ef2c-ee5d-48b9-946e-af97182f16df None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:52.059778 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bfdc8-75f3-4801-9638-a50b3fbb9989 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:52.064400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:52.131218 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b84cc-9c9a-4773-8d79-cb5af98fe1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:52.132636 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b84cc-9c9a-4773-8d79-cb5af98fe1ec None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:52.132912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b84cc-9c9a-4773-8d79-cb5af98fe1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:52.133180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b84cc-9c9a-4773-8d79-cb5af98fe1ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:52.144154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ef2c-ee5d-48b9-946e-af97182f16df None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:52.156889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b84cc-9c9a-4773-8d79-cb5af98fe1ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-fe3b84cc-9c9a-4773-8d79-cb5af98fe1ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:52.162374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:52.163566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:52.164357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:52.164357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:52.164357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:52.164357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:52.164357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:52.164357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:52.164357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:52.164357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:52.164357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:52.164357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:52.164357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:52.164357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:52.172448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 243/489] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:02:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:52.173754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b84cc-9c9a-4773-8d79-cb5af98fe1ec None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:52.214377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc568a-5e9c-4a0d-8be6-8eecd89dfdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:52.215012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc568a-5e9c-4a0d-8be6-8eecd89dfdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:52.218114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc568a-5e9c-4a0d-8be6-8eecd89dfdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:52.218388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc568a-5e9c-4a0d-8be6-8eecd89dfdf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:52.237391 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc568a-5e9c-4a0d-8be6-8eecd89dfdf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:52.238775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc568a-5e9c-4a0d-8be6-8eecd89dfdf7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:52.254358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-b9dc568a-5e9c-4a0d-8be6-8eecd89dfdf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:52.269554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:52.271716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:52.273861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:52.273861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:52.273861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:52.273861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 247/490] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:52.280780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc568a-5e9c-4a0d-8be6-8eecd89dfdf7 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:52.335736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b84cc-9c9a-4773-8d79-cb5af98fe1ec None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:52.371910 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9e811-9f68-43b3-8f5d-2e1cd7e6c5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:52.372524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9e811-9f68-43b3-8f5d-2e1cd7e6c5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:52.372798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9e811-9f68-43b3-8f5d-2e1cd7e6c5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:52.373100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9e811-9f68-43b3-8f5d-2e1cd7e6c5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:52.373800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9e811-9f68-43b3-8f5d-2e1cd7e6c5d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:52.374102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9e811-9f68-43b3-8f5d-2e1cd7e6c5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:52.375496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9e811-9f68-43b3-8f5d-2e1cd7e6c5d7 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:52.384155 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 244/491] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:02:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:52.384974 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9e811-9f68-43b3-8f5d-2e1cd7e6c5d7 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:52.397027 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc568a-5e9c-4a0d-8be6-8eecd89dfdf7 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:52.399713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:52.435876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92016ac-b3ea-4fcb-b2bb-1a2d61c5b1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:52.436494 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92016ac-b3ea-4fcb-b2bb-1a2d61c5b1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:52.436769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92016ac-b3ea-4fcb-b2bb-1a2d61c5b1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:52.437039 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92016ac-b3ea-4fcb-b2bb-1a2d61c5b1d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:52.437712 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92016ac-b3ea-4fcb-b2bb-1a2d61c5b1d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:52.438018 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92016ac-b3ea-4fcb-b2bb-1a2d61c5b1d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:52.439376 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92016ac-b3ea-4fcb-b2bb-1a2d61c5b1d5 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:52.451642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 248/492] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:52.452863 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cb68c-3672-49f6-aefe-509c6749d0ed None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:52.453152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cb68c-3672-49f6-aefe-509c6749d0ed None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:52.453447 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cb68c-3672-49f6-aefe-509c6749d0ed None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:52.457793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 249/493] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:52.457793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cb68c-3672-49f6-aefe-509c6749d0ed None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:52.498754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:52.501858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9e811-9f68-43b3-8f5d-2e1cd7e6c5d7 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:52.540163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a56be-db28-4e49-a732-a1182a740dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:52.540937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a56be-db28-4e49-a732-a1182a740dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:52.541180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a56be-db28-4e49-a732-a1182a740dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:52.541526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a56be-db28-4e49-a732-a1182a740dc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:52.552301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a56be-db28-4e49-a732-a1182a740dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-1f7a56be-db28-4e49-a732-a1182a740dc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:52.558543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:52.559467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:52.560347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:52.560347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:52.560347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:52.560347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:52.560347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:52.560347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:52.560347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:52.560347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:52.560347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:52.560347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:52.560347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:52.560347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:52.560347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 245/494] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:02:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:52.561001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a56be-db28-4e49-a732-a1182a740dc6 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:52.574117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cb68c-3672-49f6-aefe-509c6749d0ed None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:52.611074 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b425f-3d2e-422f-9844-c715bb05672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:52.611722 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b425f-3d2e-422f-9844-c715bb05672d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:52.612026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b425f-3d2e-422f-9844-c715bb05672d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:52.612293 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b425f-3d2e-422f-9844-c715bb05672d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:52.623761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b425f-3d2e-422f-9844-c715bb05672d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:52.625295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b425f-3d2e-422f-9844-c715bb05672d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-140b425f-3d2e-422f-9844-c715bb05672d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:52.641244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:52.642177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:52.643030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:52.643030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:52.643030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:52.643030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 250/495] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:52.643704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd556ca-e5f0-4761-8344-a082936d0e75 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:52.643984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd556ca-e5f0-4761-8344-a082936d0e75 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:52.644254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd556ca-e5f0-4761-8344-a082936d0e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:52.663951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-bdd556ca-e5f0-4761-8344-a082936d0e75 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:52.665405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-bdd556ca-e5f0-4761-8344-a082936d0e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:52.668005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a56be-db28-4e49-a732-a1182a740dc6 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:52.677515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:52.709103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5045a-3f58-469c-a86e-543246b0718b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:52.710068 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5045a-3f58-469c-a86e-543246b0718b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:52.710466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5045a-3f58-469c-a86e-543246b0718b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:52.710855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5045a-3f58-469c-a86e-543246b0718b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:52.722161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5045a-3f58-469c-a86e-543246b0718b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:52.724602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5045a-3f58-469c-a86e-543246b0718b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-31d5045a-3f58-469c-a86e-543246b0718b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:02:52.739868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:52.740850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:52.742174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:52.742174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:52.742174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:02:52.742174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:02:52.742174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:02:52.742174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:02:52.742174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:02:52.742174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:02:52.742174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:02:52.742174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:52.742174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 246/496] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 31 00:02:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:52.742844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5045a-3f58-469c-a86e-543246b0718b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:52.751481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 251/497] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:52.752610 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd556ca-e5f0-4761-8344-a082936d0e75 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:52.771190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:52.856435 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5045a-3f58-469c-a86e-543246b0718b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:52.878311 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd556ca-e5f0-4761-8344-a082936d0e75 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:52.891445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ae070-74f1-4409-b60c-9a519790a637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:52.892054 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ae070-74f1-4409-b60c-9a519790a637 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:52.892325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ae070-74f1-4409-b60c-9a519790a637 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:52.892578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ae070-74f1-4409-b60c-9a519790a637 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:52.893283 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ae070-74f1-4409-b60c-9a519790a637 None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:52.893576 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ae070-74f1-4409-b60c-9a519790a637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:52.894957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ae070-74f1-4409-b60c-9a519790a637 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:52.902950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 247/498] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:02:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:52.903760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ae070-74f1-4409-b60c-9a519790a637 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:52.920517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db5b62-3fda-487c-a0ae-5f5c06babf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:52.921404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db5b62-3fda-487c-a0ae-5f5c06babf52 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:52.921887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db5b62-3fda-487c-a0ae-5f5c06babf52 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:52.922222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db5b62-3fda-487c-a0ae-5f5c06babf52 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:52.922865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db5b62-3fda-487c-a0ae-5f5c06babf52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:52.923160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db5b62-3fda-487c-a0ae-5f5c06babf52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:52.924506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db5b62-3fda-487c-a0ae-5f5c06babf52 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:52.941028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 252/499] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:52.941028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955754f9-7c87-44d2-8df0-be28e1a26fd8 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:52.941028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955754f9-7c87-44d2-8df0-be28e1a26fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:52.941028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955754f9-7c87-44d2-8df0-be28e1a26fd8 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:52.941028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 253/500] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:52.941028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955754f9-7c87-44d2-8df0-be28e1a26fd8 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:52.951751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:52.998490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:53.018283 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ae070-74f1-4409-b60c-9a519790a637 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:53.053577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900c734-6711-4a12-9940-fbc21afc94ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:53.054057 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900c734-6711-4a12-9940-fbc21afc94ec None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:53.054328 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900c734-6711-4a12-9940-fbc21afc94ec None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:53.054595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900c734-6711-4a12-9940-fbc21afc94ec None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:53.055316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900c734-6711-4a12-9940-fbc21afc94ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:53.055617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900c734-6711-4a12-9940-fbc21afc94ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:53.056576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955754f9-7c87-44d2-8df0-be28e1a26fd8 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:53.057046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900c734-6711-4a12-9940-fbc21afc94ec None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:53.093758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44355835-e017-42f9-94a3-323acc43cc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:53.094401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44355835-e017-42f9-94a3-323acc43cc69 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:53.094677 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44355835-e017-42f9-94a3-323acc43cc69 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:53.094944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44355835-e017-42f9-94a3-323acc43cc69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:53.095596 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 248/501] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 31 00:02:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:53.096481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900c734-6711-4a12-9940-fbc21afc94ec None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:53.106824 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44355835-e017-42f9-94a3-323acc43cc69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:53.108253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44355835-e017-42f9-94a3-323acc43cc69 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-44355835-e017-42f9-94a3-323acc43cc69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:53.122513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:53.123414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:53.124296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:53.124296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:53.124296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:53.124296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 254/502] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:53.125099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f6d0b-c37c-4edb-82aa-42dd5dd22788 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:53.125099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f6d0b-c37c-4edb-82aa-42dd5dd22788 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:53.125394 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f6d0b-c37c-4edb-82aa-42dd5dd22788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:53.142507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-591f6d0b-c37c-4edb-82aa-42dd5dd22788 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:53.143672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-591f6d0b-c37c-4edb-82aa-42dd5dd22788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:53.197618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:53.200772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900c734-6711-4a12-9940-fbc21afc94ec None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:53.211476 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 255/503] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:53.212327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f6d0b-c37c-4edb-82aa-42dd5dd22788 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:53.236855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893297a-fe1e-47f2-8bc3-ac81c41d8d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:53.237655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893297a-fe1e-47f2-8bc3-ac81c41d8d7f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:53.237897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893297a-fe1e-47f2-8bc3-ac81c41d8d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:53.238166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893297a-fe1e-47f2-8bc3-ac81c41d8d7f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:53.246221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893297a-fe1e-47f2-8bc3-ac81c41d8d7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:53.247680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893297a-fe1e-47f2-8bc3-ac81c41d8d7f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:53.250754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-4893297a-fe1e-47f2-8bc3-ac81c41d8d7f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:02:53.261100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:53.262127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:53.263029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:53.263029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:53.263029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:02:53.263029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:02:53.263029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:02:53.263029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:02:53.263029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:02:53.263029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:02:53.263029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:02:53.263029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:53.263029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 249/504] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:53.268895 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893297a-fe1e-47f2-8bc3-ac81c41d8d7f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:53.313841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f6d0b-c37c-4edb-82aa-42dd5dd22788 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:53.352813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e47daa-530f-433e-b338-293dd487bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:53.353472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e47daa-530f-433e-b338-293dd487bd91 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:53.353747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e47daa-530f-433e-b338-293dd487bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:53.354012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e47daa-530f-433e-b338-293dd487bd91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:53.364533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e47daa-530f-433e-b338-293dd487bd91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-90e47daa-530f-433e-b338-293dd487bd91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:53.369412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:53.370307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:53.371113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:53.371113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:53.371113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:53.371113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:53.371113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:53.371113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:53.371113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:53.371113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:53.371113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:53.371113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:53.371113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:53.371113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:53.371113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 256/505] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:53.371755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e47daa-530f-433e-b338-293dd487bd91 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:53.373082 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893297a-fe1e-47f2-8bc3-ac81c41d8d7f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:53.411893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3afeb-2a92-4f50-ac79-adb599c42d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:53.412651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3afeb-2a92-4f50-ac79-adb599c42d15 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:53.413035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3afeb-2a92-4f50-ac79-adb599c42d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:53.413528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3afeb-2a92-4f50-ac79-adb599c42d15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:53.424391 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:53.476412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e47daa-530f-433e-b338-293dd487bd91 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:53.483945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:53.486793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3afeb-2a92-4f50-ac79-adb599c42d15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:53.488740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3afeb-2a92-4f50-ac79-adb599c42d15 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:53.510824 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe8868-8cc1-43eb-92b4-9374339c19a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:53.511427 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe8868-8cc1-43eb-92b4-9374339c19a7 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:53.511697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe8868-8cc1-43eb-92b4-9374339c19a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:53.511964 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe8868-8cc1-43eb-92b4-9374339c19a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:53.512602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe8868-8cc1-43eb-92b4-9374339c19a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:53.512894 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe8868-8cc1-43eb-92b4-9374339c19a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:53.514303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe8868-8cc1-43eb-92b4-9374339c19a7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:53.526222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 257/506] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:53.527101 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe8868-8cc1-43eb-92b4-9374339c19a7 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:53.591608 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 250/507] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:53.592451 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3afeb-2a92-4f50-ac79-adb599c42d15 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:53.634100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe8868-8cc1-43eb-92b4-9374339c19a7 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:53.643198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:53.670322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccdb73-1be5-464f-906f-7e14c4519ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:53.670926 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccdb73-1be5-464f-906f-7e14c4519ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:53.671195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccdb73-1be5-464f-906f-7e14c4519ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:53.671457 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccdb73-1be5-464f-906f-7e14c4519ad9 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:53.672179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccdb73-1be5-464f-906f-7e14c4519ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:53.672475 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccdb73-1be5-464f-906f-7e14c4519ad9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:53.674008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccdb73-1be5-464f-906f-7e14c4519ad9 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:53.686793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:53.689965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3afeb-2a92-4f50-ac79-adb599c42d15 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:53.710233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 258/508] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 31 00:02:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:53.711072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccdb73-1be5-464f-906f-7e14c4519ad9 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:53.729678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee3e7a-526d-495f-97fd-c4ffb9f53b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:53.730307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee3e7a-526d-495f-97fd-c4ffb9f53b87 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:53.730575 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee3e7a-526d-495f-97fd-c4ffb9f53b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:53.730843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee3e7a-526d-495f-97fd-c4ffb9f53b87 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:53.731502 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee3e7a-526d-495f-97fd-c4ffb9f53b87 None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:53.731801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee3e7a-526d-495f-97fd-c4ffb9f53b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:53.733156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee3e7a-526d-495f-97fd-c4ffb9f53b87 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:53.741508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 251/509] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:53.742296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee3e7a-526d-495f-97fd-c4ffb9f53b87 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:53.811030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccdb73-1be5-464f-906f-7e14c4519ad9 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:53.842407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee3e7a-526d-495f-97fd-c4ffb9f53b87 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:53.845353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8faf6-eddf-47a5-89dc-02ee42648319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:53.845988 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8faf6-eddf-47a5-89dc-02ee42648319 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:53.846259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8faf6-eddf-47a5-89dc-02ee42648319 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:53.846523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8faf6-eddf-47a5-89dc-02ee42648319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:53.857066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8faf6-eddf-47a5-89dc-02ee42648319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:53.858585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8faf6-eddf-47a5-89dc-02ee42648319 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-85d8faf6-eddf-47a5-89dc-02ee42648319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:53.873283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:53.874168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:53.875014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:53.875014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:53.875014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:53.875014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 259/510] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:53.875241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8faf6-eddf-47a5-89dc-02ee42648319 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:53.880110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466e5a3-4d2f-4696-a6ce-df00e82eee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:53.880742 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466e5a3-4d2f-4696-a6ce-df00e82eee87 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:53.881020 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466e5a3-4d2f-4696-a6ce-df00e82eee87 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:53.881319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466e5a3-4d2f-4696-a6ce-df00e82eee87 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:53.889329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466e5a3-4d2f-4696-a6ce-df00e82eee87 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:53.890765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466e5a3-4d2f-4696-a6ce-df00e82eee87 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:53.895776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-4466e5a3-4d2f-4696-a6ce-df00e82eee87 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:02:53.902315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:53.903366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:53.904782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:53.904782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:53.904782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:02:53.904782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:02:53.904782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:02:53.904782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:02:53.904782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:02:53.904782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:02:53.904782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:02:53.904782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:53.904782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 252/511] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:02:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:53.904782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466e5a3-4d2f-4696-a6ce-df00e82eee87 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:53.930191 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:53.987967 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8faf6-eddf-47a5-89dc-02ee42648319 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:54.007647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466e5a3-4d2f-4696-a6ce-df00e82eee87 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:54.021479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c1ab0-f1c3-42e6-986f-1017c32bf8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:54.022152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c1ab0-f1c3-42e6-986f-1017c32bf8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:54.022467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c1ab0-f1c3-42e6-986f-1017c32bf8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:54.022778 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c1ab0-f1c3-42e6-986f-1017c32bf8f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:54.033597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c1ab0-f1c3-42e6-986f-1017c32bf8f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:54.035022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c1ab0-f1c3-42e6-986f-1017c32bf8f7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:54.040983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb692b3-4152-4361-955a-35704a442ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:54.041629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb692b3-4152-4361-955a-35704a442ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:54.041902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb692b3-4152-4361-955a-35704a442ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:54.042162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb692b3-4152-4361-955a-35704a442ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-5e9c1ab0-f1c3-42e6-986f-1017c32bf8f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:54.048924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:54.049833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:54.050656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:54.050656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:54.050656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:54.050656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 260/512] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:54.050876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c1ab0-f1c3-42e6-986f-1017c32bf8f7 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:54.110723 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb692b3-4152-4361-955a-35704a442ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:54.112185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb692b3-4152-4361-955a-35704a442ee7 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:54.126498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:54.135065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:54.159118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c1ab0-f1c3-42e6-986f-1017c32bf8f7 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:54.197352 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15f1e0-005c-41a3-9aa5-8d86acff4137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:54.197985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f1e0-005c-41a3-9aa5-8d86acff4137 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:54.198259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f1e0-005c-41a3-9aa5-8d86acff4137 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:54.198524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f1e0-005c-41a3-9aa5-8d86acff4137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:54.209616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15f1e0-005c-41a3-9aa5-8d86acff4137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:54.209757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 253/513] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:54.210490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb692b3-4152-4361-955a-35704a442ee7 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:54.211081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15f1e0-005c-41a3-9aa5-8d86acff4137 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-5b15f1e0-005c-41a3-9aa5-8d86acff4137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:54.225592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:54.226679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:54.227764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:54.227764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:54.227764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:54.227764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 261/514] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:54.227764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15f1e0-005c-41a3-9aa5-8d86acff4137 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:54.314949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb692b3-4152-4361-955a-35704a442ee7 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:54.324331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15f1e0-005c-41a3-9aa5-8d86acff4137 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:54.337960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:54.346477 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:54.350169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cb3a4-2ec9-441c-bdca-1cbf0276e8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:54.350848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cb3a4-2ec9-441c-bdca-1cbf0276e8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:54.351115 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cb3a4-2ec9-441c-bdca-1cbf0276e8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:54.351372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cb3a4-2ec9-441c-bdca-1cbf0276e8d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:54.352016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cb3a4-2ec9-441c-bdca-1cbf0276e8d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:54.352313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cb3a4-2ec9-441c-bdca-1cbf0276e8d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:54.353729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cb3a4-2ec9-441c-bdca-1cbf0276e8d8 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:54.358867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233369d-d629-4c68-adfd-98dee41a7f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:54.359464 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233369d-d629-4c68-adfd-98dee41a7f76 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:54.359736 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233369d-d629-4c68-adfd-98dee41a7f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:54.360002 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233369d-d629-4c68-adfd-98dee41a7f76 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:54.360720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233369d-d629-4c68-adfd-98dee41a7f76 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:54.361018 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233369d-d629-4c68-adfd-98dee41a7f76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:54.362455 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233369d-d629-4c68-adfd-98dee41a7f76 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:54.365117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 254/515] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:54.365889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cb3a4-2ec9-441c-bdca-1cbf0276e8d8 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:54.379893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 262/516] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 31 00:02:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:54.380709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233369d-d629-4c68-adfd-98dee41a7f76 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:54.465687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cb3a4-2ec9-441c-bdca-1cbf0276e8d8 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:54.479179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233369d-d629-4c68-adfd-98dee41a7f76 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:54.499867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48c227-550e-45c0-9a44-1d39fa00659f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:54.500460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48c227-550e-45c0-9a44-1d39fa00659f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:54.500727 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48c227-550e-45c0-9a44-1d39fa00659f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:54.500991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48c227-550e-45c0-9a44-1d39fa00659f None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:54.501656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48c227-550e-45c0-9a44-1d39fa00659f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:54.501943 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48c227-550e-45c0-9a44-1d39fa00659f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:54.503309 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48c227-550e-45c0-9a44-1d39fa00659f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:54.513050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2296aa-0306-4ed3-800f-72f31ec8dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:54.513689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2296aa-0306-4ed3-800f-72f31ec8dbda None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:54.513964 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2296aa-0306-4ed3-800f-72f31ec8dbda None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:54.514232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2296aa-0306-4ed3-800f-72f31ec8dbda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:54.515784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 255/517] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:54.516566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48c227-550e-45c0-9a44-1d39fa00659f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:54.530493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2296aa-0306-4ed3-800f-72f31ec8dbda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:54.531948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2296aa-0306-4ed3-800f-72f31ec8dbda None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-3a2296aa-0306-4ed3-800f-72f31ec8dbda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:54.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:54.547785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:54.548645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:54.548645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:54.548645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:54.548645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 263/518] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:54.548645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2296aa-0306-4ed3-800f-72f31ec8dbda None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:54.565993 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:54.579807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:54.623572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48c227-550e-45c0-9a44-1d39fa00659f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:54.649442 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2296aa-0306-4ed3-800f-72f31ec8dbda None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:54.657233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539cca0-4258-4389-8dd5-75e56a2063f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:54.657856 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539cca0-4258-4389-8dd5-75e56a2063f4 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:54.658127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539cca0-4258-4389-8dd5-75e56a2063f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:54.658391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539cca0-4258-4389-8dd5-75e56a2063f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:54.659026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539cca0-4258-4389-8dd5-75e56a2063f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:54.659324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539cca0-4258-4389-8dd5-75e56a2063f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:54.660684 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539cca0-4258-4389-8dd5-75e56a2063f4 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:54.671920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 256/519] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:54.672716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539cca0-4258-4389-8dd5-75e56a2063f4 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:54.683871 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e94ae1-14fb-4954-89f8-23874e9c467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:54.684465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e94ae1-14fb-4954-89f8-23874e9c467e None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:54.684718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e94ae1-14fb-4954-89f8-23874e9c467e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:54.684980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e94ae1-14fb-4954-89f8-23874e9c467e None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:54.685661 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e94ae1-14fb-4954-89f8-23874e9c467e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:54.687102 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e94ae1-14fb-4954-89f8-23874e9c467e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:54.708253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 264/520] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:02:54 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:02:54.709048 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e94ae1-14fb-4954-89f8-23874e9c467e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:54.785102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539cca0-4258-4389-8dd5-75e56a2063f4 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:54.787261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:54.816136 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:54.826090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fe001-e44f-43ec-91ed-6f46bc64cb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:54.826705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fe001-e44f-43ec-91ed-6f46bc64cb84 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:54.826984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fe001-e44f-43ec-91ed-6f46bc64cb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:54.827253 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fe001-e44f-43ec-91ed-6f46bc64cb84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:54.833809 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e94ae1-14fb-4954-89f8-23874e9c467e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:54.875593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612300cb-462e-49a4-abd9-a4a8ba571b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:54.876138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612300cb-462e-49a4-abd9-a4a8ba571b40 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:54.876417 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612300cb-462e-49a4-abd9-a4a8ba571b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:54.876680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612300cb-462e-49a4-abd9-a4a8ba571b40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:54.885731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612300cb-462e-49a4-abd9-a4a8ba571b40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:54.891640 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612300cb-462e-49a4-abd9-a4a8ba571b40 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-612300cb-462e-49a4-abd9-a4a8ba571b40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:02:54.900650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:54.901568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:54.902396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:02:54.902396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:02:54.902396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:02:54.902396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:02:54.902396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:02:54.902396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:02:54.902396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:02:54.902396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:54.902396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 265/521] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:54.902876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612300cb-462e-49a4-abd9-a4a8ba571b40 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:54.909906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fe001-e44f-43ec-91ed-6f46bc64cb84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:54.911397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fe001-e44f-43ec-91ed-6f46bc64cb84 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:55.013817 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612300cb-462e-49a4-abd9-a4a8ba571b40 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:55.018202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 257/522] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:55.019213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fe001-e44f-43ec-91ed-6f46bc64cb84 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:55.024293 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:55.054835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc46920-2772-4bd7-a296-6a4f31c6b607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:55.055461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc46920-2772-4bd7-a296-6a4f31c6b607 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:55.056003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc46920-2772-4bd7-a296-6a4f31c6b607 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:55.056283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc46920-2772-4bd7-a296-6a4f31c6b607 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:55.056938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc46920-2772-4bd7-a296-6a4f31c6b607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:55.057268 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc46920-2772-4bd7-a296-6a4f31c6b607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:55.058635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc46920-2772-4bd7-a296-6a4f31c6b607 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:55.071193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 266/523] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:55.071921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc46920-2772-4bd7-a296-6a4f31c6b607 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:55.083322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:55.137046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fe001-e44f-43ec-91ed-6f46bc64cb84 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:55.174234 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412aace-b767-4617-b7f2-f8bf86602469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:55.174858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412aace-b767-4617-b7f2-f8bf86602469 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:55.175129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412aace-b767-4617-b7f2-f8bf86602469 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:55.175390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412aace-b767-4617-b7f2-f8bf86602469 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:55.183553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412aace-b767-4617-b7f2-f8bf86602469 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:55.184994 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412aace-b767-4617-b7f2-f8bf86602469 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:55.185911 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc46920-2772-4bd7-a296-6a4f31c6b607 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-1412aace-b767-4617-b7f2-f8bf86602469 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:02:55.197125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:55.198362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:55.199256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:55.199256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:55.199256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:02:55.199256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:02:55.199256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:02:55.199256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:02:55.199256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:02:55.199256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:02:55.199256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:02:55.199256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:55.199256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 258/524] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:02:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:55.199256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412aace-b767-4617-b7f2-f8bf86602469 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:55.231265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291140e7-5af9-4e62-b06a-e3e014264ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:55.231914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291140e7-5af9-4e62-b06a-e3e014264ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:55.232125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291140e7-5af9-4e62-b06a-e3e014264ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:55.232388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291140e7-5af9-4e62-b06a-e3e014264ad4 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:55.233096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291140e7-5af9-4e62-b06a-e3e014264ad4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:55.233386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291140e7-5af9-4e62-b06a-e3e014264ad4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:55.234793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291140e7-5af9-4e62-b06a-e3e014264ad4 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:55.254329 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 267/525] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:55.255009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291140e7-5af9-4e62-b06a-e3e014264ad4 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:55.271872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:55.316125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412aace-b767-4617-b7f2-f8bf86602469 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:55.326820 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:55.351865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc44613-39a7-47af-91d9-97e2a630408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:55.352493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc44613-39a7-47af-91d9-97e2a630408c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:55.352765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc44613-39a7-47af-91d9-97e2a630408c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:55.353032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc44613-39a7-47af-91d9-97e2a630408c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:55.364148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc44613-39a7-47af-91d9-97e2a630408c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:55.365632 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc44613-39a7-47af-91d9-97e2a630408c None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:55.365963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291140e7-5af9-4e62-b06a-e3e014264ad4 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-9cc44613-39a7-47af-91d9-97e2a630408c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:55.380815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:55.381926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:55.382791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:55.382791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:55.382791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:55.382791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 259/526] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:55.382791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc44613-39a7-47af-91d9-97e2a630408c None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:55.405615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf7155-f115-45d4-be63-bdadf6e64455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:55.406221 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf7155-f115-45d4-be63-bdadf6e64455 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:55.406559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf7155-f115-45d4-be63-bdadf6e64455 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:55.406711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf7155-f115-45d4-be63-bdadf6e64455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:55.414631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf7155-f115-45d4-be63-bdadf6e64455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:55.416084 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf7155-f115-45d4-be63-bdadf6e64455 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-4acf7155-f115-45d4-be63-bdadf6e64455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:02:55.428459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:55.429384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:55.430305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:02:55.430305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:02:55.430305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:02:55.430305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:02:55.430305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:02:55.430305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:02:55.430305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:02:55.430305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:55.430305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 268/527] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:55.430794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf7155-f115-45d4-be63-bdadf6e64455 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:55.495844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc44613-39a7-47af-91d9-97e2a630408c None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:55.513656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:55.537867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf7155-f115-45d4-be63-bdadf6e64455 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:55.538089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c594fb-0971-4b79-85cf-fb607cc4b235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:55.538812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c594fb-0971-4b79-85cf-fb607cc4b235 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:55.539086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c594fb-0971-4b79-85cf-fb607cc4b235 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:55.539343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c594fb-0971-4b79-85cf-fb607cc4b235 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:55.540084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c594fb-0971-4b79-85cf-fb607cc4b235 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:55.540379 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c594fb-0971-4b79-85cf-fb607cc4b235 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:55.541849 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c594fb-0971-4b79-85cf-fb607cc4b235 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:55.560243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 260/528] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Aug 31 00:02:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:55.565272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c594fb-0971-4b79-85cf-fb607cc4b235 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:55.576208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:55.585396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241a110-0046-49f2-99d6-1c2807c90e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:55.586007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a110-0046-49f2-99d6-1c2807c90e1b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:55.586279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a110-0046-49f2-99d6-1c2807c90e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:55.586540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a110-0046-49f2-99d6-1c2807c90e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:55.587719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241a110-0046-49f2-99d6-1c2807c90e1b None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=2016ed84211d412481d512eae23d2ab6) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:55.588172 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241a110-0046-49f2-99d6-1c2807c90e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:55.589973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241a110-0046-49f2-99d6-1c2807c90e1b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:55.601245 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 269/529] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:55 2022] GET /identity/v3/role_assignments?user.id=2016ed84211d412481d512eae23d2ab6&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:55.601245 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241a110-0046-49f2-99d6-1c2807c90e1b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:55.706868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c594fb-0971-4b79-85cf-fb607cc4b235 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:55.718158 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241a110-0046-49f2-99d6-1c2807c90e1b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:55.757797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ffeb2-445e-4065-8685-5359154dd3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:55.758416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ffeb2-445e-4065-8685-5359154dd3db None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:55.758691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ffeb2-445e-4065-8685-5359154dd3db None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:55.758959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ffeb2-445e-4065-8685-5359154dd3db None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:55.759648 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ffeb2-445e-4065-8685-5359154dd3db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:55.759954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ffeb2-445e-4065-8685-5359154dd3db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:55.761466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ffeb2-445e-4065-8685-5359154dd3db None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:55.769132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d583417-2854-4112-a2dd-2de3deb44ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:55.769862 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d583417-2854-4112-a2dd-2de3deb44ceb None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:55.770200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d583417-2854-4112-a2dd-2de3deb44ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:55.770540 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d583417-2854-4112-a2dd-2de3deb44ceb None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:55.771255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d583417-2854-4112-a2dd-2de3deb44ceb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:55.771615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d583417-2854-4112-a2dd-2de3deb44ceb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:55.775770 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d583417-2854-4112-a2dd-2de3deb44ceb None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:55.784140 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 270/530] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:55.785003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ffeb2-445e-4065-8685-5359154dd3db None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:55.788329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 261/531] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:55.790681 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d583417-2854-4112-a2dd-2de3deb44ceb None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:55.824152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:55.865100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:55.915732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ffeb2-445e-4065-8685-5359154dd3db None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:55.927986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d583417-2854-4112-a2dd-2de3deb44ceb None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:55.958380 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1f841-28ab-41f3-8016-561a647cc6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:55.958909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1f841-28ab-41f3-8016-561a647cc6bb None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:55.959495 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1f841-28ab-41f3-8016-561a647cc6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:55.959701 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1f841-28ab-41f3-8016-561a647cc6bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:55.972742 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464224f-3259-45b8-86c6-30eedb3c2cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:55.973961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464224f-3259-45b8-86c6-30eedb3c2cab None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:55.974231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464224f-3259-45b8-86c6-30eedb3c2cab None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:55.974494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464224f-3259-45b8-86c6-30eedb3c2cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:55.975263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464224f-3259-45b8-86c6-30eedb3c2cab None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=d967a3fa32ef48b68c9e3a174f0c9a03) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:55.975603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464224f-3259-45b8-86c6-30eedb3c2cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:55.977036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464224f-3259-45b8-86c6-30eedb3c2cab None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:55.987907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 262/532] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:55 2022] GET /identity/v3/role_assignments?user.id=d967a3fa32ef48b68c9e3a174f0c9a03&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:55.989065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464224f-3259-45b8-86c6-30eedb3c2cab None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:56.042166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1f841-28ab-41f3-8016-561a647cc6bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:56.043193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1f841-28ab-41f3-8016-561a647cc6bb None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:56.114647 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:56.145817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:56.157395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464224f-3259-45b8-86c6-30eedb3c2cab None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:56.184268 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 271/533] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:56.190545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1f841-28ab-41f3-8016-561a647cc6bb None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:56.217957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731147ab-fcaf-4133-8f9f-a302c4008aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:56.218517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731147ab-fcaf-4133-8f9f-a302c4008aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:56.218789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731147ab-fcaf-4133-8f9f-a302c4008aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:56.219056 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731147ab-fcaf-4133-8f9f-a302c4008aa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:56.233106 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731147ab-fcaf-4133-8f9f-a302c4008aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:56.234638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731147ab-fcaf-4133-8f9f-a302c4008aa3 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-731147ab-fcaf-4133-8f9f-a302c4008aa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:02:56.251156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:56.252062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:56.252919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:02:56.252919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:02:56.252919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:02:56.252919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:02:56.252919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:02:56.252919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:02:56.252919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:02:56.252919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:56.252919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 263/534] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:56.258586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731147ab-fcaf-4133-8f9f-a302c4008aa3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:56.339150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1f841-28ab-41f3-8016-561a647cc6bb None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:56.383205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff8add-5a85-454a-840e-1b8612b5b80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:56.385712 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff8add-5a85-454a-840e-1b8612b5b80d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:56.389809 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff8add-5a85-454a-840e-1b8612b5b80d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:56.390321 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff8add-5a85-454a-840e-1b8612b5b80d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:56.414097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff8add-5a85-454a-840e-1b8612b5b80d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:56.415575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff8add-5a85-454a-840e-1b8612b5b80d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-c2ff8add-5a85-454a-840e-1b8612b5b80d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:56.450654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:56.451632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:56.452459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:56.452459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:56.452459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:56.456189 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 272/535] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:56.462185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff8add-5a85-454a-840e-1b8612b5b80d None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:56.469729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731147ab-fcaf-4133-8f9f-a302c4008aa3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:56.471017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:56.514022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6a623-c2ff-4c8c-a5c9-72d77e57caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:56.515899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6a623-c2ff-4c8c-a5c9-72d77e57caa7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:56.519454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6a623-c2ff-4c8c-a5c9-72d77e57caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:56.519933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6a623-c2ff-4c8c-a5c9-72d77e57caa7 None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:56.520834 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6a623-c2ff-4c8c-a5c9-72d77e57caa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:56.521376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6a623-c2ff-4c8c-a5c9-72d77e57caa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:56.523458 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6a623-c2ff-4c8c-a5c9-72d77e57caa7 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:56.557050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 264/536] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:56.562727 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6a623-c2ff-4c8c-a5c9-72d77e57caa7 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:56.601483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:56.620495 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff8add-5a85-454a-840e-1b8612b5b80d None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:56.694732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fb32e-5ea4-46e2-ba2d-97a69251c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:56.695183 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fb32e-5ea4-46e2-ba2d-97a69251c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:56.695460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fb32e-5ea4-46e2-ba2d-97a69251c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:56.695729 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fb32e-5ea4-46e2-ba2d-97a69251c2d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:56.696380 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fb32e-5ea4-46e2-ba2d-97a69251c2d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:56.696679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fb32e-5ea4-46e2-ba2d-97a69251c2d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:56.698069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fb32e-5ea4-46e2-ba2d-97a69251c2d6 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:56.716826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 273/537] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:56.718128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d15d09-88ef-492b-9b55-00fa91a316df None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:56.718409 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d15d09-88ef-492b-9b55-00fa91a316df None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:56.718680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d15d09-88ef-492b-9b55-00fa91a316df None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:56.719995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 274/538] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:56.724497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d15d09-88ef-492b-9b55-00fa91a316df None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:56.735018 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6a623-c2ff-4c8c-a5c9-72d77e57caa7 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:56.780668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bccbb4-3c83-490d-8c6b-7a3633c33231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:56.781293 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bccbb4-3c83-490d-8c6b-7a3633c33231 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:56.781565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bccbb4-3c83-490d-8c6b-7a3633c33231 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:56.781828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bccbb4-3c83-490d-8c6b-7a3633c33231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:56.783070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bccbb4-3c83-490d-8c6b-7a3633c33231 None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=6414692e72024816a99d63234f7c233f) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:56.783506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bccbb4-3c83-490d-8c6b-7a3633c33231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:56.785346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bccbb4-3c83-490d-8c6b-7a3633c33231 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:56.792558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:56.794918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 265/539] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:56 2022] GET /identity/v3/role_assignments?user.id=6414692e72024816a99d63234f7c233f&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:02:56.796147 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df87f4-fcde-4767-893a-03613693cd74 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:56.796587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df87f4-fcde-4767-893a-03613693cd74 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:56.797116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df87f4-fcde-4767-893a-03613693cd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:56.823881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-b7df87f4-fcde-4767-893a-03613693cd74 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:56.825646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b7df87f4-fcde-4767-893a-03613693cd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:56.836671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d15d09-88ef-492b-9b55-00fa91a316df None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:56.906320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 266/540] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:56.942703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136ef97-d65d-491a-babd-cd3fa61c517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:56.943374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136ef97-d65d-491a-babd-cd3fa61c517f None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:56.943651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136ef97-d65d-491a-babd-cd3fa61c517f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:56.943949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136ef97-d65d-491a-babd-cd3fa61c517f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:56.962579 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136ef97-d65d-491a-babd-cd3fa61c517f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:56.964075 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136ef97-d65d-491a-babd-cd3fa61c517f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-4136ef97-d65d-491a-babd-cd3fa61c517f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:02:56.983452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:56.984347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:56.985200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:02:56.985200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:02:56.985200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:02:56.985200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:02:56.985200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:02:56.985200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:02:56.985200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:02:56.985200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:56.985653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 275/541] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:56.990374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df87f4-fcde-4767-893a-03613693cd74 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:57.010174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:57.119090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df87f4-fcde-4767-893a-03613693cd74 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:57.160618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6164a-e3e4-487c-b251-e8f46391d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:57.161386 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6164a-e3e4-487c-b251-e8f46391d3cd None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:57.161549 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6164a-e3e4-487c-b251-e8f46391d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:57.161812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6164a-e3e4-487c-b251-e8f46391d3cd None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:57.162499 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6164a-e3e4-487c-b251-e8f46391d3cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:57.162883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6164a-e3e4-487c-b251-e8f46391d3cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:57.164280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6164a-e3e4-487c-b251-e8f46391d3cd None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:57.181590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 267/542] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:57.182353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136ef97-d65d-491a-babd-cd3fa61c517f None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:57.227040 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6164a-e3e4-487c-b251-e8f46391d3cd None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:57.313388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136ef97-d65d-491a-babd-cd3fa61c517f None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:57.328851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:57.368768 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6164a-e3e4-487c-b251-e8f46391d3cd None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:57.370095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:57.402479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2a626-124a-460a-b859-504659fcdc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:57.403095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2a626-124a-460a-b859-504659fcdc7b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:57.403373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2a626-124a-460a-b859-504659fcdc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:57.403644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2a626-124a-460a-b859-504659fcdc7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:57.404372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2a626-124a-460a-b859-504659fcdc7b None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=d4f2b852544b450a86fdcb5fa18fd290) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:57.404680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2a626-124a-460a-b859-504659fcdc7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:57.406479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2a626-124a-460a-b859-504659fcdc7b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:57.413336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 276/543] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:02:57 2022] GET /identity/v3/role_assignments?user.id=d4f2b852544b450a86fdcb5fa18fd290&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:57.420157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c34fe-94f8-43d8-be62-175988c163ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:57.420815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c34fe-94f8-43d8-be62-175988c163ec None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:57.421088 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c34fe-94f8-43d8-be62-175988c163ec None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:57.421397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c34fe-94f8-43d8-be62-175988c163ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:57.433148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c34fe-94f8-43d8-be62-175988c163ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-898c34fe-94f8-43d8-be62-175988c163ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:57.438514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:57.439392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:57.440179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:57.440179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:57.440179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:57.440179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:57.440179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:57.440179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:57.440179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:57.440179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:57.440179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:57.440179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:57.440179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:57.440179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:57.440179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 268/544] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:02:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:57.450467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2a626-124a-460a-b859-504659fcdc7b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:57.565467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2a626-124a-460a-b859-504659fcdc7b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:57.602834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5bcca-99c1-46d3-bcf4-002e97baca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:57.603502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5bcca-99c1-46d3-bcf4-002e97baca2e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:57.603786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5bcca-99c1-46d3-bcf4-002e97baca2e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:57.604056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5bcca-99c1-46d3-bcf4-002e97baca2e None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:57.604727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5bcca-99c1-46d3-bcf4-002e97baca2e None admin] RBAC: Adding query filter params (name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:57.605028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5bcca-99c1-46d3-bcf4-002e97baca2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:57.606507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5bcca-99c1-46d3-bcf4-002e97baca2e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:57.615998 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 277/545] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:02:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:57.622210 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c34fe-94f8-43d8-be62-175988c163ec None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:57.747678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c34fe-94f8-43d8-be62-175988c163ec None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:57.778995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:57.787109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b42a8-2487-4577-afca-d89fa438c31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:57.787891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b42a8-2487-4577-afca-d89fa438c31a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:57.788167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b42a8-2487-4577-afca-d89fa438c31a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:57.788437 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b42a8-2487-4577-afca-d89fa438c31a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:57.804848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b42a8-2487-4577-afca-d89fa438c31a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:57.805803 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b42a8-2487-4577-afca-d89fa438c31a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-9f5b42a8-2487-4577-afca-d89fa438c31a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:57.829035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:57.830004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:57.830841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:57.830841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:57.830841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:57.830841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 269/546] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:57.838332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5bcca-99c1-46d3-bcf4-002e97baca2e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:57.905628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:57.974164 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5bcca-99c1-46d3-bcf4-002e97baca2e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:58.028414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184a093-0fe1-4782-8219-78b1eed21278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:58.029035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a093-0fe1-4782-8219-78b1eed21278 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:58.029342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a093-0fe1-4782-8219-78b1eed21278 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:58.029612 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a093-0fe1-4782-8219-78b1eed21278 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:58.030578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184a093-0fe1-4782-8219-78b1eed21278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:58.030875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184a093-0fe1-4782-8219-78b1eed21278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:58.032251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184a093-0fe1-4782-8219-78b1eed21278 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:58.048770 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 278/547] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:58.054348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b42a8-2487-4577-afca-d89fa438c31a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:58.101237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31105c9-195b-41a0-a8a9-23f2271e1878 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:58.101237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31105c9-195b-41a0-a8a9-23f2271e1878 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:58.101237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31105c9-195b-41a0-a8a9-23f2271e1878 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:58.101237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 279/548] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:58.106460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5cd03-38ac-46e2-9316-5b5114c2c530 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:58.106840 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5cd03-38ac-46e2-9316-5b5114c2c530 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:58.107210 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5cd03-38ac-46e2-9316-5b5114c2c530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:58.131895 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-15e5cd03-38ac-46e2-9316-5b5114c2c530 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:58.133090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-15e5cd03-38ac-46e2-9316-5b5114c2c530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:58.210906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b42a8-2487-4577-afca-d89fa438c31a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:58.249913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b02eda-2381-493d-8b59-db810abf2185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:58.250546 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b02eda-2381-493d-8b59-db810abf2185 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:58.250820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b02eda-2381-493d-8b59-db810abf2185 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:58.251083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b02eda-2381-493d-8b59-db810abf2185 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:58.259330 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b02eda-2381-493d-8b59-db810abf2185 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:58.260855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b02eda-2381-493d-8b59-db810abf2185 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-71b02eda-2381-493d-8b59-db810abf2185 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:02:58.272815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:58.274676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:58.275957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:58.275957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:58.275957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:02:58.275957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:02:58.275957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:02:58.275957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:02:58.275957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:02:58.275957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:02:58.275957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:02:58.275957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:58.275957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 270/549] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:02:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:02:58.275957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b37581-70a1-4214-bb34-a2511cb721a2 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:58.275957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b37581-70a1-4214-bb34-a2511cb721a2 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:58.276653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b37581-70a1-4214-bb34-a2511cb721a2 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:58.278331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 271/550] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:58.281227 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b37581-70a1-4214-bb34-a2511cb721a2 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:58.286569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 280/551] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:58.288415 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad56fca-3210-4574-93b7-b3197eced1d8 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:58.288759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad56fca-3210-4574-93b7-b3197eced1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:58.289032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad56fca-3210-4574-93b7-b3197eced1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:58.317242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7ad56fca-3210-4574-93b7-b3197eced1d8 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:58.317879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7ad56fca-3210-4574-93b7-b3197eced1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:58.381331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:58.393228 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:58.457233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 281/552] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:58.502869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b37581-70a1-4214-bb34-a2511cb721a2 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:58.558638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac74cb-b6d9-4dbb-bf54-9ed96bd942cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:58.559291 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac74cb-b6d9-4dbb-bf54-9ed96bd942cd None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:58.559566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac74cb-b6d9-4dbb-bf54-9ed96bd942cd None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:58.559836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac74cb-b6d9-4dbb-bf54-9ed96bd942cd None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:58.560561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac74cb-b6d9-4dbb-bf54-9ed96bd942cd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:58.560911 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac74cb-b6d9-4dbb-bf54-9ed96bd942cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:58.562358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac74cb-b6d9-4dbb-bf54-9ed96bd942cd None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:58.595991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 272/553] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 31 00:02:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:58.602164 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad56fca-3210-4574-93b7-b3197eced1d8 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:58.773234 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac74cb-b6d9-4dbb-bf54-9ed96bd942cd None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:58.781546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad56fca-3210-4574-93b7-b3197eced1d8 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:58.858152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa1c79-13be-452b-9410-99c672263f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:58.858839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1c79-13be-452b-9410-99c672263f02 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:58.859116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1c79-13be-452b-9410-99c672263f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:58.859383 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1c79-13be-452b-9410-99c672263f02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:58.927686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:58.955987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa1c79-13be-452b-9410-99c672263f02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:58.957856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa1c79-13be-452b-9410-99c672263f02 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:58.963022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:58.966837 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac74cb-b6d9-4dbb-bf54-9ed96bd942cd None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:59.004021 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfa57b-4b9a-4f00-8e39-05a60f72e0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:59.004698 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfa57b-4b9a-4f00-8e39-05a60f72e0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:59.005017 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfa57b-4b9a-4f00-8e39-05a60f72e0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:59.005304 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfa57b-4b9a-4f00-8e39-05a60f72e0d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:59.017301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfa57b-4b9a-4f00-8e39-05a60f72e0d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-67dfa57b-4b9a-4f00-8e39-05a60f72e0d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:59.022579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:59.023932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:59.024772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:59.024772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:59.024772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:59.024772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:59.024772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:59.024772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:59.024772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:59.024772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:59.024772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:59.024772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:59.024772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:59.024772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:59.029002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 273/554] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:02:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:59.030388 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfa57b-4b9a-4f00-8e39-05a60f72e0d0 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:59.071549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 282/555] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:02:59.072921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa1c79-13be-452b-9410-99c672263f02 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:59.146045 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:59.148318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfa57b-4b9a-4f00-8e39-05a60f72e0d0 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:59.179490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa1c79-13be-452b-9410-99c672263f02 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:59.186681 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e7e50-cf4b-4ae0-a891-7b492161a9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:59.187316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e7e50-cf4b-4ae0-a891-7b492161a9bd None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:59.187589 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e7e50-cf4b-4ae0-a891-7b492161a9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:59.187856 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e7e50-cf4b-4ae0-a891-7b492161a9bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:59.199477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e7e50-cf4b-4ae0-a891-7b492161a9bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-ec3e7e50-cf4b-4ae0-a891-7b492161a9bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:02:59.204368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:59.205415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:59.206228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:59.206228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:59.206228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:59.206228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:59.206228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:02:59.206228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:02:59.206228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:02:59.206228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:02:59.206228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:02:59.206228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:02:59.206228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:02:59.206228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:59.209532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 274/556] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:02:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:59.210464 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e7e50-cf4b-4ae0-a891-7b492161a9bd None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:59.220747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fff33-0eda-43cb-82db-b20fbcd15628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:59.221726 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fff33-0eda-43cb-82db-b20fbcd15628 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:59.222204 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fff33-0eda-43cb-82db-b20fbcd15628 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:59.222687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fff33-0eda-43cb-82db-b20fbcd15628 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:59.223623 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fff33-0eda-43cb-82db-b20fbcd15628 None admin] RBAC: Adding query filter params (name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:59.224162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fff33-0eda-43cb-82db-b20fbcd15628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:59.225965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fff33-0eda-43cb-82db-b20fbcd15628 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:59.234841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:59.235734 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 283/557] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:02:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:59.236798 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fff33-0eda-43cb-82db-b20fbcd15628 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:59.334063 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e7e50-cf4b-4ae0-a891-7b492161a9bd None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:59.342473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fff33-0eda-43cb-82db-b20fbcd15628 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:59.368787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9582f8b-69ba-4f09-a5ad-53b8e36dc122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:59.369439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9582f8b-69ba-4f09-a5ad-53b8e36dc122 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:59.370005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9582f8b-69ba-4f09-a5ad-53b8e36dc122 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:59.370005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9582f8b-69ba-4f09-a5ad-53b8e36dc122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:59.375078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:59.380808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9582f8b-69ba-4f09-a5ad-53b8e36dc122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:59.381436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa23ee0-f18b-449c-b71c-6ab1857ea873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:59.382353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa23ee0-f18b-449c-b71c-6ab1857ea873 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:59.382830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9582f8b-69ba-4f09-a5ad-53b8e36dc122 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:59.383015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa23ee0-f18b-449c-b71c-6ab1857ea873 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:59.383615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa23ee0-f18b-449c-b71c-6ab1857ea873 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:59.384524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa23ee0-f18b-449c-b71c-6ab1857ea873 None admin] RBAC: Adding query filter params (name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:59.384980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa23ee0-f18b-449c-b71c-6ab1857ea873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:59.386586 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa23ee0-f18b-449c-b71c-6ab1857ea873 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:59.395889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 284/558] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:02:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:59.397095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa23ee0-f18b-449c-b71c-6ab1857ea873 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-b9582f8b-69ba-4f09-a5ad-53b8e36dc122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:59.397634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:59.398531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:59.399405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:59.399405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:59.399405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:59.403415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 275/559] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:59.404572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85545c8-9c5b-491c-badc-52ffcfb85d2f None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:59.405161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85545c8-9c5b-491c-badc-52ffcfb85d2f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:59.405466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85545c8-9c5b-491c-badc-52ffcfb85d2f None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:59.406707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 276/560] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:59.407392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85545c8-9c5b-491c-badc-52ffcfb85d2f None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:59.495444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:59.520603 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa23ee0-f18b-449c-b71c-6ab1857ea873 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:59.532418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85545c8-9c5b-491c-badc-52ffcfb85d2f None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:59.558468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29696f48-4d7f-4873-8b19-fdc99f2aacb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:59.559112 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29696f48-4d7f-4873-8b19-fdc99f2aacb5 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:59.559393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29696f48-4d7f-4873-8b19-fdc99f2aacb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:59.559663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29696f48-4d7f-4873-8b19-fdc99f2aacb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:59.571162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29696f48-4d7f-4873-8b19-fdc99f2aacb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:59.572627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29696f48-4d7f-4873-8b19-fdc99f2aacb5 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:59.573266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417723fc-d26e-418d-af63-83f390b5f0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:59.573886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417723fc-d26e-418d-af63-83f390b5f0ab None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:59.574154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417723fc-d26e-418d-af63-83f390b5f0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:59.574579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417723fc-d26e-418d-af63-83f390b5f0ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:59.586746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417723fc-d26e-418d-af63-83f390b5f0ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-29696f48-4d7f-4873-8b19-fdc99f2aacb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:59.587665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:59.588669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:59.589580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:59.589580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:59.589580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:02:59.590400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417723fc-d26e-418d-af63-83f390b5f0ab None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:59.590493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 285/561] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:59.590493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29696f48-4d7f-4873-8b19-fdc99f2aacb5 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-417723fc-d26e-418d-af63-83f390b5f0ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:02:59.607946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:02:59.609002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:02:59.609915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:02:59.609915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:02:59.609915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:02:59.613649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 277/562] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:02:59.614858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c198eb8-1210-4c4b-b65c-1506cf8e6aca None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:59.615068 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c198eb8-1210-4c4b-b65c-1506cf8e6aca None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:59.615307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c198eb8-1210-4c4b-b65c-1506cf8e6aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:59.635584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-1c198eb8-1210-4c4b-b65c-1506cf8e6aca None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:02:59.636783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1c198eb8-1210-4c4b-b65c-1506cf8e6aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:02:59.646799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:59.704799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29696f48-4d7f-4873-8b19-fdc99f2aacb5 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:59.717390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 278/563] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:02:59.717390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c198eb8-1210-4c4b-b65c-1506cf8e6aca None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:59.750866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5dac1-8fa1-4592-a2b3-557e4a1d8999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:59.752215 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5dac1-8fa1-4592-a2b3-557e4a1d8999 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:59.752215 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5dac1-8fa1-4592-a2b3-557e4a1d8999 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:59.752428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5dac1-8fa1-4592-a2b3-557e4a1d8999 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:59.753090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5dac1-8fa1-4592-a2b3-557e4a1d8999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:59.753495 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5dac1-8fa1-4592-a2b3-557e4a1d8999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:59.754923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5dac1-8fa1-4592-a2b3-557e4a1d8999 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:59.768471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 286/564] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:59.769350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5dac1-8fa1-4592-a2b3-557e4a1d8999 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:59.775263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:59.823387 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c198eb8-1210-4c4b-b65c-1506cf8e6aca None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:59.861128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9979e46-c299-423c-a958-7a4218e837a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:59.861985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9979e46-c299-423c-a958-7a4218e837a1 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:59.862435 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9979e46-c299-423c-a958-7a4218e837a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:59.862845 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9979e46-c299-423c-a958-7a4218e837a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:59.863742 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9979e46-c299-423c-a958-7a4218e837a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:59.864199 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9979e46-c299-423c-a958-7a4218e837a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:59.865797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9979e46-c299-423c-a958-7a4218e837a1 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:59.878228 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5dac1-8fa1-4592-a2b3-557e4a1d8999 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:02:59.878439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 279/565] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:59.879437 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9979e46-c299-423c-a958-7a4218e837a1 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:59.887015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:02:59.918887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a7015-cc28-47aa-8bf5-5e59a2c9e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:02:59.919508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a7015-cc28-47aa-8bf5-5e59a2c9e155 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:59.919783 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a7015-cc28-47aa-8bf5-5e59a2c9e155 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:59.920051 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a7015-cc28-47aa-8bf5-5e59a2c9e155 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:59.920807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a7015-cc28-47aa-8bf5-5e59a2c9e155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:02:59.921113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a7015-cc28-47aa-8bf5-5e59a2c9e155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:02:59.922618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a7015-cc28-47aa-8bf5-5e59a2c9e155 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:02:59.939200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 287/566] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:02:59.939200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0028a-97f6-459f-b1d7-90543d4654c1 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:02:59.939200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0028a-97f6-459f-b1d7-90543d4654c1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:02:59.939200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0028a-97f6-459f-b1d7-90543d4654c1 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:02:59.939200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 288/567] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:02:59.939200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0028a-97f6-459f-b1d7-90543d4654c1 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:02:59.988661 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9979e46-c299-423c-a958-7a4218e837a1 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:00.002581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:00.024596 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9ebc6-e557-4b0c-9c57-e0ca3eac04e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:00.025227 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9ebc6-e557-4b0c-9c57-e0ca3eac04e7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:00.025518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9ebc6-e557-4b0c-9c57-e0ca3eac04e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:00.025782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9ebc6-e557-4b0c-9c57-e0ca3eac04e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:00.032722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9ebc6-e557-4b0c-9c57-e0ca3eac04e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:00.034173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9ebc6-e557-4b0c-9c57-e0ca3eac04e7 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-dff9ebc6-e557-4b0c-9c57-e0ca3eac04e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:00.045157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:00.046238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:00.047325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:00.047325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:00.047325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:00.047325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:00.047325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:00.047325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:00.047325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:00.047325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:00.047325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 280/568] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:00.047325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9ebc6-e557-4b0c-9c57-e0ca3eac04e7 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:00.052641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0028a-97f6-459f-b1d7-90543d4654c1 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:00.086486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d8bd9-4ffa-4ad5-a182-e2b7376fc636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:00.087111 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d8bd9-4ffa-4ad5-a182-e2b7376fc636 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:00.087380 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d8bd9-4ffa-4ad5-a182-e2b7376fc636 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:00.087641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d8bd9-4ffa-4ad5-a182-e2b7376fc636 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:00.095318 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d8bd9-4ffa-4ad5-a182-e2b7376fc636 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:00.096745 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d8bd9-4ffa-4ad5-a182-e2b7376fc636 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-ff8d8bd9-4ffa-4ad5-a182-e2b7376fc636 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:00.109496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:00.110467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:00.111737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:00.111737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:00.111737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:00.111737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:00.111737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:00.111737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:00.111737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:00.111737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:00.111737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:00.111737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:00.111737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 289/569] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 31 00:02:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:00.112375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a002b0-16f8-481d-a43d-4278a6002504 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:00.112375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a002b0-16f8-481d-a43d-4278a6002504 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:00.112497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a002b0-16f8-481d-a43d-4278a6002504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:00.130203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-82a002b0-16f8-481d-a43d-4278a6002504 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:00.131420 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-82a002b0-16f8-481d-a43d-4278a6002504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:00.151477 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:00.159103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9ebc6-e557-4b0c-9c57-e0ca3eac04e7 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:00.194538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c71eb-99a5-47dd-baae-a4dcc0381a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:00.195153 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c71eb-99a5-47dd-baae-a4dcc0381a4a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:00.195422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c71eb-99a5-47dd-baae-a4dcc0381a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:00.195687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c71eb-99a5-47dd-baae-a4dcc0381a4a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:00.198292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 290/570] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:03:00.199125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a002b0-16f8-481d-a43d-4278a6002504 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:00.203836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c71eb-99a5-47dd-baae-a4dcc0381a4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:00.205283 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c71eb-99a5-47dd-baae-a4dcc0381a4a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-c97c71eb-99a5-47dd-baae-a4dcc0381a4a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:00.216997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:00.218144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:00.219230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:00.219230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:00.219230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:00.219230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:00.219230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:00.219230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:00.219230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:00.219230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:00.219230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:03:00.219230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:00.219230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 281/571] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:03:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:00.219230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c71eb-99a5-47dd-baae-a4dcc0381a4a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:00.260076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:00.314452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a002b0-16f8-481d-a43d-4278a6002504 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:00.340807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c71eb-99a5-47dd-baae-a4dcc0381a4a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:00.351186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d14ee-7314-4445-97cf-882dc06c5397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:00.351819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d14ee-7314-4445-97cf-882dc06c5397 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:00.352095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d14ee-7314-4445-97cf-882dc06c5397 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:00.352363 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d14ee-7314-4445-97cf-882dc06c5397 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:00.362927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d14ee-7314-4445-97cf-882dc06c5397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-a29d14ee-7314-4445-97cf-882dc06c5397 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:00.368012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:00.368987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 291/572] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:00.370297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d14ee-7314-4445-97cf-882dc06c5397 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:00.382803 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed71d2-df0e-4d3d-96fc-0fb36ceb0675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:00.383529 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed71d2-df0e-4d3d-96fc-0fb36ceb0675 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:00.383810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed71d2-df0e-4d3d-96fc-0fb36ceb0675 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:00.384077 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed71d2-df0e-4d3d-96fc-0fb36ceb0675 None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:00.384828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed71d2-df0e-4d3d-96fc-0fb36ceb0675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:00.385166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed71d2-df0e-4d3d-96fc-0fb36ceb0675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:00.386639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed71d2-df0e-4d3d-96fc-0fb36ceb0675 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:00.393250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:00.399667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 282/573] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:00.400548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed71d2-df0e-4d3d-96fc-0fb36ceb0675 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:00.489045 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d14ee-7314-4445-97cf-882dc06c5397 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:00.498780 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:00.505893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed71d2-df0e-4d3d-96fc-0fb36ceb0675 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:00.525024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb11d3-c4b6-48f3-9f1a-1d45ca263904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:00.525663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb11d3-c4b6-48f3-9f1a-1d45ca263904 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:00.525925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb11d3-c4b6-48f3-9f1a-1d45ca263904 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:00.526196 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb11d3-c4b6-48f3-9f1a-1d45ca263904 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:00.526923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb11d3-c4b6-48f3-9f1a-1d45ca263904 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:00.527225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb11d3-c4b6-48f3-9f1a-1d45ca263904 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:00.528639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb11d3-c4b6-48f3-9f1a-1d45ca263904 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:00.540059 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164aadf-595b-4a36-abfe-0c19a88affde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:00.540659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164aadf-595b-4a36-abfe-0c19a88affde None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:00.540934 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164aadf-595b-4a36-abfe-0c19a88affde None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:00.541221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164aadf-595b-4a36-abfe-0c19a88affde None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:00.541950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164aadf-595b-4a36-abfe-0c19a88affde None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:00.542251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164aadf-595b-4a36-abfe-0c19a88affde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:00.543739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164aadf-595b-4a36-abfe-0c19a88affde None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:00.546859 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 292/574] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 31 00:03:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:00.547669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb11d3-c4b6-48f3-9f1a-1d45ca263904 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:00.562358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 283/575] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 31 00:03:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:00.563213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164aadf-595b-4a36-abfe-0c19a88affde None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:00.629049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:00.654696 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb11d3-c4b6-48f3-9f1a-1d45ca263904 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:00.668727 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164aadf-595b-4a36-abfe-0c19a88affde None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:00.690462 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eef015-c86b-45b0-96ff-8c42a2ec9140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:00.691139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eef015-c86b-45b0-96ff-8c42a2ec9140 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:00.691410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eef015-c86b-45b0-96ff-8c42a2ec9140 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:00.691699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eef015-c86b-45b0-96ff-8c42a2ec9140 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:00.692347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eef015-c86b-45b0-96ff-8c42a2ec9140 None admin] RBAC: Adding query filter params (name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:00.692645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eef015-c86b-45b0-96ff-8c42a2ec9140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:00.694055 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eef015-c86b-45b0-96ff-8c42a2ec9140 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:00.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 293/576] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:00.702693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eef015-c86b-45b0-96ff-8c42a2ec9140 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:00.703966 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78499fdb-a342-4b25-9e84-131d702fb5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:00.704630 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78499fdb-a342-4b25-9e84-131d702fb5be None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:00.704964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78499fdb-a342-4b25-9e84-131d702fb5be None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:00.705318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78499fdb-a342-4b25-9e84-131d702fb5be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:00.706067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78499fdb-a342-4b25-9e84-131d702fb5be None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=85c5a65170b046d08b0d1f01c6550730) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:00.706377 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78499fdb-a342-4b25-9e84-131d702fb5be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:00.708041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78499fdb-a342-4b25-9e84-131d702fb5be None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:00.713653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 284/577] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:00 2022] GET /identity/v3/role_assignments?user.id=85c5a65170b046d08b0d1f01c6550730&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:00.714435 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78499fdb-a342-4b25-9e84-131d702fb5be None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:00.745264 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:00.816336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eef015-c86b-45b0-96ff-8c42a2ec9140 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:00.843965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78499fdb-a342-4b25-9e84-131d702fb5be None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:00.853979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d207f94-903c-4326-9f11-84b54156aa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:00.854705 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d207f94-903c-4326-9f11-84b54156aa6e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:00.855068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d207f94-903c-4326-9f11-84b54156aa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:00.855398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d207f94-903c-4326-9f11-84b54156aa6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:00.858272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:00.867945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d207f94-903c-4326-9f11-84b54156aa6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-0d207f94-903c-4326-9f11-84b54156aa6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:00.873345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:00.874333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 294/578] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:00.876160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d207f94-903c-4326-9f11-84b54156aa6e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:00.888735 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d111a0c-7379-4b28-93a0-b4d876f784fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:00.889379 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d111a0c-7379-4b28-93a0-b4d876f784fd None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:00.889665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d111a0c-7379-4b28-93a0-b4d876f784fd None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:00.889939 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d111a0c-7379-4b28-93a0-b4d876f784fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:00.901492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d111a0c-7379-4b28-93a0-b4d876f784fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:00.903280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d111a0c-7379-4b28-93a0-b4d876f784fd None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-3d111a0c-7379-4b28-93a0-b4d876f784fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:00.919590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:00.920740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:00.921876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:00.921876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:00.921876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:00.927931 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 285/579] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:00.929411 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d111a0c-7379-4b28-93a0-b4d876f784fd None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:00.994055 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d207f94-903c-4326-9f11-84b54156aa6e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:01.002174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:01.032365 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f8d24-ecaf-4311-bbe4-670651e766b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:01.033158 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f8d24-ecaf-4311-bbe4-670651e766b8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:01.033585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f8d24-ecaf-4311-bbe4-670651e766b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:01.033993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f8d24-ecaf-4311-bbe4-670651e766b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:01.039578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d111a0c-7379-4b28-93a0-b4d876f784fd None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:01.046858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f8d24-ecaf-4311-bbe4-670651e766b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:01.048405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f8d24-ecaf-4311-bbe4-670651e766b8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-cd6f8d24-ecaf-4311-bbe4-670651e766b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:01.063145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:01.064261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:01.065389 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:01.065389 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:01.065389 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:01.069597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 295/580] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:01.070448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f8d24-ecaf-4311-bbe4-670651e766b8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:01.082173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a755a7-81cd-4695-8fde-106f38844867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:01.083071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a755a7-81cd-4695-8fde-106f38844867 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:01.083408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a755a7-81cd-4695-8fde-106f38844867 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:01.083851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a755a7-81cd-4695-8fde-106f38844867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:01.100170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a755a7-81cd-4695-8fde-106f38844867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:01.102171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a755a7-81cd-4695-8fde-106f38844867 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-85a755a7-81cd-4695-8fde-106f38844867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:01.117146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:01.118154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:01.119041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:01.119041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:01.119041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:01.122891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 286/581] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:01.123707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a755a7-81cd-4695-8fde-106f38844867 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:01.128686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:01.190216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f8d24-ecaf-4311-bbe4-670651e766b8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:01.227360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd694d-84af-476e-97d1-0fd11c45535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:01.227989 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd694d-84af-476e-97d1-0fd11c45535a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:01.228286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd694d-84af-476e-97d1-0fd11c45535a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:01.228492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd694d-84af-476e-97d1-0fd11c45535a None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:01.229150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd694d-84af-476e-97d1-0fd11c45535a None admin] RBAC: Adding query filter params (name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:01.229477 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd694d-84af-476e-97d1-0fd11c45535a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:01.230899 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd694d-84af-476e-97d1-0fd11c45535a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:01.233407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a755a7-81cd-4695-8fde-106f38844867 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:01.239645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 296/582] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:03:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:01.242171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd694d-84af-476e-97d1-0fd11c45535a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:01.257190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:01.272956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe15d8-7bff-4605-b99d-2a1adec31595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:01.273658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe15d8-7bff-4605-b99d-2a1adec31595 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:01.273850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe15d8-7bff-4605-b99d-2a1adec31595 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:01.274117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe15d8-7bff-4605-b99d-2a1adec31595 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:01.274752 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe15d8-7bff-4605-b99d-2a1adec31595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:01.275048 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe15d8-7bff-4605-b99d-2a1adec31595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:01.276421 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe15d8-7bff-4605-b99d-2a1adec31595 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:01.289571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 287/583] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:01.294711 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe15d8-7bff-4605-b99d-2a1adec31595 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:01.354143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd694d-84af-476e-97d1-0fd11c45535a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:01.365491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:01.389956 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f3bab-0ac7-4182-9ec4-10ba9fd6c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:01.390608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f3bab-0ac7-4182-9ec4-10ba9fd6c902 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:01.390823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f3bab-0ac7-4182-9ec4-10ba9fd6c902 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:01.391086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f3bab-0ac7-4182-9ec4-10ba9fd6c902 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:01.391962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f3bab-0ac7-4182-9ec4-10ba9fd6c902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:01.392069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f3bab-0ac7-4182-9ec4-10ba9fd6c902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:01.393375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f3bab-0ac7-4182-9ec4-10ba9fd6c902 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:01.401268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe15d8-7bff-4605-b99d-2a1adec31595 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:01.406681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 297/584] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:01.411443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f3bab-0ac7-4182-9ec4-10ba9fd6c902 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:01.439831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c20885-cf79-4374-86a5-fa761acb79bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:01.440546 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20885-cf79-4374-86a5-fa761acb79bd None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:01.440770 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20885-cf79-4374-86a5-fa761acb79bd None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:01.441044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20885-cf79-4374-86a5-fa761acb79bd None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:01.441728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c20885-cf79-4374-86a5-fa761acb79bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:01.442025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c20885-cf79-4374-86a5-fa761acb79bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:01.443433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c20885-cf79-4374-86a5-fa761acb79bd None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:01.455470 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 288/585] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:01.456285 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c20885-cf79-4374-86a5-fa761acb79bd None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:01.500871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:01.527344 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f3bab-0ac7-4182-9ec4-10ba9fd6c902 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:01.562027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c20885-cf79-4374-86a5-fa761acb79bd None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:01.564746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de0092-6805-40c0-9a9e-0ab127441cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:01.565418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de0092-6805-40c0-9a9e-0ab127441cbb None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:01.565691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de0092-6805-40c0-9a9e-0ab127441cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:01.565954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de0092-6805-40c0-9a9e-0ab127441cbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:01.577531 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de0092-6805-40c0-9a9e-0ab127441cbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:01.579004 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de0092-6805-40c0-9a9e-0ab127441cbb None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-f7de0092-6805-40c0-9a9e-0ab127441cbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:01.593957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:01.594949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:01.595834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:01.595834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:01.595834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:01.595834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 298/586] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:01.596599 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de0092-6805-40c0-9a9e-0ab127441cbb None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:01.601491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c075ad-1d54-4cdc-b60b-cb3cb2283419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:01.602130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c075ad-1d54-4cdc-b60b-cb3cb2283419 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:01.602401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c075ad-1d54-4cdc-b60b-cb3cb2283419 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:01.602664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c075ad-1d54-4cdc-b60b-cb3cb2283419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:01.609797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c075ad-1d54-4cdc-b60b-cb3cb2283419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:01.611352 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c075ad-1d54-4cdc-b60b-cb3cb2283419 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-c6c075ad-1d54-4cdc-b60b-cb3cb2283419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:01.623321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:01.624370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:01.625453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:01.625453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:01.625453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:01.625453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:01.625453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:01.625453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:01.625453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:01.625453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:01.627375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:01.629480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 289/587] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:01.630393 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c075ad-1d54-4cdc-b60b-cb3cb2283419 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:01.710233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de0092-6805-40c0-9a9e-0ab127441cbb None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:01.731490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:01.736225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c075ad-1d54-4cdc-b60b-cb3cb2283419 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:01.748451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f36ce3-4414-4bfb-acf3-1e45f5c9d158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:01.749083 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f36ce3-4414-4bfb-acf3-1e45f5c9d158 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:01.749395 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f36ce3-4414-4bfb-acf3-1e45f5c9d158 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:01.749699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f36ce3-4414-4bfb-acf3-1e45f5c9d158 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:01.756689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f36ce3-4414-4bfb-acf3-1e45f5c9d158 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:01.758277 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f36ce3-4414-4bfb-acf3-1e45f5c9d158 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-62f36ce3-4414-4bfb-acf3-1e45f5c9d158 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:01.769865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:01.770945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:01.771924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:01.771924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:01.771924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:01.771924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:01.771924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:01.771924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:01.771924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:01.771924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:01.771924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 299/588] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:01.771924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f36ce3-4414-4bfb-acf3-1e45f5c9d158 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:01.778414 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f34db-14e1-418f-a0a5-5ff9ff989303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:01.779157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f34db-14e1-418f-a0a5-5ff9ff989303 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:01.779491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f34db-14e1-418f-a0a5-5ff9ff989303 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:01.780119 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f34db-14e1-418f-a0a5-5ff9ff989303 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:01.788655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f34db-14e1-418f-a0a5-5ff9ff989303 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:01.790103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f34db-14e1-418f-a0a5-5ff9ff989303 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-fd1f34db-14e1-418f-a0a5-5ff9ff989303 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:01.801556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:01.802493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:01.803613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:01.803613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:01.803613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:01.803613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:01.803613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:01.803613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:01.803613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:01.803613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:01.803613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:03:01.803613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:01.803613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 290/589] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:03:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:01.804187 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f34db-14e1-418f-a0a5-5ff9ff989303 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:01.872420 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:01.892753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f36ce3-4414-4bfb-acf3-1e45f5c9d158 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:01.912761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f34db-14e1-418f-a0a5-5ff9ff989303 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:01.927739 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38765f-b3ed-4aa7-9c93-0c4d3894632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:01.928436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38765f-b3ed-4aa7-9c93-0c4d3894632a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:01.928716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38765f-b3ed-4aa7-9c93-0c4d3894632a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:01.928982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38765f-b3ed-4aa7-9c93-0c4d3894632a None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:01.929641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38765f-b3ed-4aa7-9c93-0c4d3894632a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:01.929968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38765f-b3ed-4aa7-9c93-0c4d3894632a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:01.931323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38765f-b3ed-4aa7-9c93-0c4d3894632a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:01.943130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 300/590] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:01.944141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38765f-b3ed-4aa7-9c93-0c4d3894632a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:01.951951 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496b739-b7c6-4cf1-bab4-51d9da135f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:01.952560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496b739-b7c6-4cf1-bab4-51d9da135f94 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:01.952833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496b739-b7c6-4cf1-bab4-51d9da135f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:01.953100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496b739-b7c6-4cf1-bab4-51d9da135f94 None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:01.953818 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496b739-b7c6-4cf1-bab4-51d9da135f94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:01.954118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496b739-b7c6-4cf1-bab4-51d9da135f94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:01.955538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496b739-b7c6-4cf1-bab4-51d9da135f94 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:01.968187 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 291/591] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:01.968987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496b739-b7c6-4cf1-bab4-51d9da135f94 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:01.996236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:02.058882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38765f-b3ed-4aa7-9c93-0c4d3894632a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:02.079159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496b739-b7c6-4cf1-bab4-51d9da135f94 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:02.102489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a990bbf-4e1e-4ccb-b629-cb8543e38bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:02.103111 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a990bbf-4e1e-4ccb-b629-cb8543e38bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:02.103521 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a990bbf-4e1e-4ccb-b629-cb8543e38bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:02.103778 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a990bbf-4e1e-4ccb-b629-cb8543e38bd8 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:02.104465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a990bbf-4e1e-4ccb-b629-cb8543e38bd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:02.104769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a990bbf-4e1e-4ccb-b629-cb8543e38bd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:02.106247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a990bbf-4e1e-4ccb-b629-cb8543e38bd8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:02.118451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 301/592] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:02.118748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a40c20-3147-4333-aa4f-73901f1ef657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:02.119261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a990bbf-4e1e-4ccb-b629-cb8543e38bd8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:02.119744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a40c20-3147-4333-aa4f-73901f1ef657 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:02.120010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a40c20-3147-4333-aa4f-73901f1ef657 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:02.120295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a40c20-3147-4333-aa4f-73901f1ef657 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:02.121022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a40c20-3147-4333-aa4f-73901f1ef657 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:02.121358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a40c20-3147-4333-aa4f-73901f1ef657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:02.122791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a40c20-3147-4333-aa4f-73901f1ef657 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:02.125756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:02.141932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 292/593] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 31 00:03:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:02.142813 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a40c20-3147-4333-aa4f-73901f1ef657 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:02.230424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:02.234007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a990bbf-4e1e-4ccb-b629-cb8543e38bd8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:02.255192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a40c20-3147-4333-aa4f-73901f1ef657 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:02.272123 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53905676-b168-4281-8c7b-11622a125395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:02.273197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53905676-b168-4281-8c7b-11622a125395 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:02.273493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53905676-b168-4281-8c7b-11622a125395 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:02.273759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53905676-b168-4281-8c7b-11622a125395 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:02.282079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53905676-b168-4281-8c7b-11622a125395 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:02.283502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53905676-b168-4281-8c7b-11622a125395 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-53905676-b168-4281-8c7b-11622a125395 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:02.295060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:02.296033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:02.296965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:02.296965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:02.296965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:02.296965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:02.296965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:02.296965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:02.296965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:02.296965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:02.296965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:03:02.296965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:02.297550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d2c3-f9d9-4d2b-9940-3241e6a80457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:02.297550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d2c3-f9d9-4d2b-9940-3241e6a80457 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:02.297550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d2c3-f9d9-4d2b-9940-3241e6a80457 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:02.297550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d2c3-f9d9-4d2b-9940-3241e6a80457 None admin] PATH_INFO: `/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/2016ed84211d412481d512eae23d2ab6/roles/25b5ec65e62b4d48881026cb00fbd74f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:02.300695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 302/594] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:03:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:02.302054 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53905676-b168-4281-8c7b-11622a125395 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:02.314165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4d2c3-f9d9-4d2b-9940-3241e6a80457 None admin] RBAC: Authorizing `identity:create_grant(project_id=204574e6a3c34ca4a7c266b5549bfdfa, user_id=2016ed84211d412481d512eae23d2ab6, role_id=25b5ec65e62b4d48881026cb00fbd74f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:02.315441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4d2c3-f9d9-4d2b-9940-3241e6a80457 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:02.341233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 293/595] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:03:02 2022] PUT /identity/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/2016ed84211d412481d512eae23d2ab6/roles/25b5ec65e62b4d48881026cb00fbd74f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:03:02.341233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d2c3-f9d9-4d2b-9940-3241e6a80457 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:02.371553 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:02.416820 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53905676-b168-4281-8c7b-11622a125395 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:02.459000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8716a51-94d1-43fd-a22b-302ca64f79b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:02.459733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8716a51-94d1-43fd-a22b-302ca64f79b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:02.460004 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8716a51-94d1-43fd-a22b-302ca64f79b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:02.460268 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8716a51-94d1-43fd-a22b-302ca64f79b1 None admin] PATH_INFO: `/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/d967a3fa32ef48b68c9e3a174f0c9a03/roles/25b5ec65e62b4d48881026cb00fbd74f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:02.466978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d2c3-f9d9-4d2b-9940-3241e6a80457 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:02.487228 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8716a51-94d1-43fd-a22b-302ca64f79b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=204574e6a3c34ca4a7c266b5549bfdfa, user_id=d967a3fa32ef48b68c9e3a174f0c9a03, role_id=25b5ec65e62b4d48881026cb00fbd74f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:02.488592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8716a51-94d1-43fd-a22b-302ca64f79b1 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:02.504338 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 303/596] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:03:02 2022] PUT /identity/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/d967a3fa32ef48b68c9e3a174f0c9a03/roles/25b5ec65e62b4d48881026cb00fbd74f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:03:02.505145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:02.505302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8716a51-94d1-43fd-a22b-302ca64f79b1 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:02.520552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bc3c1-5014-418d-a019-77d4f303b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:02.521917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bc3c1-5014-418d-a019-77d4f303b691 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:02.522447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bc3c1-5014-418d-a019-77d4f303b691 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:02.522926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bc3c1-5014-418d-a019-77d4f303b691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:02.536481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bc3c1-5014-418d-a019-77d4f303b691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:02.538800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bc3c1-5014-418d-a019-77d4f303b691 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-c55bc3c1-5014-418d-a019-77d4f303b691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:02.557392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:02.558441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:02.559437 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:02.559437 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:02.559437 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:02.561828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 294/597] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:02.568740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bc3c1-5014-418d-a019-77d4f303b691 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:02.626072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8716a51-94d1-43fd-a22b-302ca64f79b1 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:02.641111 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:02.666167 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae776262-f519-4544-8861-e2ef8d995f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:02.666790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae776262-f519-4544-8861-e2ef8d995f6a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:02.667060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae776262-f519-4544-8861-e2ef8d995f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:02.667412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae776262-f519-4544-8861-e2ef8d995f6a None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:02.668190 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae776262-f519-4544-8861-e2ef8d995f6a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:02.668499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae776262-f519-4544-8861-e2ef8d995f6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:02.670096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae776262-f519-4544-8861-e2ef8d995f6a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:02.690276 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 304/598] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Aug 31 00:03:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:02.696540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae776262-f519-4544-8861-e2ef8d995f6a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:02.701793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bc3c1-5014-418d-a019-77d4f303b691 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:02.747012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6154f-886c-495e-aefc-22dd92797751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:02.748009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6154f-886c-495e-aefc-22dd92797751 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:02.748009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6154f-886c-495e-aefc-22dd92797751 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:02.748221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6154f-886c-495e-aefc-22dd92797751 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:02.748692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6154f-886c-495e-aefc-22dd92797751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:02.748980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6154f-886c-495e-aefc-22dd92797751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:02.750414 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6154f-886c-495e-aefc-22dd92797751 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:02.763533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 295/599] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:02.769180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b5673-d895-4074-9b25-22abaa3531e5 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:02.769180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b5673-d895-4074-9b25-22abaa3531e5 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:02.769180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b5673-d895-4074-9b25-22abaa3531e5 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:02.769522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 296/600] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:02.770087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b5673-d895-4074-9b25-22abaa3531e5 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:02.819681 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:02.841983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae776262-f519-4544-8861-e2ef8d995f6a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:02.878615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34036bfb-f9f3-4a43-9489-55bc502698e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:02.879287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34036bfb-f9f3-4a43-9489-55bc502698e8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:02.879518 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34036bfb-f9f3-4a43-9489-55bc502698e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:02.879828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34036bfb-f9f3-4a43-9489-55bc502698e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:02.891802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34036bfb-f9f3-4a43-9489-55bc502698e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:02.893269 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34036bfb-f9f3-4a43-9489-55bc502698e8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:02.893793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b5673-d895-4074-9b25-22abaa3531e5 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-34036bfb-f9f3-4a43-9489-55bc502698e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:02.910187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:02.911393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:02.912570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:02.912570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:02.912570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:02.912570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 305/601] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:02.913548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a95023-50fe-48e7-91e8-281b98198859 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:02.913933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a95023-50fe-48e7-91e8-281b98198859 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:02.914373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a95023-50fe-48e7-91e8-281b98198859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:02.936873 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-12a95023-50fe-48e7-91e8-281b98198859 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:02.937795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f634e-46fb-4c11-afd1-9c89b162f36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:02.938078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-12a95023-50fe-48e7-91e8-281b98198859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:02.938827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f634e-46fb-4c11-afd1-9c89b162f36e None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:02.939244 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f634e-46fb-4c11-afd1-9c89b162f36e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:02.939649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f634e-46fb-4c11-afd1-9c89b162f36e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:02.948310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f634e-46fb-4c11-afd1-9c89b162f36e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:02.949992 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f634e-46fb-4c11-afd1-9c89b162f36e None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:02.958162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-570f634e-46fb-4c11-afd1-9c89b162f36e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:02.965026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:02.966202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:02.967180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:02.967180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:02.967180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:02.967180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:02.967180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:02.967180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:02.967180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:02.967180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:02.972929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 297/602] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:02.975026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f634e-46fb-4c11-afd1-9c89b162f36e None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:03.030718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 306/603] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:03:03.031841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a95023-50fe-48e7-91e8-281b98198859 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:03.143038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a95023-50fe-48e7-91e8-281b98198859 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:03.152641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:03.159429 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f634e-46fb-4c11-afd1-9c89b162f36e None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:03.182554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f815e-1645-412c-8c70-9d0aca8eb665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:03.183464 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f815e-1645-412c-8c70-9d0aca8eb665 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:03.184002 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f815e-1645-412c-8c70-9d0aca8eb665 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:03.184422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f815e-1645-412c-8c70-9d0aca8eb665 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:03.185408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f815e-1645-412c-8c70-9d0aca8eb665 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:03.185872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f815e-1645-412c-8c70-9d0aca8eb665 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:03.187752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f815e-1645-412c-8c70-9d0aca8eb665 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:03.200774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 307/604] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:03.219713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f815e-1645-412c-8c70-9d0aca8eb665 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:03.220830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc8486-3337-4954-b858-2dcb798e4f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:03.221468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc8486-3337-4954-b858-2dcb798e4f59 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:03.221739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc8486-3337-4954-b858-2dcb798e4f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:03.222006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc8486-3337-4954-b858-2dcb798e4f59 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:03.222645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc8486-3337-4954-b858-2dcb798e4f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:03.222941 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc8486-3337-4954-b858-2dcb798e4f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:03.224297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc8486-3337-4954-b858-2dcb798e4f59 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:03.236816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 298/605] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:03.246208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc8486-3337-4954-b858-2dcb798e4f59 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:03.246428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:03.351135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc8486-3337-4954-b858-2dcb798e4f59 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:03.402850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfa4a8-9167-4b91-8568-84eda32ac9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:03.403482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfa4a8-9167-4b91-8568-84eda32ac9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:03.403750 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfa4a8-9167-4b91-8568-84eda32ac9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:03.404015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfa4a8-9167-4b91-8568-84eda32ac9a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:03.415829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfa4a8-9167-4b91-8568-84eda32ac9a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:03.417313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfa4a8-9167-4b91-8568-84eda32ac9a6 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:03.419690 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f815e-1645-412c-8c70-9d0aca8eb665 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-afdfa4a8-9167-4b91-8568-84eda32ac9a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:03.438142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:03.439098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:03.439999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:03.439999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:03.439999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:03.439999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:03.439999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:03.439999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:03.439999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:03.439999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:03.441719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 299/606] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:03.450123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfa4a8-9167-4b91-8568-84eda32ac9a6 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:03.469114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5120c8b-4953-4993-9802-9880438bdda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:03.470078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5120c8b-4953-4993-9802-9880438bdda1 None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:03.470556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5120c8b-4953-4993-9802-9880438bdda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:03.470995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5120c8b-4953-4993-9802-9880438bdda1 None admin] PATH_INFO: `/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/6414692e72024816a99d63234f7c233f/roles/25b5ec65e62b4d48881026cb00fbd74f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:03.488982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5120c8b-4953-4993-9802-9880438bdda1 None admin] RBAC: Authorizing `identity:create_grant(project_id=204574e6a3c34ca4a7c266b5549bfdfa, user_id=6414692e72024816a99d63234f7c233f, role_id=25b5ec65e62b4d48881026cb00fbd74f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:03.490132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:03.491758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5120c8b-4953-4993-9802-9880438bdda1 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:03.517657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 308/607] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:03:03 2022] PUT /identity/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/6414692e72024816a99d63234f7c233f/roles/25b5ec65e62b4d48881026cb00fbd74f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:03:03.517657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5120c8b-4953-4993-9802-9880438bdda1 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:03.638404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfa4a8-9167-4b91-8568-84eda32ac9a6 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:03.645568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:03.706330 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98e408-4510-49eb-800d-5dff472421cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:03.706952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98e408-4510-49eb-800d-5dff472421cf None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:03.707228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98e408-4510-49eb-800d-5dff472421cf None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:03.707500 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98e408-4510-49eb-800d-5dff472421cf None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:03.708208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98e408-4510-49eb-800d-5dff472421cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:03.708602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98e408-4510-49eb-800d-5dff472421cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:03.710177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98e408-4510-49eb-800d-5dff472421cf None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:03.727858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5120c8b-4953-4993-9802-9880438bdda1 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:03.729474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 300/608] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:03.734204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98e408-4510-49eb-800d-5dff472421cf None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:03.772533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a50901-3753-4709-8092-5bb2c6c30fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:03.773176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50901-3753-4709-8092-5bb2c6c30fbc None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:03.773506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50901-3753-4709-8092-5bb2c6c30fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:03.773773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50901-3753-4709-8092-5bb2c6c30fbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:03.785098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a50901-3753-4709-8092-5bb2c6c30fbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-88a50901-3753-4709-8092-5bb2c6c30fbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:03.790303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:03.791229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:03.792479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:03.792479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:03.792479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:03.792479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:03.792479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:03.792479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:03.792479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:03.792479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:03.792479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:03.792479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:03.792479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:03.792479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:03.792479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 309/609] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:03:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:03.798633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a50901-3753-4709-8092-5bb2c6c30fbc None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:03.841906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:03.870335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98e408-4510-49eb-800d-5dff472421cf None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:03.939719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a459e3-a49f-469c-a5e4-917ba89acef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:03.940307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a459e3-a49f-469c-a5e4-917ba89acef2 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:03.940578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a459e3-a49f-469c-a5e4-917ba89acef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:03.940848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a459e3-a49f-469c-a5e4-917ba89acef2 None admin] PATH_INFO: `/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/d4f2b852544b450a86fdcb5fa18fd290/roles/25b5ec65e62b4d48881026cb00fbd74f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:03.956337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a50901-3753-4709-8092-5bb2c6c30fbc None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:03.974090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a459e3-a49f-469c-a5e4-917ba89acef2 None admin] RBAC: Authorizing `identity:create_grant(project_id=204574e6a3c34ca4a7c266b5549bfdfa, user_id=d4f2b852544b450a86fdcb5fa18fd290, role_id=25b5ec65e62b4d48881026cb00fbd74f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:03.977369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a459e3-a49f-469c-a5e4-917ba89acef2 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:03.999190 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:04.000359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 301/610] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:03:03 2022] PUT /identity/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/d4f2b852544b450a86fdcb5fa18fd290/roles/25b5ec65e62b4d48881026cb00fbd74f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:03:04.012712 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf2bf9-599f-44a0-8d1e-e15055d9664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:04.013421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf2bf9-599f-44a0-8d1e-e15055d9664a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:04.013749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf2bf9-599f-44a0-8d1e-e15055d9664a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:04.014022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf2bf9-599f-44a0-8d1e-e15055d9664a None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:04.014702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf2bf9-599f-44a0-8d1e-e15055d9664a None admin] RBAC: Adding query filter params (name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:04.015000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf2bf9-599f-44a0-8d1e-e15055d9664a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:04.016423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf2bf9-599f-44a0-8d1e-e15055d9664a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:04.027053 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 310/611] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:03:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:04.033285 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a459e3-a49f-469c-a5e4-917ba89acef2 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:04.146189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a459e3-a49f-469c-a5e4-917ba89acef2 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:04.179249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:04.186563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a324e-3a0c-4a10-b216-e9307afb3c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:04.187206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a324e-3a0c-4a10-b216-e9307afb3c11 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:04.187534 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a324e-3a0c-4a10-b216-e9307afb3c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:04.187814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a324e-3a0c-4a10-b216-e9307afb3c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:04.203466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a324e-3a0c-4a10-b216-e9307afb3c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:04.203466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a324e-3a0c-4a10-b216-e9307afb3c11 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-d94a324e-3a0c-4a10-b216-e9307afb3c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:04.216583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:04.217597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:04.219266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:04.219266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:04.219266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:04.219266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 302/612] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:04.223896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf2bf9-599f-44a0-8d1e-e15055d9664a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:04.355169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf2bf9-599f-44a0-8d1e-e15055d9664a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:04.395984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454906e-11f5-4d65-a7a7-a16b273710f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:04.396697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454906e-11f5-4d65-a7a7-a16b273710f6 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:04.396990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454906e-11f5-4d65-a7a7-a16b273710f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:04.397286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454906e-11f5-4d65-a7a7-a16b273710f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:04.397959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454906e-11f5-4d65-a7a7-a16b273710f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:04.398238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454906e-11f5-4d65-a7a7-a16b273710f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:04.399629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454906e-11f5-4d65-a7a7-a16b273710f6 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:04.415178 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 311/613] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:04.421776 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a324e-3a0c-4a10-b216-e9307afb3c11 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:04.516430 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5590c54-ddea-4a45-9346-189b40b7df19 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:04.516973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5590c54-ddea-4a45-9346-189b40b7df19 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:04.516973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5590c54-ddea-4a45-9346-189b40b7df19 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:04.518578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 312/614] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:04.524109 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe1255-89c2-496b-a722-6fa2db66304c None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:04.524383 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe1255-89c2-496b-a722-6fa2db66304c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:04.524659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe1255-89c2-496b-a722-6fa2db66304c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:04.539398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a324e-3a0c-4a10-b216-e9307afb3c11 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:04.545053 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-2cbe1255-89c2-496b-a722-6fa2db66304c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:04.546303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2cbe1255-89c2-496b-a722-6fa2db66304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:04.594074 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:04.595180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc1305-85b0-424d-ac3e-337ae00a53b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:04.595833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc1305-85b0-424d-ac3e-337ae00a53b0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:04.596110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc1305-85b0-424d-ac3e-337ae00a53b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:04.596382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc1305-85b0-424d-ac3e-337ae00a53b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:04.605316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc1305-85b0-424d-ac3e-337ae00a53b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:04.606756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc1305-85b0-424d-ac3e-337ae00a53b0 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-8acc1305-85b0-424d-ac3e-337ae00a53b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:04.618329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:04.619313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:04.620829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:04.620829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:04.620829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:04.620829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:04.620829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:04.620829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:04.620829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:04.620829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:04.620829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:03:04.620829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:04.620829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 303/615] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:03:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:04.620829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3e218-a613-404d-adaa-e0ae683837f7 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:04.620829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3e218-a613-404d-adaa-e0ae683837f7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:04.621601 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3e218-a613-404d-adaa-e0ae683837f7 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:04.623654 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 304/616] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:04.627325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3e218-a613-404d-adaa-e0ae683837f7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:04.633869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 313/617] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:03:04.635171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad523b-64d1-4465-95ef-00678fa91c53 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:04.635454 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad523b-64d1-4465-95ef-00678fa91c53 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:04.635725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad523b-64d1-4465-95ef-00678fa91c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:04.676440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-67ad523b-64d1-4465-95ef-00678fa91c53 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:04.677660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-67ad523b-64d1-4465-95ef-00678fa91c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:04.711288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:04.820049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 314/618] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:03:04.827169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3e218-a613-404d-adaa-e0ae683837f7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:04.863349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf29ea-a5a2-4838-96ae-c922c3aadfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:04.864031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf29ea-a5a2-4838-96ae-c922c3aadfcc None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:04.864306 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf29ea-a5a2-4838-96ae-c922c3aadfcc None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:04.864623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf29ea-a5a2-4838-96ae-c922c3aadfcc None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:04.865430 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf29ea-a5a2-4838-96ae-c922c3aadfcc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:04.865842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf29ea-a5a2-4838-96ae-c922c3aadfcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:04.867550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf29ea-a5a2-4838-96ae-c922c3aadfcc None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:04.886615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 305/619] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 31 00:03:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:04.894397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad523b-64d1-4465-95ef-00678fa91c53 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:04.916150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf29ea-a5a2-4838-96ae-c922c3aadfcc None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:05.067816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:05.070186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad523b-64d1-4465-95ef-00678fa91c53 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:05.071473 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf29ea-a5a2-4838-96ae-c922c3aadfcc None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:05.078294 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:05.115349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5cda6-b567-45a4-ad99-4a1ea2a03156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:05.116200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5cda6-b567-45a4-ad99-4a1ea2a03156 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:05.116570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5cda6-b567-45a4-ad99-4a1ea2a03156 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:05.116940 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5cda6-b567-45a4-ad99-4a1ea2a03156 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:05.138101 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf4bbd-a7a7-4bf3-9d3a-3e68fb7a13ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:05.138890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf4bbd-a7a7-4bf3-9d3a-3e68fb7a13ce None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:05.139267 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf4bbd-a7a7-4bf3-9d3a-3e68fb7a13ce None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:05.140197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5cda6-b567-45a4-ad99-4a1ea2a03156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:05.140569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf4bbd-a7a7-4bf3-9d3a-3e68fb7a13ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-59c5cda6-b567-45a4-ad99-4a1ea2a03156 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:05.145956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:05.147420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:05.148478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:05.148478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:05.148478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:05.148478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:05.148478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:05.148478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:05.148478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:05.148478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:05.148478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:05.148478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:05.148478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:05.148478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:05.151398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 306/620] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:03:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:05.157909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5cda6-b567-45a4-ad99-4a1ea2a03156 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:05.164624 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf4bbd-a7a7-4bf3-9d3a-3e68fb7a13ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:05.166467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf4bbd-a7a7-4bf3-9d3a-3e68fb7a13ce None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-91cf4bbd-a7a7-4bf3-9d3a-3e68fb7a13ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:05.194096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:05.195400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:05.197397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:05.197397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:05.197397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:05.197397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 315/621] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:05.202128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf4bbd-a7a7-4bf3-9d3a-3e68fb7a13ce None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:05.318278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5cda6-b567-45a4-ad99-4a1ea2a03156 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:05.326137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf4bbd-a7a7-4bf3-9d3a-3e68fb7a13ce None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:05.361305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd303ec-6cba-459e-925a-3d03cdbeb1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:05.362108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd303ec-6cba-459e-925a-3d03cdbeb1ec None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:05.362390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd303ec-6cba-459e-925a-3d03cdbeb1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:05.362751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd303ec-6cba-459e-925a-3d03cdbeb1ec None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:05.363575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd303ec-6cba-459e-925a-3d03cdbeb1ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:05.363878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd303ec-6cba-459e-925a-3d03cdbeb1ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:05.363999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07cc42-f823-483a-86c9-85f5eda2ef0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:05.364571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07cc42-f823-483a-86c9-85f5eda2ef0b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:05.364844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07cc42-f823-483a-86c9-85f5eda2ef0b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:05.365111 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07cc42-f823-483a-86c9-85f5eda2ef0b None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:05.365336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd303ec-6cba-459e-925a-3d03cdbeb1ec None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:05.366001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07cc42-f823-483a-86c9-85f5eda2ef0b None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:05.366304 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07cc42-f823-483a-86c9-85f5eda2ef0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:05.368559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07cc42-f823-483a-86c9-85f5eda2ef0b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:05.378725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 316/623] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:05.378989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 307/623] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:03:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:05.384054 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd303ec-6cba-459e-925a-3d03cdbeb1ec None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:05.384189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07cc42-f823-483a-86c9-85f5eda2ef0b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:05.410698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:05.416430 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:05.497490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07cc42-f823-483a-86c9-85f5eda2ef0b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:05.529691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd303ec-6cba-459e-925a-3d03cdbeb1ec None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:05.534747 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805c613-1a6d-4b86-ba7d-5989aba34350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:05.535548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805c613-1a6d-4b86-ba7d-5989aba34350 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:05.535919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805c613-1a6d-4b86-ba7d-5989aba34350 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:05.536318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805c613-1a6d-4b86-ba7d-5989aba34350 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:05.543884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805c613-1a6d-4b86-ba7d-5989aba34350 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:05.545492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805c613-1a6d-4b86-ba7d-5989aba34350 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-4805c613-1a6d-4b86-ba7d-5989aba34350 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:05.557565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:05.558703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:05.559817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:05.559817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:05.559817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:05.559817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:05.559817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:05.559817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:05.559817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:05.559817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:05.561492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 308/624] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:05.562350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805c613-1a6d-4b86-ba7d-5989aba34350 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:05.575130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd8cd0-2e04-44e4-8ce9-00c81e6a6504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:05.575995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd8cd0-2e04-44e4-8ce9-00c81e6a6504 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:05.576808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd8cd0-2e04-44e4-8ce9-00c81e6a6504 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:05.577263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd8cd0-2e04-44e4-8ce9-00c81e6a6504 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:05.591670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd8cd0-2e04-44e4-8ce9-00c81e6a6504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-6dfd8cd0-2e04-44e4-8ce9-00c81e6a6504 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:05.598281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:05.599438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:05.600748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:05.600748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:05.600748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:05.600748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:05.600748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:05.600748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:05.600748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:05.600748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:05.600748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:05.600748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:05.600748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:05.600748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:05.608953 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 317/625] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:03:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:05.610038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd8cd0-2e04-44e4-8ce9-00c81e6a6504 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:05.656038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:05.676962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805c613-1a6d-4b86-ba7d-5989aba34350 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:05.718134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:05.722769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b256380-8e61-456b-91da-8722e74bcc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:05.724440 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b256380-8e61-456b-91da-8722e74bcc19 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:05.725461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b256380-8e61-456b-91da-8722e74bcc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:05.725907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b256380-8e61-456b-91da-8722e74bcc19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:05.741592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b256380-8e61-456b-91da-8722e74bcc19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:05.743517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b256380-8e61-456b-91da-8722e74bcc19 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:05.744648 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd8cd0-2e04-44e4-8ce9-00c81e6a6504 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-3b256380-8e61-456b-91da-8722e74bcc19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:05.764213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:05.765454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:05.766610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:05.766610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:05.766610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:05.768044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 309/626] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:05.769046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b256380-8e61-456b-91da-8722e74bcc19 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:05.785166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4c87e-14f1-4af5-8a82-15dfff8223ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:05.785782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c87e-14f1-4af5-8a82-15dfff8223ec None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:05.786172 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c87e-14f1-4af5-8a82-15dfff8223ec None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:05.786554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c87e-14f1-4af5-8a82-15dfff8223ec None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:05.787470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4c87e-14f1-4af5-8a82-15dfff8223ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:05.787814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4c87e-14f1-4af5-8a82-15dfff8223ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:05.789488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4c87e-14f1-4af5-8a82-15dfff8223ec None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:05.806059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 318/627] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:05.807779 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4c87e-14f1-4af5-8a82-15dfff8223ec None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:05.887210 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b256380-8e61-456b-91da-8722e74bcc19 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:05.924100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7952eb-a0ac-4fd7-9c8f-77d31d400236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:05.924823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7952eb-a0ac-4fd7-9c8f-77d31d400236 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:05.925246 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7952eb-a0ac-4fd7-9c8f-77d31d400236 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:05.925709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7952eb-a0ac-4fd7-9c8f-77d31d400236 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:05.926428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7952eb-a0ac-4fd7-9c8f-77d31d400236 None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:05.926916 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7952eb-a0ac-4fd7-9c8f-77d31d400236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:05.928576 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7952eb-a0ac-4fd7-9c8f-77d31d400236 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:05.930400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:05.945257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 310/628] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:03:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:05.945257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7952eb-a0ac-4fd7-9c8f-77d31d400236 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:05.955176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4c87e-14f1-4af5-8a82-15dfff8223ec None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:05.997446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ca523-c098-4c8a-aba2-c302a72afd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:05.998155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ca523-c098-4c8a-aba2-c302a72afd57 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:05.998499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ca523-c098-4c8a-aba2-c302a72afd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:05.998827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ca523-c098-4c8a-aba2-c302a72afd57 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:05.999530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ca523-c098-4c8a-aba2-c302a72afd57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:05.999999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ca523-c098-4c8a-aba2-c302a72afd57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:06.001547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ca523-c098-4c8a-aba2-c302a72afd57 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:06.004330 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:06.024193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 319/629] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:06.024193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ca523-c098-4c8a-aba2-c302a72afd57 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:06.062592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7952eb-a0ac-4fd7-9c8f-77d31d400236 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:06.104031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c6e60-5a78-4e14-871f-00ab2bf30c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:06.105332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c6e60-5a78-4e14-871f-00ab2bf30c69 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:06.105704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c6e60-5a78-4e14-871f-00ab2bf30c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:06.106068 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c6e60-5a78-4e14-871f-00ab2bf30c69 None admin] PATH_INFO: `/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/85c5a65170b046d08b0d1f01c6550730/roles/25b5ec65e62b4d48881026cb00fbd74f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:06.122128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c6e60-5a78-4e14-871f-00ab2bf30c69 None admin] RBAC: Authorizing `identity:create_grant(project_id=204574e6a3c34ca4a7c266b5549bfdfa, user_id=85c5a65170b046d08b0d1f01c6550730, role_id=25b5ec65e62b4d48881026cb00fbd74f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:06.123659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c6e60-5a78-4e14-871f-00ab2bf30c69 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:06.135152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ca523-c098-4c8a-aba2-c302a72afd57 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:06.145866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 311/630] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:03:05 2022] PUT /identity/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/85c5a65170b046d08b0d1f01c6550730/roles/25b5ec65e62b4d48881026cb00fbd74f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:03:06.145866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f238b9-84e2-4b17-af98-766e87e234d8 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:06.145866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f238b9-84e2-4b17-af98-766e87e234d8 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:06.145866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f238b9-84e2-4b17-af98-766e87e234d8 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:06.145866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 312/631] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:06.145866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f238b9-84e2-4b17-af98-766e87e234d8 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:06.184099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f348cd6-b04c-4483-8b54-944fcbe80056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:06.184992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348cd6-b04c-4483-8b54-944fcbe80056 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:06.185323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348cd6-b04c-4483-8b54-944fcbe80056 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:06.186051 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348cd6-b04c-4483-8b54-944fcbe80056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:06.200893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f348cd6-b04c-4483-8b54-944fcbe80056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:06.203583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f348cd6-b04c-4483-8b54-944fcbe80056 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:06.208052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-3f348cd6-b04c-4483-8b54-944fcbe80056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:06.231583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:06.232713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:06.233737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:06.233737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:06.233737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:06.233737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 320/632] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:06.234952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9551d09-60e1-4810-a693-3648e23e97f5 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:06.234952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9551d09-60e1-4810-a693-3648e23e97f5 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:06.235138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9551d09-60e1-4810-a693-3648e23e97f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:06.261631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d9551d09-60e1-4810-a693-3648e23e97f5 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:06.263448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d9551d09-60e1-4810-a693-3648e23e97f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:06.278037 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f238b9-84e2-4b17-af98-766e87e234d8 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:06.318491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15232439-4e65-436a-a4b0-78fd6e89cccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:06.319455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15232439-4e65-436a-a4b0-78fd6e89cccf None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:06.319758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15232439-4e65-436a-a4b0-78fd6e89cccf None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:06.319954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15232439-4e65-436a-a4b0-78fd6e89cccf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:06.328584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15232439-4e65-436a-a4b0-78fd6e89cccf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:06.330140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15232439-4e65-436a-a4b0-78fd6e89cccf None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:06.333387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-15232439-4e65-436a-a4b0-78fd6e89cccf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:06.346132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:06.347122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:06.348052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:06.348052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:06.348052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:06.348052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:06.348052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:06.348052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:06.348052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:06.348052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:06.348052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:06.348052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:06.350330 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 313/633] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 31 00:03:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:06.351407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15232439-4e65-436a-a4b0-78fd6e89cccf None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:06.373719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 321/634] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:03:06.379076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9551d09-60e1-4810-a693-3648e23e97f5 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:06.471904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15232439-4e65-436a-a4b0-78fd6e89cccf None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:06.481080 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9551d09-60e1-4810-a693-3648e23e97f5 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:06.497616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:06.509135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cfe7c-d728-42f5-831d-da69e23e2645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:06.510072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cfe7c-d728-42f5-831d-da69e23e2645 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:06.510631 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cfe7c-d728-42f5-831d-da69e23e2645 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:06.511078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cfe7c-d728-42f5-831d-da69e23e2645 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:06.512033 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cfe7c-d728-42f5-831d-da69e23e2645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:06.512863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cfe7c-d728-42f5-831d-da69e23e2645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:06.514545 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cfe7c-d728-42f5-831d-da69e23e2645 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:06.516889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0525d-702f-4f90-b75f-71b927435303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:06.517530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0525d-702f-4f90-b75f-71b927435303 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:06.517806 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0525d-702f-4f90-b75f-71b927435303 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:06.518076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0525d-702f-4f90-b75f-71b927435303 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:06.518800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0525d-702f-4f90-b75f-71b927435303 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:06.519105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0525d-702f-4f90-b75f-71b927435303 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:06.520515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0525d-702f-4f90-b75f-71b927435303 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:06.528960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 314/635] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:06.532579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60f78e-024e-4e5f-a24d-8c0260b9de4d None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:06.532861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60f78e-024e-4e5f-a24d-8c0260b9de4d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:06.536232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60f78e-024e-4e5f-a24d-8c0260b9de4d None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:06.538154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 315/636] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:06.542360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 322/637] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 31 00:03:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:06.542814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0525d-702f-4f90-b75f-71b927435303 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:06.544286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dc240-15a0-4db6-9c5b-21266548dabb None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:06.544754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dc240-15a0-4db6-9c5b-21266548dabb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:06.545309 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dc240-15a0-4db6-9c5b-21266548dabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:06.564753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-513dc240-15a0-4db6-9c5b-21266548dabb None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:06.566373 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-513dc240-15a0-4db6-9c5b-21266548dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:06.578741 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:06.644327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 316/638] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:03:06.645719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dc240-15a0-4db6-9c5b-21266548dabb None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:06.648487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0525d-702f-4f90-b75f-71b927435303 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:06.687219 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a13e9-d5a0-4ad5-9c8f-fdb330ae9c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:06.687861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a13e9-d5a0-4ad5-9c8f-fdb330ae9c5d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:06.688209 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a13e9-d5a0-4ad5-9c8f-fdb330ae9c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:06.688487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a13e9-d5a0-4ad5-9c8f-fdb330ae9c5d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:06.696990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a13e9-d5a0-4ad5-9c8f-fdb330ae9c5d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:06.698574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a13e9-d5a0-4ad5-9c8f-fdb330ae9c5d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-234a13e9-d5a0-4ad5-9c8f-fdb330ae9c5d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:06.715023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:06.716107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:06.717025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:06.717025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:06.717025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:06.717025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:06.717025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:06.717025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:06.717025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:06.717025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:06.717025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:03:06.717025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:06.717585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 323/639] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:03:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:06.718136 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a13e9-d5a0-4ad5-9c8f-fdb330ae9c5d None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:06.767887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:06.776341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dc240-15a0-4db6-9c5b-21266548dabb None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:06.823425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a03d9b-e312-4a4a-af1b-1970127211c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:06.824289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a03d9b-e312-4a4a-af1b-1970127211c3 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:06.825094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:06.825383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a03d9b-e312-4a4a-af1b-1970127211c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:06.826475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a03d9b-e312-4a4a-af1b-1970127211c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:06.832275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a13e9-d5a0-4ad5-9c8f-fdb330ae9c5d None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:06.868999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bada0-8dec-498c-9ced-07132f281d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:06.869664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bada0-8dec-498c-9ced-07132f281d74 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:06.869974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bada0-8dec-498c-9ced-07132f281d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:06.870249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bada0-8dec-498c-9ced-07132f281d74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:06.881150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bada0-8dec-498c-9ced-07132f281d74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-542bada0-8dec-498c-9ced-07132f281d74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:06.887000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:06.887948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:06.888768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:06.888768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:06.888768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:06.888768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:06.888768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:06.888768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:06.888768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:06.888768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:06.888768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:06.888768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:06.888768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:06.888768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:06.893146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 324/640] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:03:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:06.893932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bada0-8dec-498c-9ced-07132f281d74 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:06.921474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a03d9b-e312-4a4a-af1b-1970127211c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:06.923230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a03d9b-e312-4a4a-af1b-1970127211c3 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:07.002721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bada0-8dec-498c-9ced-07132f281d74 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:07.021700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:07.034955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 317/641] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:03:07.034955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a03d9b-e312-4a4a-af1b-1970127211c3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:07.046232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33822fd-a3dc-4a86-b3a9-6f302d1b3bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:07.046838 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33822fd-a3dc-4a86-b3a9-6f302d1b3bed None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:07.047108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33822fd-a3dc-4a86-b3a9-6f302d1b3bed None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:07.047372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33822fd-a3dc-4a86-b3a9-6f302d1b3bed None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:07.048150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33822fd-a3dc-4a86-b3a9-6f302d1b3bed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:07.048451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33822fd-a3dc-4a86-b3a9-6f302d1b3bed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:07.049889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33822fd-a3dc-4a86-b3a9-6f302d1b3bed None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:07.073346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 325/642] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 31 00:03:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:07.073346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33822fd-a3dc-4a86-b3a9-6f302d1b3bed None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:07.086733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:07.150456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a03d9b-e312-4a4a-af1b-1970127211c3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:07.183112 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33822fd-a3dc-4a86-b3a9-6f302d1b3bed None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:07.186209 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f845ef-9bd2-48fe-9152-defc0409fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:07.186807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f845ef-9bd2-48fe-9152-defc0409fdfc None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:07.187072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f845ef-9bd2-48fe-9152-defc0409fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:07.187333 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f845ef-9bd2-48fe-9152-defc0409fdfc None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:07.187983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f845ef-9bd2-48fe-9152-defc0409fdfc None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:07.188272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f845ef-9bd2-48fe-9152-defc0409fdfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:07.189701 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f845ef-9bd2-48fe-9152-defc0409fdfc None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:07.202311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 318/643] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:03:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:07.202311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f845ef-9bd2-48fe-9152-defc0409fdfc None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:07.228455 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacfafa-8fcc-4e0c-9424-75f76abebfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:07.229090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacfafa-8fcc-4e0c-9424-75f76abebfca None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:07.229392 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacfafa-8fcc-4e0c-9424-75f76abebfca None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:07.229711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacfafa-8fcc-4e0c-9424-75f76abebfca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:07.240332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacfafa-8fcc-4e0c-9424-75f76abebfca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-ecacfafa-8fcc-4e0c-9424-75f76abebfca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:07.245078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:07.246108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 326/644] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:03:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:07.246963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacfafa-8fcc-4e0c-9424-75f76abebfca None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:07.265501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:07.312525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f845ef-9bd2-48fe-9152-defc0409fdfc None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:07.327023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:07.352179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135fc47-2530-43a1-b0c1-52afcc660213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:07.352810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135fc47-2530-43a1-b0c1-52afcc660213 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:07.353077 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135fc47-2530-43a1-b0c1-52afcc660213 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:07.353372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135fc47-2530-43a1-b0c1-52afcc660213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:07.358050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacfafa-8fcc-4e0c-9424-75f76abebfca None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:07.368962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135fc47-2530-43a1-b0c1-52afcc660213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:07.370272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135fc47-2530-43a1-b0c1-52afcc660213 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-1135fc47-2530-43a1-b0c1-52afcc660213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:07.385446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:07.386511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:07.387480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:07.387480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:07.387480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:07.387480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 319/645] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:07.387480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135fc47-2530-43a1-b0c1-52afcc660213 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:07.402676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6771f-4645-4e54-b03f-175a381aea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:07.403280 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6771f-4645-4e54-b03f-175a381aea26 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:07.403545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6771f-4645-4e54-b03f-175a381aea26 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:07.403811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6771f-4645-4e54-b03f-175a381aea26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:07.476681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6771f-4645-4e54-b03f-175a381aea26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:07.478139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6771f-4645-4e54-b03f-175a381aea26 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:07.490995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135fc47-2530-43a1-b0c1-52afcc660213 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:07.501999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:07.529395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cddfee-e379-4c17-be1e-98b1f0465924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:07.530659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cddfee-e379-4c17-be1e-98b1f0465924 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:07.530934 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cddfee-e379-4c17-be1e-98b1f0465924 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:07.531198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cddfee-e379-4c17-be1e-98b1f0465924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:07.544237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cddfee-e379-4c17-be1e-98b1f0465924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:07.545841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cddfee-e379-4c17-be1e-98b1f0465924 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:07.556634 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-75cddfee-e379-4c17-be1e-98b1f0465924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:07.561103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:07.562261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:07.563410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:07.563410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:07.563410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:07.563789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 320/646] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:07.564553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cddfee-e379-4c17-be1e-98b1f0465924 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:07.590674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 327/647] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:03:07.594124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6771f-4645-4e54-b03f-175a381aea26 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:07.671814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cddfee-e379-4c17-be1e-98b1f0465924 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:07.702230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6771f-4645-4e54-b03f-175a381aea26 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:07.716356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe737a36-7b77-489a-8f19-1b8db1e28c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:07.716968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe737a36-7b77-489a-8f19-1b8db1e28c49 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:07.717228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe737a36-7b77-489a-8f19-1b8db1e28c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:07.717525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe737a36-7b77-489a-8f19-1b8db1e28c49 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:07.718171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe737a36-7b77-489a-8f19-1b8db1e28c49 None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:07.718480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe737a36-7b77-489a-8f19-1b8db1e28c49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:07.719823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe737a36-7b77-489a-8f19-1b8db1e28c49 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:07.728881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 321/648] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:03:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:07.729552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe737a36-7b77-489a-8f19-1b8db1e28c49 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:07.744115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938f37-95c5-442c-b176-066b69cd57bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:07.744887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938f37-95c5-442c-b176-066b69cd57bf None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:07.745171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938f37-95c5-442c-b176-066b69cd57bf None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:07.745472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938f37-95c5-442c-b176-066b69cd57bf None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:07.746119 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05938f37-95c5-442c-b176-066b69cd57bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:07.746422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05938f37-95c5-442c-b176-066b69cd57bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:07.747830 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05938f37-95c5-442c-b176-066b69cd57bf None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:07.756337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:07.765251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 328/649] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:07.766138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938f37-95c5-442c-b176-066b69cd57bf None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:07.802761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:07.832913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe737a36-7b77-489a-8f19-1b8db1e28c49 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:07.867527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5670a-ac7c-45c1-ae75-580b8a3eee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:07.868230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5670a-ac7c-45c1-ae75-580b8a3eee63 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:07.868497 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5670a-ac7c-45c1-ae75-580b8a3eee63 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:07.868775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5670a-ac7c-45c1-ae75-580b8a3eee63 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:07.869430 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5670a-ac7c-45c1-ae75-580b8a3eee63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:07.869723 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5670a-ac7c-45c1-ae75-580b8a3eee63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:07.871086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5670a-ac7c-45c1-ae75-580b8a3eee63 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:07.874034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938f37-95c5-442c-b176-066b69cd57bf None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:07.882752 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 322/650] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:07.883565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5670a-ac7c-45c1-ae75-580b8a3eee63 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:07.913962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a90b6-ede0-41c7-8a4c-0b6037e5766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:07.914593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a90b6-ede0-41c7-8a4c-0b6037e5766e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:07.914863 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a90b6-ede0-41c7-8a4c-0b6037e5766e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:07.915123 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a90b6-ede0-41c7-8a4c-0b6037e5766e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:07.926266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a90b6-ede0-41c7-8a4c-0b6037e5766e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:07.927905 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a90b6-ede0-41c7-8a4c-0b6037e5766e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-eb0a90b6-ede0-41c7-8a4c-0b6037e5766e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:07.942808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:07.943931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:07.944944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:07.944944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:07.944944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:07.944944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 329/651] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:07.945166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a90b6-ede0-41c7-8a4c-0b6037e5766e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:07.976514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:07.997416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5670a-ac7c-45c1-ae75-580b8a3eee63 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:08.034781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddd7b3-e58c-4641-950f-3a3614baef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:08.035547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddd7b3-e58c-4641-950f-3a3614baef99 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:08.035873 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddd7b3-e58c-4641-950f-3a3614baef99 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:08.036194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddd7b3-e58c-4641-950f-3a3614baef99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:08.039737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:08.048923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddd7b3-e58c-4641-950f-3a3614baef99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:08.050645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddd7b3-e58c-4641-950f-3a3614baef99 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:08.056568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a90b6-ede0-41c7-8a4c-0b6037e5766e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-25ddd7b3-e58c-4641-950f-3a3614baef99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:08.066446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:08.067609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:08.068595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:08.068595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:08.068595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:08.072853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 323/652] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:08.073726 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddd7b3-e58c-4641-950f-3a3614baef99 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:08.097576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d968e-e449-4a3d-9692-7dad55dacf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:08.098479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d968e-e449-4a3d-9692-7dad55dacf9b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:08.098959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d968e-e449-4a3d-9692-7dad55dacf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:08.099415 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d968e-e449-4a3d-9692-7dad55dacf9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:08.107332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d968e-e449-4a3d-9692-7dad55dacf9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:08.108835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d968e-e449-4a3d-9692-7dad55dacf9b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-f33d968e-e449-4a3d-9692-7dad55dacf9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:08.120752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:08.121698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:08.122580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:08.122580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:08.122580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:08.122580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:08.122580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:08.122580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:08.122580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:08.122580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:08.122580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 330/653] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:08.123083 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d968e-e449-4a3d-9692-7dad55dacf9b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:08.186637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddd7b3-e58c-4641-950f-3a3614baef99 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:08.221533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f86fc-5144-46a6-8cfa-2d748c1ad58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:08.222167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f86fc-5144-46a6-8cfa-2d748c1ad58b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:08.222436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f86fc-5144-46a6-8cfa-2d748c1ad58b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:08.222700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f86fc-5144-46a6-8cfa-2d748c1ad58b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:08.225730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:08.227894 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d968e-e449-4a3d-9692-7dad55dacf9b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:08.230956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f86fc-5144-46a6-8cfa-2d748c1ad58b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:08.232743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f86fc-5144-46a6-8cfa-2d748c1ad58b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-a23f86fc-5144-46a6-8cfa-2d748c1ad58b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:08.244721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:08.245660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:08.246996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:08.246996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:08.246996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:08.246996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:08.246996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:08.246996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:08.246996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:08.246996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:08.246996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:03:08.246996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:08.246996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 324/654] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:03:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:08.246996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f86fc-5144-46a6-8cfa-2d748c1ad58b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:08.265783 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bd505-3a3d-4aa0-8fec-6b581a446e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:08.266400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bd505-3a3d-4aa0-8fec-6b581a446e43 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:08.266677 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bd505-3a3d-4aa0-8fec-6b581a446e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:08.266948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bd505-3a3d-4aa0-8fec-6b581a446e43 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:08.267618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bd505-3a3d-4aa0-8fec-6b581a446e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:08.267918 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bd505-3a3d-4aa0-8fec-6b581a446e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:08.269306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bd505-3a3d-4aa0-8fec-6b581a446e43 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:08.281512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 331/655] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:08.282302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bd505-3a3d-4aa0-8fec-6b581a446e43 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:08.290628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:08.358567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f86fc-5144-46a6-8cfa-2d748c1ad58b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:08.384071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bd505-3a3d-4aa0-8fec-6b581a446e43 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:08.390979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17684f70-9c0a-4d92-843d-de496bfffbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:08.391582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17684f70-9c0a-4d92-843d-de496bfffbfb None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:08.391854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17684f70-9c0a-4d92-843d-de496bfffbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:08.392119 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17684f70-9c0a-4d92-843d-de496bfffbfb None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:08.392756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17684f70-9c0a-4d92-843d-de496bfffbfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:08.393085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17684f70-9c0a-4d92-843d-de496bfffbfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:08.394490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17684f70-9c0a-4d92-843d-de496bfffbfb None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:08.406886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 325/656] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:08.408131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39901b2a-f1a7-419e-9029-cdd85c6ba9e0 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:08.408418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39901b2a-f1a7-419e-9029-cdd85c6ba9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:08.408685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39901b2a-f1a7-419e-9029-cdd85c6ba9e0 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:08.409898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 326/657] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:08.410582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39901b2a-f1a7-419e-9029-cdd85c6ba9e0 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:08.420883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f527952-e063-4e02-bfc8-66885f6c3b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:08.421527 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527952-e063-4e02-bfc8-66885f6c3b61 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:08.421803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527952-e063-4e02-bfc8-66885f6c3b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:08.422071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527952-e063-4e02-bfc8-66885f6c3b61 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:08.422760 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f527952-e063-4e02-bfc8-66885f6c3b61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:08.423066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f527952-e063-4e02-bfc8-66885f6c3b61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:08.424540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f527952-e063-4e02-bfc8-66885f6c3b61 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:08.436186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 332/658] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:08.436992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f527952-e063-4e02-bfc8-66885f6c3b61 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:08.469428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:08.503839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:08.516713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39901b2a-f1a7-419e-9029-cdd85c6ba9e0 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:08.539332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f527952-e063-4e02-bfc8-66885f6c3b61 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:08.551340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f004127-7f39-4f3f-9767-5565611cd717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:08.551953 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f004127-7f39-4f3f-9767-5565611cd717 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:08.552222 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f004127-7f39-4f3f-9767-5565611cd717 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:08.552476 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f004127-7f39-4f3f-9767-5565611cd717 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:08.553538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f004127-7f39-4f3f-9767-5565611cd717 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:08.553826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f004127-7f39-4f3f-9767-5565611cd717 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:08.555253 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f004127-7f39-4f3f-9767-5565611cd717 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:08.572138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51121fc-6238-440a-b1e6-669cc770c87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:08.572791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51121fc-6238-440a-b1e6-669cc770c87e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:08.572899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 327/659] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 31 00:03:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:08.577511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51121fc-6238-440a-b1e6-669cc770c87e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:08.577511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51121fc-6238-440a-b1e6-669cc770c87e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:08.577679 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f004127-7f39-4f3f-9767-5565611cd717 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:08.580028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51121fc-6238-440a-b1e6-669cc770c87e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:08.581489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51121fc-6238-440a-b1e6-669cc770c87e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-a51121fc-6238-440a-b1e6-669cc770c87e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:08.593530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:08.594502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:08.595542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:08.595542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:08.595542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:08.595542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:08.595542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:08.595542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:08.595542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:08.595542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:08.597351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 333/660] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:08.598732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50069-f646-46e2-9a36-534f0a8f5e47 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:08.599012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50069-f646-46e2-9a36-534f0a8f5e47 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:08.599262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50069-f646-46e2-9a36-534f0a8f5e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:08.617754 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-dba50069-f646-46e2-9a36-534f0a8f5e47 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:08.618890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-dba50069-f646-46e2-9a36-534f0a8f5e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:08.674281 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f004127-7f39-4f3f-9767-5565611cd717 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:08.684599 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 334/661] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:03:08.685668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba50069-f646-46e2-9a36-534f0a8f5e47 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:08.699314 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:08.720385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4281e58-67ef-4b75-b75b-05d0770ceeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:08.721104 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4281e58-67ef-4b75-b75b-05d0770ceeff None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:08.721494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4281e58-67ef-4b75-b75b-05d0770ceeff None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:08.721743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4281e58-67ef-4b75-b75b-05d0770ceeff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:08.729123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4281e58-67ef-4b75-b75b-05d0770ceeff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:08.730570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4281e58-67ef-4b75-b75b-05d0770ceeff None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-f4281e58-67ef-4b75-b75b-05d0770ceeff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:08.742233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:08.743269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:08.744224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:08.744224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:08.744224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:08.744224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:08.744224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:08.744224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:08.744224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:08.744224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:08.744224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:03:08.744224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:08.744224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 328/662] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:03:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:08.744224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4281e58-67ef-4b75-b75b-05d0770ceeff None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:08.748086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:08.793837 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba50069-f646-46e2-9a36-534f0a8f5e47 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:08.829442 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0802f7-a852-4a5e-af54-e0ac4c0bfa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:08.830491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0802f7-a852-4a5e-af54-e0ac4c0bfa6b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:08.830779 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0802f7-a852-4a5e-af54-e0ac4c0bfa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:08.831047 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0802f7-a852-4a5e-af54-e0ac4c0bfa6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:08.832182 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0802f7-a852-4a5e-af54-e0ac4c0bfa6b None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=2016ed84211d412481d512eae23d2ab6) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:08.832756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0802f7-a852-4a5e-af54-e0ac4c0bfa6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:08.834596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0802f7-a852-4a5e-af54-e0ac4c0bfa6b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:08.841826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 335/663] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:08 2022] GET /identity/v3/role_assignments?user.id=2016ed84211d412481d512eae23d2ab6&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:08.846096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0802f7-a852-4a5e-af54-e0ac4c0bfa6b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:08.856941 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4281e58-67ef-4b75-b75b-05d0770ceeff None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:08.896385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce1f93-4784-4dcc-9a58-da7b54ce5401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:08.897400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce1f93-4784-4dcc-9a58-da7b54ce5401 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:08.897759 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce1f93-4784-4dcc-9a58-da7b54ce5401 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:08.898124 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce1f93-4784-4dcc-9a58-da7b54ce5401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:08.948005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:08.977491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce1f93-4784-4dcc-9a58-da7b54ce5401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:08.979136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce1f93-4784-4dcc-9a58-da7b54ce5401 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:08.985417 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0802f7-a852-4a5e-af54-e0ac4c0bfa6b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:09.011432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:09.030431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dff228-6a58-4716-b5ea-b6ac8e131e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:09.031057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dff228-6a58-4716-b5ea-b6ac8e131e53 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:09.031747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dff228-6a58-4716-b5ea-b6ac8e131e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:09.031747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dff228-6a58-4716-b5ea-b6ac8e131e53 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:09.033030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dff228-6a58-4716-b5ea-b6ac8e131e53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:09.033030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dff228-6a58-4716-b5ea-b6ac8e131e53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:09.034680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dff228-6a58-4716-b5ea-b6ac8e131e53 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:09.049076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 336/664] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:09.050682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dff228-6a58-4716-b5ea-b6ac8e131e53 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:09.089263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 329/665] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:03:09.091030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce1f93-4784-4dcc-9a58-da7b54ce5401 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:09.174501 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dff228-6a58-4716-b5ea-b6ac8e131e53 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:09.178102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:09.204920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce1f93-4784-4dcc-9a58-da7b54ce5401 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:09.211523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce624c8-eddf-4d8e-b9ae-d96070fc2616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:09.211969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce624c8-eddf-4d8e-b9ae-d96070fc2616 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:09.212969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce624c8-eddf-4d8e-b9ae-d96070fc2616 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:09.213377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce624c8-eddf-4d8e-b9ae-d96070fc2616 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:09.214185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce624c8-eddf-4d8e-b9ae-d96070fc2616 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:09.214972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce624c8-eddf-4d8e-b9ae-d96070fc2616 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:09.216813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce624c8-eddf-4d8e-b9ae-d96070fc2616 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:09.236323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 337/666] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Aug 31 00:03:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:09.241876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce624c8-eddf-4d8e-b9ae-d96070fc2616 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:09.242904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b245c3-de98-49f6-89a7-e753464e9664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:09.243636 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b245c3-de98-49f6-89a7-e753464e9664 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:09.244009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b245c3-de98-49f6-89a7-e753464e9664 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:09.244392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b245c3-de98-49f6-89a7-e753464e9664 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:09.255504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b245c3-de98-49f6-89a7-e753464e9664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-63b245c3-de98-49f6-89a7-e753464e9664 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:09.260334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:09.261471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:09.262506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:09.262506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:09.262506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:09.262506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:09.262506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:09.262506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:09.262506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:09.262506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:09.262506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:09.262506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:09.262506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:09.262506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:09.266102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 330/667] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:03:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:09.267123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b245c3-de98-49f6-89a7-e753464e9664 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:09.291066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:09.354298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce624c8-eddf-4d8e-b9ae-d96070fc2616 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:09.375057 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b245c3-de98-49f6-89a7-e753464e9664 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:09.397933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74714b88-5bdc-4c43-b6ff-eb19d835b0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:09.398538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714b88-5bdc-4c43-b6ff-eb19d835b0db None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:09.398828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714b88-5bdc-4c43-b6ff-eb19d835b0db None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:09.399162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714b88-5bdc-4c43-b6ff-eb19d835b0db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:09.399810 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74714b88-5bdc-4c43-b6ff-eb19d835b0db None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=d967a3fa32ef48b68c9e3a174f0c9a03) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:09.400100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74714b88-5bdc-4c43-b6ff-eb19d835b0db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:09.401567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74714b88-5bdc-4c43-b6ff-eb19d835b0db None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:09.412843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 338/668] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:09 2022] GET /identity/v3/role_assignments?user.id=d967a3fa32ef48b68c9e3a174f0c9a03&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:09.412843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74714b88-5bdc-4c43-b6ff-eb19d835b0db None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:09.423729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2cad3-bd83-4a4d-88ce-c6f4ccb95c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:09.424611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2cad3-bd83-4a4d-88ce-c6f4ccb95c65 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:09.424889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2cad3-bd83-4a4d-88ce-c6f4ccb95c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:09.425239 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2cad3-bd83-4a4d-88ce-c6f4ccb95c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:09.428215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:09.438689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2cad3-bd83-4a4d-88ce-c6f4ccb95c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:09.440298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2cad3-bd83-4a4d-88ce-c6f4ccb95c65 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-93b2cad3-bd83-4a4d-88ce-c6f4ccb95c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:09.456072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:09.457126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:09.458084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:09.458084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:09.458084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:09.462176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 331/669] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:09.463121 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2cad3-bd83-4a4d-88ce-c6f4ccb95c65 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:09.531943 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74714b88-5bdc-4c43-b6ff-eb19d835b0db None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:09.534233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:09.579360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d0c87-76e9-4190-9351-779108c85111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:09.580022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d0c87-76e9-4190-9351-779108c85111 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:09.580244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d0c87-76e9-4190-9351-779108c85111 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:09.580519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d0c87-76e9-4190-9351-779108c85111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:09.581736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2cad3-bd83-4a4d-88ce-c6f4ccb95c65 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:09.630047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79b55d-e65d-4383-8d5f-b921290eb9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:09.631967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79b55d-e65d-4383-8d5f-b921290eb9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:09.632428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79b55d-e65d-4383-8d5f-b921290eb9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:09.632887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79b55d-e65d-4383-8d5f-b921290eb9f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:09.633616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79b55d-e65d-4383-8d5f-b921290eb9f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:09.633917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79b55d-e65d-4383-8d5f-b921290eb9f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:09.635289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79b55d-e65d-4383-8d5f-b921290eb9f0 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:09.645534 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 332/670] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:03:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:09.646410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79b55d-e65d-4383-8d5f-b921290eb9f0 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:09.670010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d0c87-76e9-4190-9351-779108c85111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:09.671569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d0c87-76e9-4190-9351-779108c85111 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:09.708198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:09.776707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79b55d-e65d-4383-8d5f-b921290eb9f0 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:09.796342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 339/671] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:03:09.797759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d0c87-76e9-4190-9351-779108c85111 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:09.800503 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:09.819255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8dbeb-a069-4af2-a3ae-fd98d12ed419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:09.819885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8dbeb-a069-4af2-a3ae-fd98d12ed419 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:09.820162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8dbeb-a069-4af2-a3ae-fd98d12ed419 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:09.820830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8dbeb-a069-4af2-a3ae-fd98d12ed419 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:09.821525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8dbeb-a069-4af2-a3ae-fd98d12ed419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:09.821826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8dbeb-a069-4af2-a3ae-fd98d12ed419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:09.823188 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8dbeb-a069-4af2-a3ae-fd98d12ed419 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:09.838603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 333/672] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:09.839451 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8dbeb-a069-4af2-a3ae-fd98d12ed419 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:09.939557 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d0c87-76e9-4190-9351-779108c85111 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:09.959097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8dbeb-a069-4af2-a3ae-fd98d12ed419 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:09.969308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:09.991792 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416cd28-f39d-417a-99d1-bfde0bd2c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:09.993550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416cd28-f39d-417a-99d1-bfde0bd2c980 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:09.994323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416cd28-f39d-417a-99d1-bfde0bd2c980 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:09.994824 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416cd28-f39d-417a-99d1-bfde0bd2c980 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:10.001172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58bca5-9033-4b19-a1c1-b3a7ebb8273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:10.001851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58bca5-9033-4b19-a1c1-b3a7ebb8273a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:10.002120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58bca5-9033-4b19-a1c1-b3a7ebb8273a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:10.002383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58bca5-9033-4b19-a1c1-b3a7ebb8273a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:10.011175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416cd28-f39d-417a-99d1-bfde0bd2c980 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:10.013955 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416cd28-f39d-417a-99d1-bfde0bd2c980 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:10.014610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58bca5-9033-4b19-a1c1-b3a7ebb8273a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:10.016029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58bca5-9033-4b19-a1c1-b3a7ebb8273a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-1d58bca5-9033-4b19-a1c1-b3a7ebb8273a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:10.032118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:10.033122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:10.034062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:10.034062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:10.034062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:10.034062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 334/673] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:10.034712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58bca5-9033-4b19-a1c1-b3a7ebb8273a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-8416cd28-f39d-417a-99d1-bfde0bd2c980 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:10.035992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:10.036914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:10.037990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:10.037990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:10.037990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:10.041271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 340/674] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:10.042340 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416cd28-f39d-417a-99d1-bfde0bd2c980 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:10.118593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:10.147948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58bca5-9033-4b19-a1c1-b3a7ebb8273a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:10.176994 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416cd28-f39d-417a-99d1-bfde0bd2c980 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:10.184362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27893d-ac0f-413e-bf58-bcd457d30aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:10.185084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27893d-ac0f-413e-bf58-bcd457d30aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:10.185444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27893d-ac0f-413e-bf58-bcd457d30aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:10.185779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27893d-ac0f-413e-bf58-bcd457d30aa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:10.193191 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27893d-ac0f-413e-bf58-bcd457d30aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:10.194836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27893d-ac0f-413e-bf58-bcd457d30aa8 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-6e27893d-ac0f-413e-bf58-bcd457d30aa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:10.207384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:10.208325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:10.209550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:10.209550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:10.209550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:10.209550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:10.209550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:10.209550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:10.209550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:10.209550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:10.213309 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 335/675] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:10.214230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27893d-ac0f-413e-bf58-bcd457d30aa8 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:10.221240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d7bfd-a806-4744-8f4e-abd04a8071e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:10.222086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d7bfd-a806-4744-8f4e-abd04a8071e7 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:10.222543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d7bfd-a806-4744-8f4e-abd04a8071e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:10.222992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d7bfd-a806-4744-8f4e-abd04a8071e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:10.224363 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d7bfd-a806-4744-8f4e-abd04a8071e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:10.224975 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d7bfd-a806-4744-8f4e-abd04a8071e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:10.227692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d7bfd-a806-4744-8f4e-abd04a8071e7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:10.239253 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:10.246960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 341/676] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:10.248768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d7bfd-a806-4744-8f4e-abd04a8071e7 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:10.329034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27893d-ac0f-413e-bf58-bcd457d30aa8 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:10.374142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fada4-a9d5-4e03-abd9-6dfb2a604f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:10.374832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fada4-a9d5-4e03-abd9-6dfb2a604f4b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:10.375108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fada4-a9d5-4e03-abd9-6dfb2a604f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:10.375374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fada4-a9d5-4e03-abd9-6dfb2a604f4b None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:10.376070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fada4-a9d5-4e03-abd9-6dfb2a604f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:10.376363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fada4-a9d5-4e03-abd9-6dfb2a604f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:10.377769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fada4-a9d5-4e03-abd9-6dfb2a604f4b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:10.378772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d7bfd-a806-4744-8f4e-abd04a8071e7 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:10.395555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 336/677] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:10.396584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fada4-a9d5-4e03-abd9-6dfb2a604f4b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:10.398293 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:10.418546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bdc0d-162b-4097-a9d1-aea78f0d6f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:10.419653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bdc0d-162b-4097-a9d1-aea78f0d6f1e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:10.420225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bdc0d-162b-4097-a9d1-aea78f0d6f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:10.420717 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bdc0d-162b-4097-a9d1-aea78f0d6f1e None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:10.421700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bdc0d-162b-4097-a9d1-aea78f0d6f1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:10.422206 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bdc0d-162b-4097-a9d1-aea78f0d6f1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:10.423918 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bdc0d-162b-4097-a9d1-aea78f0d6f1e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:10.441290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 342/678] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:10.442523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bdc0d-162b-4097-a9d1-aea78f0d6f1e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:10.487858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:10.508971 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fada4-a9d5-4e03-abd9-6dfb2a604f4b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:10.545499 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1c2b5-2c6e-4ccc-bd3c-0846355b3b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:10.546148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1c2b5-2c6e-4ccc-bd3c-0846355b3b68 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:10.546428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1c2b5-2c6e-4ccc-bd3c-0846355b3b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:10.546920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1c2b5-2c6e-4ccc-bd3c-0846355b3b68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:10.554349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1c2b5-2c6e-4ccc-bd3c-0846355b3b68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:10.555868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1c2b5-2c6e-4ccc-bd3c-0846355b3b68 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:10.556626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bdc0d-162b-4097-a9d1-aea78f0d6f1e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-59f1c2b5-2c6e-4ccc-bd3c-0846355b3b68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:10.568481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:10.569570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:10.570483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:10.570483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:10.570483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:10.570483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:10.570483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:10.570483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:10.570483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:10.570483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:10.570483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 337/679] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:10.570984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1c2b5-2c6e-4ccc-bd3c-0846355b3b68 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:10.597387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d8008-268d-446e-b674-6fe6298f9924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:10.598890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d8008-268d-446e-b674-6fe6298f9924 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:10.599476 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d8008-268d-446e-b674-6fe6298f9924 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:10.600100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d8008-268d-446e-b674-6fe6298f9924 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:10.609416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d8008-268d-446e-b674-6fe6298f9924 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:10.611280 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d8008-268d-446e-b674-6fe6298f9924 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-711d8008-268d-446e-b674-6fe6298f9924 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:10.624296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:10.625614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:10.626644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:10.626644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:10.626644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:10.626644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:10.626644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:10.626644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:10.626644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:10.626644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:10.626644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:03:10.626644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:10.629163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 343/680] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:03:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:10.630275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d8008-268d-446e-b674-6fe6298f9924 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:10.683132 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:10.691361 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1c2b5-2c6e-4ccc-bd3c-0846355b3b68 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:10.726483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acffb06-5f1c-4831-b4f9-3bd69615989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:10.727086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acffb06-5f1c-4831-b4f9-3bd69615989f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:10.727354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acffb06-5f1c-4831-b4f9-3bd69615989f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:10.727618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acffb06-5f1c-4831-b4f9-3bd69615989f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:10.728332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acffb06-5f1c-4831-b4f9-3bd69615989f None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=6414692e72024816a99d63234f7c233f) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:10.728634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acffb06-5f1c-4831-b4f9-3bd69615989f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:10.730145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acffb06-5f1c-4831-b4f9-3bd69615989f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:10.741328 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 338/681] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:10 2022] GET /identity/v3/role_assignments?user.id=6414692e72024816a99d63234f7c233f&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:10.741328 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acffb06-5f1c-4831-b4f9-3bd69615989f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:10.756918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:10.802010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d8008-268d-446e-b674-6fe6298f9924 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:10.868240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b8f14-6d15-4c60-864a-d9528f91e2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:10.868861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b8f14-6d15-4c60-864a-d9528f91e2ac None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:10.869129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b8f14-6d15-4c60-864a-d9528f91e2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:10.869414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b8f14-6d15-4c60-864a-d9528f91e2ac None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:10.870110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b8f14-6d15-4c60-864a-d9528f91e2ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:10.870472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b8f14-6d15-4c60-864a-d9528f91e2ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:10.874451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b8f14-6d15-4c60-864a-d9528f91e2ac None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:10.892919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 344/682] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:10.894605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b121a9-9f76-4453-b3f4-c83399143491 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:10.894908 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b121a9-9f76-4453-b3f4-c83399143491 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:10.895169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b121a9-9f76-4453-b3f4-c83399143491 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:10.897544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 345/683] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:10.898541 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b121a9-9f76-4453-b3f4-c83399143491 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:10.920022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acffb06-5f1c-4831-b4f9-3bd69615989f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:10.961492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309de92e-b3e4-4cb9-858f-3fa3bdaa9c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:10.962100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309de92e-b3e4-4cb9-858f-3fa3bdaa9c0d None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:10.962371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309de92e-b3e4-4cb9-858f-3fa3bdaa9c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:10.962637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309de92e-b3e4-4cb9-858f-3fa3bdaa9c0d None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:10.963363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309de92e-b3e4-4cb9-858f-3fa3bdaa9c0d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:10.963891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309de92e-b3e4-4cb9-858f-3fa3bdaa9c0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:10.966058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309de92e-b3e4-4cb9-858f-3fa3bdaa9c0d None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:10.984241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 339/684] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 31 00:03:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:10.990274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86ff69-3c7a-4a03-9a8d-b64e7da9c59e None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:10.990542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86ff69-3c7a-4a03-9a8d-b64e7da9c59e None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:10.990828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86ff69-3c7a-4a03-9a8d-b64e7da9c59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:11.009951 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-da86ff69-3c7a-4a03-9a8d-b64e7da9c59e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:11.011296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-da86ff69-3c7a-4a03-9a8d-b64e7da9c59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:11.015000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:11.024976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b121a9-9f76-4453-b3f4-c83399143491 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:11.066539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3039be3-2b02-4dfb-9cc8-4d2bc1f7524b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:11.067149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3039be3-2b02-4dfb-9cc8-4d2bc1f7524b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:11.067666 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3039be3-2b02-4dfb-9cc8-4d2bc1f7524b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:11.067939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3039be3-2b02-4dfb-9cc8-4d2bc1f7524b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:11.068742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3039be3-2b02-4dfb-9cc8-4d2bc1f7524b None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=d4f2b852544b450a86fdcb5fa18fd290) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:11.069095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3039be3-2b02-4dfb-9cc8-4d2bc1f7524b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:11.070561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3039be3-2b02-4dfb-9cc8-4d2bc1f7524b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:11.076940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 346/685] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:10 2022] GET /identity/v3/role_assignments?user.id=d4f2b852544b450a86fdcb5fa18fd290&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:11.077788 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3039be3-2b02-4dfb-9cc8-4d2bc1f7524b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:11.090851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:11.114042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 340/686] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:03:11.254942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3039be3-2b02-4dfb-9cc8-4d2bc1f7524b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:11.292458 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a67f4-e987-4056-8109-2a1d8a8527aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:11.293460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a67f4-e987-4056-8109-2a1d8a8527aa None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:11.293955 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a67f4-e987-4056-8109-2a1d8a8527aa None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:11.294413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a67f4-e987-4056-8109-2a1d8a8527aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:11.324000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:11.369433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a67f4-e987-4056-8109-2a1d8a8527aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:11.370880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a67f4-e987-4056-8109-2a1d8a8527aa None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:11.475034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 347/687] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:03:11.477707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86ff69-3c7a-4a03-9a8d-b64e7da9c59e None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:11.481119 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a67f4-e987-4056-8109-2a1d8a8527aa None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:11.559199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:11.596865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86ff69-3c7a-4a03-9a8d-b64e7da9c59e None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:11.611295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a67f4-e987-4056-8109-2a1d8a8527aa None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:11.633416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d2363-9783-452e-a93e-8960a43b9ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:11.634393 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d2363-9783-452e-a93e-8960a43b9ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:11.634667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d2363-9783-452e-a93e-8960a43b9ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:11.634933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d2363-9783-452e-a93e-8960a43b9ce0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:11.648349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d2363-9783-452e-a93e-8960a43b9ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:11.651629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057a7f7-93e8-4998-bd04-60d92aa2edab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:11.652270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a7f7-93e8-4998-bd04-60d92aa2edab None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:11.652552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a7f7-93e8-4998-bd04-60d92aa2edab None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:11.652823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a7f7-93e8-4998-bd04-60d92aa2edab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-6a6d2363-9783-452e-a93e-8960a43b9ce0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:11.653399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:11.654318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:11.655496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:11.655496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:11.655496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:11.655496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:11.655496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:11.655496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:11.655496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:11.655496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:11.655496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:11.655496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:11.655496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:11.655496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:11.655496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 341/688] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:03:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:11.656831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21845f-3571-4d27-a463-0630b6e86ea5 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:11.656831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21845f-3571-4d27-a463-0630b6e86ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:11.657154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21845f-3571-4d27-a463-0630b6e86ea5 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:11.659031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 342/689] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:11.660420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21845f-3571-4d27-a463-0630b6e86ea5 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:11.672202 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057a7f7-93e8-4998-bd04-60d92aa2edab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:11.674068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057a7f7-93e8-4998-bd04-60d92aa2edab None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-8057a7f7-93e8-4998-bd04-60d92aa2edab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:11.693636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:11.695843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:11.703504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:11.703504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:11.703504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:11.703504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 348/690] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:11.703504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52128393-5d53-43e5-8166-4929b796830e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:11.703504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52128393-5d53-43e5-8166-4929b796830e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:11.703504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52128393-5d53-43e5-8166-4929b796830e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:11.726000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-52128393-5d53-43e5-8166-4929b796830e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:11.727458 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-52128393-5d53-43e5-8166-4929b796830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:11.728800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:11.778313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21845f-3571-4d27-a463-0630b6e86ea5 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:11.805005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 349/691] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:03:11.806343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52128393-5d53-43e5-8166-4929b796830e None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:11.814944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d773e-3527-4499-a0a7-d5fe29363cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:11.815842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d773e-3527-4499-a0a7-d5fe29363cbf None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:11.815842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d773e-3527-4499-a0a7-d5fe29363cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:11.816305 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d773e-3527-4499-a0a7-d5fe29363cbf None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:11.817070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d773e-3527-4499-a0a7-d5fe29363cbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:11.817496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d773e-3527-4499-a0a7-d5fe29363cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:11.819255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d773e-3527-4499-a0a7-d5fe29363cbf None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:11.828279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 343/692] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:03:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:11.833816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d773e-3527-4499-a0a7-d5fe29363cbf None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:11.853715 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:11.920786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52128393-5d53-43e5-8166-4929b796830e None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:11.941235 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d773e-3527-4499-a0a7-d5fe29363cbf None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:11.957624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:11.978234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c0abf-5a04-41cc-9227-4e04019d5b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:11.979174 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c0abf-5a04-41cc-9227-4e04019d5b7f None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:11.979609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c0abf-5a04-41cc-9227-4e04019d5b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:11.980130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c0abf-5a04-41cc-9227-4e04019d5b7f None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:11.980927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c0abf-5a04-41cc-9227-4e04019d5b7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:11.981404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c0abf-5a04-41cc-9227-4e04019d5b7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:11.982916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c0abf-5a04-41cc-9227-4e04019d5b7f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:11.988669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18e19f-2a46-4d28-9eb5-77a5655864eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:11.989340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18e19f-2a46-4d28-9eb5-77a5655864eb None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:11.989672 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18e19f-2a46-4d28-9eb5-77a5655864eb None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:11.989943 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18e19f-2a46-4d28-9eb5-77a5655864eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:11.996886 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 350/693] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:12.002606 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c0abf-5a04-41cc-9227-4e04019d5b7f None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:12.007668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18e19f-2a46-4d28-9eb5-77a5655864eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:12.009134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18e19f-2a46-4d28-9eb5-77a5655864eb None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-1b18e19f-2a46-4d28-9eb5-77a5655864eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:12.036515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:12.037826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:12.038788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:12.038788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:12.038788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:12.038788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 344/694] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:12.043684 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18e19f-2a46-4d28-9eb5-77a5655864eb None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:12.113917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:12.119009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c0abf-5a04-41cc-9227-4e04019d5b7f None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:12.156240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfced10-b17e-4923-a477-2352561048bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:12.156878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfced10-b17e-4923-a477-2352561048bf None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:12.157156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfced10-b17e-4923-a477-2352561048bf None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:12.157455 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfced10-b17e-4923-a477-2352561048bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:12.165322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfced10-b17e-4923-a477-2352561048bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:12.166775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfced10-b17e-4923-a477-2352561048bf None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:12.171213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18e19f-2a46-4d28-9eb5-77a5655864eb None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-ebfced10-b17e-4923-a477-2352561048bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:12.180763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:12.181954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:12.182881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:12.182881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:12.182881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:12.182881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:12.182881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:12.182881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:12.182881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:12.182881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:12.182881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 351/695] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:12.187817 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfced10-b17e-4923-a477-2352561048bf None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:12.211817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab63aa-383a-4c8e-a569-33067b1305ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:12.212822 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab63aa-383a-4c8e-a569-33067b1305ce None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:12.213350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab63aa-383a-4c8e-a569-33067b1305ce None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:12.213883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab63aa-383a-4c8e-a569-33067b1305ce None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:12.214737 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab63aa-383a-4c8e-a569-33067b1305ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:12.215256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab63aa-383a-4c8e-a569-33067b1305ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:12.216854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab63aa-383a-4c8e-a569-33067b1305ce None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:12.231015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 345/696] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:12.236714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab63aa-383a-4c8e-a569-33067b1305ce None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:12.264838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:12.303346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfced10-b17e-4923-a477-2352561048bf None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:12.339282 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab63aa-383a-4c8e-a569-33067b1305ce None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:12.367799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65737968-b3b6-4fd1-8ece-c817b15d9a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:12.368336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65737968-b3b6-4fd1-8ece-c817b15d9a9e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:12.368613 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65737968-b3b6-4fd1-8ece-c817b15d9a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:12.368880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65737968-b3b6-4fd1-8ece-c817b15d9a9e None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:12.369932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65737968-b3b6-4fd1-8ece-c817b15d9a9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:12.370239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65737968-b3b6-4fd1-8ece-c817b15d9a9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:12.372526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65737968-b3b6-4fd1-8ece-c817b15d9a9e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:12.378748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9796c-d76c-4485-8cb8-bf4b3708c28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:12.379656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9796c-d76c-4485-8cb8-bf4b3708c28f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:12.380136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9796c-d76c-4485-8cb8-bf4b3708c28f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:12.380637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9796c-d76c-4485-8cb8-bf4b3708c28f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:12.389362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 352/697] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:12.390548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65737968-b3b6-4fd1-8ece-c817b15d9a9e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:12.395577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9796c-d76c-4485-8cb8-bf4b3708c28f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:12.397268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9796c-d76c-4485-8cb8-bf4b3708c28f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-03f9796c-d76c-4485-8cb8-bf4b3708c28f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:12.415518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:12.416616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:12.417609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:12.417609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:12.417609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:12.417609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:12.417609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:12.417609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:12.417609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:12.417609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:12.417609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:12.417609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:12.417609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 346/698] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 31 00:03:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:12.421985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9796c-d76c-4485-8cb8-bf4b3708c28f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:12.424897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:12.524506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65737968-b3b6-4fd1-8ece-c817b15d9a9e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:12.525678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:12.548223 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9796c-d76c-4485-8cb8-bf4b3708c28f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:12.563488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae9bc5-651c-439e-ad1b-b4a850117c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:12.564130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae9bc5-651c-439e-ad1b-b4a850117c00 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:12.564413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae9bc5-651c-439e-ad1b-b4a850117c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:12.564683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae9bc5-651c-439e-ad1b-b4a850117c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:12.575910 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae9bc5-651c-439e-ad1b-b4a850117c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:12.577423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae9bc5-651c-439e-ad1b-b4a850117c00 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:12.592814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76fc8f-41d4-4846-ba0a-170c652c61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-31ae9bc5-651c-439e-ad1b-b4a850117c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:12.593239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:12.594185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:12.595081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:12.595081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:12.595081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:12.596201 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76fc8f-41d4-4846-ba0a-170c652c61a3 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:12.596699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76fc8f-41d4-4846-ba0a-170c652c61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:12.597162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76fc8f-41d4-4846-ba0a-170c652c61a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:12.598116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76fc8f-41d4-4846-ba0a-170c652c61a3 None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=85c5a65170b046d08b0d1f01c6550730) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:12.598627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76fc8f-41d4-4846-ba0a-170c652c61a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:12.599270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 353/699] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:12.600232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae9bc5-651c-439e-ad1b-b4a850117c00 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:12.601298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76fc8f-41d4-4846-ba0a-170c652c61a3 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:12.615152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 347/700] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:12 2022] GET /identity/v3/role_assignments?user.id=85c5a65170b046d08b0d1f01c6550730&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:12.615152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76fc8f-41d4-4846-ba0a-170c652c61a3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:12.742661 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:12.805766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae9bc5-651c-439e-ad1b-b4a850117c00 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:12.822191 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76fc8f-41d4-4846-ba0a-170c652c61a3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:12.845989 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4df182-46c9-4188-916d-3b2378e642e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:12.846995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4df182-46c9-4188-916d-3b2378e642e6 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:12.847482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4df182-46c9-4188-916d-3b2378e642e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:12.847968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4df182-46c9-4188-916d-3b2378e642e6 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:12.848908 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4df182-46c9-4188-916d-3b2378e642e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:12.849528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4df182-46c9-4188-916d-3b2378e642e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:12.851476 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4df182-46c9-4188-916d-3b2378e642e6 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:12.859495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518921d-0688-4a7e-8b00-c2fccc3cb9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:12.860164 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518921d-0688-4a7e-8b00-c2fccc3cb9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:12.860373 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518921d-0688-4a7e-8b00-c2fccc3cb9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:12.860636 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518921d-0688-4a7e-8b00-c2fccc3cb9c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:12.861313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518921d-0688-4a7e-8b00-c2fccc3cb9c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:12.861612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518921d-0688-4a7e-8b00-c2fccc3cb9c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:12.863139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518921d-0688-4a7e-8b00-c2fccc3cb9c5 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:12.873041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 354/701] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 31 00:03:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:12.876631 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 348/702] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:12.879416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4df182-46c9-4188-916d-3b2378e642e6 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:12.882215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518921d-0688-4a7e-8b00-c2fccc3cb9c5 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:12.895467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:12.988055 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4df182-46c9-4188-916d-3b2378e642e6 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:12.995015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518921d-0688-4a7e-8b00-c2fccc3cb9c5 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:13.019375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:13.027579 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0a28a-8068-4ff0-b1c8-26489369525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:13.028515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0a28a-8068-4ff0-b1c8-26489369525d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:13.029008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0a28a-8068-4ff0-b1c8-26489369525d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:13.029506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0a28a-8068-4ff0-b1c8-26489369525d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:13.034915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aac118-0218-4097-8939-871f76b3c7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:13.035292 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aac118-0218-4097-8939-871f76b3c7d1 None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:13.035568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aac118-0218-4097-8939-871f76b3c7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:13.035836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aac118-0218-4097-8939-871f76b3c7d1 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:13.036500 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aac118-0218-4097-8939-871f76b3c7d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:13.038210 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aac118-0218-4097-8939-871f76b3c7d1 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:13.063808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 349/703] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:03:12 2022] POST /identity/v3/users => generated 254 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:03:13.111921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0a28a-8068-4ff0-b1c8-26489369525d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:13.113796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0a28a-8068-4ff0-b1c8-26489369525d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:13.189147 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73101793-a0c2-4076-9280-8cf6952a21a4 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:13.189508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73101793-a0c2-4076-9280-8cf6952a21a4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:13.189718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73101793-a0c2-4076-9280-8cf6952a21a4 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:13.191126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 350/704] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:13.200550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1553f-cb46-4fb4-b0b6-66c29eed72af None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:13.200899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1553f-cb46-4fb4-b0b6-66c29eed72af None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:13.201091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1553f-cb46-4fb4-b0b6-66c29eed72af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:13.224974 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-31e1553f-cb46-4fb4-b0b6-66c29eed72af None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:13.226909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-31e1553f-cb46-4fb4-b0b6-66c29eed72af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:13.234524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 355/705] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:03:13.240665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0a28a-8068-4ff0-b1c8-26489369525d None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:13.273364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:13.316155 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:13.326586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 351/706] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:03:13.363730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0a28a-8068-4ff0-b1c8-26489369525d None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:13.388348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010187fc-35ea-4ba5-b17b-241a84df5bf6 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:13.388855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010187fc-35ea-4ba5-b17b-241a84df5bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:13.389250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010187fc-35ea-4ba5-b17b-241a84df5bf6 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:13.390961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 352/707] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:13.395602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48c16-c45c-4dc0-ad82-8652fbdf89ca None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:13.395882 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48c16-c45c-4dc0-ad82-8652fbdf89ca None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:13.396151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48c16-c45c-4dc0-ad82-8652fbdf89ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:13.401724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a50782-9471-41f5-8f41-3eafe42d7caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:13.402367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a50782-9471-41f5-8f41-3eafe42d7caf None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:13.402643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a50782-9471-41f5-8f41-3eafe42d7caf None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:13.402908 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a50782-9471-41f5-8f41-3eafe42d7caf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:13.415854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a50782-9471-41f5-8f41-3eafe42d7caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:13.417334 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a50782-9471-41f5-8f41-3eafe42d7caf None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:13.418653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-3cc48c16-c45c-4dc0-ad82-8652fbdf89ca None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:13.420104 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3cc48c16-c45c-4dc0-ad82-8652fbdf89ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-50a50782-9471-41f5-8f41-3eafe42d7caf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:13.434879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:13.435901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:13.437896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:13.437896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:13.437896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:13.437896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 356/708] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:13.441960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a50782-9471-41f5-8f41-3eafe42d7caf None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:13.497066 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 353/709] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:03:13.540542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:13.560962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a50782-9471-41f5-8f41-3eafe42d7caf None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:13.607131 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de109671-e850-4c02-a4a7-578068ce8055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:13.607733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de109671-e850-4c02-a4a7-578068ce8055 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:13.608010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de109671-e850-4c02-a4a7-578068ce8055 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:13.608276 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de109671-e850-4c02-a4a7-578068ce8055 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:13.608924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de109671-e850-4c02-a4a7-578068ce8055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:13.609242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de109671-e850-4c02-a4a7-578068ce8055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:13.610601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de109671-e850-4c02-a4a7-578068ce8055 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:13.619818 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc48c16-c45c-4dc0-ad82-8652fbdf89ca None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:13.626758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 357/710] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:13.638675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de109671-e850-4c02-a4a7-578068ce8055 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:13.746813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de109671-e850-4c02-a4a7-578068ce8055 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:13.786981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281804fa-59f5-4d38-82b9-c2f669ce1c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:13.788191 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281804fa-59f5-4d38-82b9-c2f669ce1c74 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:13.788668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281804fa-59f5-4d38-82b9-c2f669ce1c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:13.789409 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281804fa-59f5-4d38-82b9-c2f669ce1c74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:13.797386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281804fa-59f5-4d38-82b9-c2f669ce1c74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:13.799017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281804fa-59f5-4d38-82b9-c2f669ce1c74 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-281804fa-59f5-4d38-82b9-c2f669ce1c74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:13.811903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:13.812841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:13.813784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:13.813784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:13.813784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:13.813784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:13.813784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:13.813784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:13.813784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:13.813784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:13.813784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 358/711] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:13.814271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281804fa-59f5-4d38-82b9-c2f669ce1c74 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:13.841587 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:13.859297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc48c16-c45c-4dc0-ad82-8652fbdf89ca None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:13.888316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:13.900165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eb942-57c1-4b15-815e-b3913fa4beb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:13.901363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eb942-57c1-4b15-815e-b3913fa4beb3 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:13.901794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eb942-57c1-4b15-815e-b3913fa4beb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:13.902211 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eb942-57c1-4b15-815e-b3913fa4beb3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:13.903186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37eb942-57c1-4b15-815e-b3913fa4beb3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:13.905949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37eb942-57c1-4b15-815e-b3913fa4beb3 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-e37eb942-57c1-4b15-815e-b3913fa4beb3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:13.920652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:13.921955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:03:13.922954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:13.925618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 354/712] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Aug 31 00:03:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:13.926565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eb942-57c1-4b15-815e-b3913fa4beb3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:13.941088 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281804fa-59f5-4d38-82b9-c2f669ce1c74 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:13.979555 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b33e6-3796-4e4e-9823-e396383b1511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:13.980286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b33e6-3796-4e4e-9823-e396383b1511 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:13.980636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b33e6-3796-4e4e-9823-e396383b1511 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:13.980975 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b33e6-3796-4e4e-9823-e396383b1511 None admin] PATH_INFO: `/v3/services/network` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:13.981650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b33e6-3796-4e4e-9823-e396383b1511 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:13.983210 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b33e6-3796-4e4e-9823-e396383b1511 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-6c7b33e6-3796-4e4e-9823-e396383b1511 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:13.995398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:13.996437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:13.997351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 359/713] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:13 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:13.998163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b33e6-3796-4e4e-9823-e396383b1511 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:14.076707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eb942-57c1-4b15-815e-b3913fa4beb3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:14.078618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:14.118802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b33e6-3796-4e4e-9823-e396383b1511 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:14.126757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc093015-1cf9-47fb-81cc-5f317be48866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:14.127541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc093015-1cf9-47fb-81cc-5f317be48866 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:14.127654 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc093015-1cf9-47fb-81cc-5f317be48866 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:14.127893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc093015-1cf9-47fb-81cc-5f317be48866 None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:14.128642 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc093015-1cf9-47fb-81cc-5f317be48866 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:14.128948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc093015-1cf9-47fb-81cc-5f317be48866 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:14.130562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc093015-1cf9-47fb-81cc-5f317be48866 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:14.148975 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 355/714] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:14.149918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc093015-1cf9-47fb-81cc-5f317be48866 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:14.161551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33f4db-0cc6-445b-9126-8d4d4f41abae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:14.163348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33f4db-0cc6-445b-9126-8d4d4f41abae None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:14.163850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33f4db-0cc6-445b-9126-8d4d4f41abae None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:14.164605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33f4db-0cc6-445b-9126-8d4d4f41abae None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:14.165785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33f4db-0cc6-445b-9126-8d4d4f41abae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:14.166305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33f4db-0cc6-445b-9126-8d4d4f41abae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:14.168396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33f4db-0cc6-445b-9126-8d4d4f41abae None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:14.174539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 360/715] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 31 00:03:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:14.175845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33f4db-0cc6-445b-9126-8d4d4f41abae None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:14.204575 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:14.268263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc093015-1cf9-47fb-81cc-5f317be48866 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:14.304892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877070e0-536d-464a-9f52-404c8d0176b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:14.305553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877070e0-536d-464a-9f52-404c8d0176b1 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:14.305828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877070e0-536d-464a-9f52-404c8d0176b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:14.306099 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877070e0-536d-464a-9f52-404c8d0176b1 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:14.306764 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877070e0-536d-464a-9f52-404c8d0176b1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:14.307072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877070e0-536d-464a-9f52-404c8d0176b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:14.308440 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877070e0-536d-464a-9f52-404c8d0176b1 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:14.309179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33f4db-0cc6-445b-9126-8d4d4f41abae None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:14.317724 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 356/716] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 31 00:03:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:14.318712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877070e0-536d-464a-9f52-404c8d0176b1 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:14.348099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:14.356704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed84578-5ee6-4f5a-9221-ca6205112175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:14.357776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed84578-5ee6-4f5a-9221-ca6205112175 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:14.358260 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed84578-5ee6-4f5a-9221-ca6205112175 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:14.359482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed84578-5ee6-4f5a-9221-ca6205112175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:14.360413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed84578-5ee6-4f5a-9221-ca6205112175 None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=2016ed84211d412481d512eae23d2ab6) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:14.360910 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed84578-5ee6-4f5a-9221-ca6205112175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:14.362545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed84578-5ee6-4f5a-9221-ca6205112175 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:14.370317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 361/717] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:14 2022] GET /identity/v3/role_assignments?user.id=2016ed84211d412481d512eae23d2ab6&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:14.371346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed84578-5ee6-4f5a-9221-ca6205112175 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:14.511327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877070e0-536d-464a-9f52-404c8d0176b1 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:14.544601 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:14.545073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed84578-5ee6-4f5a-9221-ca6205112175 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:14.573513 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be7591-a627-4e3b-9c07-372f3f3cd248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:14.574130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be7591-a627-4e3b-9c07-372f3f3cd248 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:14.574405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be7591-a627-4e3b-9c07-372f3f3cd248 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:14.574673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be7591-a627-4e3b-9c07-372f3f3cd248 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:14.575406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be7591-a627-4e3b-9c07-372f3f3cd248 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:14.575712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be7591-a627-4e3b-9c07-372f3f3cd248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:14.577145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be7591-a627-4e3b-9c07-372f3f3cd248 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:14.583954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 357/718] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 31 00:03:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:14.590536 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188cd18-a9fd-4b23-a5a4-3fdc7fdd5370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:14.591418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188cd18-a9fd-4b23-a5a4-3fdc7fdd5370 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:14.591853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188cd18-a9fd-4b23-a5a4-3fdc7fdd5370 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:14.592266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188cd18-a9fd-4b23-a5a4-3fdc7fdd5370 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:14.593067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188cd18-a9fd-4b23-a5a4-3fdc7fdd5370 None admin] RBAC: Adding query filter params (type=network) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:14.593544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188cd18-a9fd-4b23-a5a4-3fdc7fdd5370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:14.595088 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188cd18-a9fd-4b23-a5a4-3fdc7fdd5370 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:14.603283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 362/719] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 31 00:03:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:15.290964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f26f91-83f6-478b-9d48-017468f05739 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:15.291508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f26f91-83f6-478b-9d48-017468f05739 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:15.291508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f26f91-83f6-478b-9d48-017468f05739 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:15.293106 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 358/720] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:15.299816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbec46-2755-4390-8739-fa3a2a1c7455 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:15.300474 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbec46-2755-4390-8739-fa3a2a1c7455 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:15.300474 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbec46-2755-4390-8739-fa3a2a1c7455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:15.331130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c5dbec46-2755-4390-8739-fa3a2a1c7455 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:15.332322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c5dbec46-2755-4390-8739-fa3a2a1c7455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:15.392118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a54d9-e8e5-4366-bbf6-440042080bb9 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:15.392413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a54d9-e8e5-4366-bbf6-440042080bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:15.392592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a54d9-e8e5-4366-bbf6-440042080bb9 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:15.395251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 359/721] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:15.399294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e189f32-5d8c-4003-b5f2-f3ca388fc7ff None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:15.399604 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e189f32-5d8c-4003-b5f2-f3ca388fc7ff None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:15.399846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e189f32-5d8c-4003-b5f2-f3ca388fc7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:15.405936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:15.429491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-4e189f32-5d8c-4003-b5f2-f3ca388fc7ff None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:15.430707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4e189f32-5d8c-4003-b5f2-f3ca388fc7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:15.436246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 363/722] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:03:15.527656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 360/723] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:03:15.793244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbec46-2755-4390-8739-fa3a2a1c7455 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:15.835363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e189f32-5d8c-4003-b5f2-f3ca388fc7ff None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:15.987814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbec46-2755-4390-8739-fa3a2a1c7455 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:15.991208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e189f32-5d8c-4003-b5f2-f3ca388fc7ff None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:16.000922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:16.030143 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12c8a9-494b-4a3d-b89d-181838e9259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:16.030774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12c8a9-494b-4a3d-b89d-181838e9259c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:16.031048 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12c8a9-494b-4a3d-b89d-181838e9259c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:16.031313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12c8a9-494b-4a3d-b89d-181838e9259c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:16.048462 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12c8a9-494b-4a3d-b89d-181838e9259c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-ee12c8a9-494b-4a3d-b89d-181838e9259c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:16.053586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:16.054710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:16.055538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:16.055538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:16.055538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:16.055538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:16.055538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:16.055538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:16.055538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:16.055538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:16.055538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:16.055538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:16.055538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:16.055538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:16.055538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 361/724] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:03:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:16.060611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12c8a9-494b-4a3d-b89d-181838e9259c None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:16.073154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536bf56-adb0-4d10-b18e-f092f06417fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:16.075674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536bf56-adb0-4d10-b18e-f092f06417fb None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:16.075674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536bf56-adb0-4d10-b18e-f092f06417fb None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:16.075674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536bf56-adb0-4d10-b18e-f092f06417fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:16.097255 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536bf56-adb0-4d10-b18e-f092f06417fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-d536bf56-adb0-4d10-b18e-f092f06417fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:16.102890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:16.103799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:16.104620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:16.104620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:16.104620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:16.104620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:16.104620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:16.104620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:16.104620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:16.104620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:16.104620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:16.104620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:16.104620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:16.104620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:16.109806 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 364/725] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:03:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:16.115515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536bf56-adb0-4d10-b18e-f092f06417fb None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:16.215704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:16.238820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12c8a9-494b-4a3d-b89d-181838e9259c None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:16.302186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693631ac-3623-4ca0-9b96-7f557f763760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:16.303938 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693631ac-3623-4ca0-9b96-7f557f763760 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:16.304408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693631ac-3623-4ca0-9b96-7f557f763760 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:16.304865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693631ac-3623-4ca0-9b96-7f557f763760 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:16.305765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693631ac-3623-4ca0-9b96-7f557f763760 None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:16.306277 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693631ac-3623-4ca0-9b96-7f557f763760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:16.307837 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693631ac-3623-4ca0-9b96-7f557f763760 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:16.320156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536bf56-adb0-4d10-b18e-f092f06417fb None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:16.322170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 362/726] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:03:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:16.324811 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693631ac-3623-4ca0-9b96-7f557f763760 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:16.385561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:16.386032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35830e5-8546-4457-b444-27d6adf9cd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:16.387065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35830e5-8546-4457-b444-27d6adf9cd06 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:16.387553 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35830e5-8546-4457-b444-27d6adf9cd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:16.388087 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35830e5-8546-4457-b444-27d6adf9cd06 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:16.388952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35830e5-8546-4457-b444-27d6adf9cd06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:16.389522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35830e5-8546-4457-b444-27d6adf9cd06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:16.392072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35830e5-8546-4457-b444-27d6adf9cd06 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:16.410087 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 365/727] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:03:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:16.415460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35830e5-8546-4457-b444-27d6adf9cd06 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:16.517671 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693631ac-3623-4ca0-9b96-7f557f763760 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:16.572812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35830e5-8546-4457-b444-27d6adf9cd06 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:16.585404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe7167-e4de-4c45-9ec0-d3b84db9060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:16.586044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe7167-e4de-4c45-9ec0-d3b84db9060e None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:16.586315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe7167-e4de-4c45-9ec0-d3b84db9060e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:16.586579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe7167-e4de-4c45-9ec0-d3b84db9060e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:16.589278 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:16.610140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe7167-e4de-4c45-9ec0-d3b84db9060e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:16.611595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe7167-e4de-4c45-9ec0-d3b84db9060e None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:16.638118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0781b61-f23a-4a3c-b025-f399fc6c0586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:16.638742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0781b61-f23a-4a3c-b025-f399fc6c0586 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:16.639010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0781b61-f23a-4a3c-b025-f399fc6c0586 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:16.639274 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0781b61-f23a-4a3c-b025-f399fc6c0586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-50fe7167-e4de-4c45-9ec0-d3b84db9060e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:16.640494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:16.641479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:16.642395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:16.642395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:16.642395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:16.642395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 363/728] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:16.643076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636e692-d0e8-4b33-9fb3-e1b5ce74c45c None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:16.643346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636e692-d0e8-4b33-9fb3-e1b5ce74c45c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:16.643607 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636e692-d0e8-4b33-9fb3-e1b5ce74c45c None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:16.645025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 364/729] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:16.650456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636e692-d0e8-4b33-9fb3-e1b5ce74c45c None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:16.655353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0781b61-f23a-4a3c-b025-f399fc6c0586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:16.657146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0781b61-f23a-4a3c-b025-f399fc6c0586 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-c0781b61-f23a-4a3c-b025-f399fc6c0586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:16.674410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:16.675496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:16.676408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:16.676408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:16.676408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:16.685182 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 366/730] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:16.685182 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f594-250f-4931-a4de-b68362e148c6 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:16.685182 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f594-250f-4931-a4de-b68362e148c6 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:16.685182 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f594-250f-4931-a4de-b68362e148c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:16.706470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7847f594-250f-4931-a4de-b68362e148c6 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:16.708809 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7847f594-250f-4931-a4de-b68362e148c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:16.747773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:16.769507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636e692-d0e8-4b33-9fb3-e1b5ce74c45c None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:16.801765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 367/731] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:03:16.803075 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847f594-250f-4931-a4de-b68362e148c6 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:16.816885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09154a02-f362-411c-b66c-f9211abbad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:16.817896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154a02-f362-411c-b66c-f9211abbad3f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:16.818276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154a02-f362-411c-b66c-f9211abbad3f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:16.818587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154a02-f362-411c-b66c-f9211abbad3f None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:16.819242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09154a02-f362-411c-b66c-f9211abbad3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:16.819538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09154a02-f362-411c-b66c-f9211abbad3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:16.821452 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09154a02-f362-411c-b66c-f9211abbad3f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:16.846918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 365/732] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:16.853069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09154a02-f362-411c-b66c-f9211abbad3f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:16.948083 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:16.956009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847f594-250f-4931-a4de-b68362e148c6 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:16.971042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09154a02-f362-411c-b66c-f9211abbad3f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:17.002202 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff22973-48b9-49b3-b545-f0647cd3bcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:17.003624 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff22973-48b9-49b3-b545-f0647cd3bcad None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.004381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff22973-48b9-49b3-b545-f0647cd3bcad None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.004871 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff22973-48b9-49b3-b545-f0647cd3bcad None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.005777 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff22973-48b9-49b3-b545-f0647cd3bcad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:17.006285 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff22973-48b9-49b3-b545-f0647cd3bcad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:17.007840 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff22973-48b9-49b3-b545-f0647cd3bcad None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:17.008241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6915db-0311-456e-833c-e8738eb8fee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:17.008872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6915db-0311-456e-833c-e8738eb8fee9 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.009145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6915db-0311-456e-833c-e8738eb8fee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.009457 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6915db-0311-456e-833c-e8738eb8fee9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.017097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6915db-0311-456e-833c-e8738eb8fee9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:17.018363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6915db-0311-456e-833c-e8738eb8fee9 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:17.023317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 368/733] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:17.024797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3933a5-cae2-4f40-8e07-bdbf22a6c178 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.025583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3933a5-cae2-4f40-8e07-bdbf22a6c178 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.026087 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3933a5-cae2-4f40-8e07-bdbf22a6c178 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.027719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 369/734] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:17.028612 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3933a5-cae2-4f40-8e07-bdbf22a6c178 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-ad6915db-0311-456e-833c-e8738eb8fee9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:17.035300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:17.036252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:17.037341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:17.037341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:17.037341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:17.037341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:17.037341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:17.037341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:17.037341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:17.037341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:17.037341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:03:17.037341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:17.041356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 366/735] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 31 00:03:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:17.042688 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db15a-8567-453e-9b45-33e3b67828ad None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.042966 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db15a-8567-453e-9b45-33e3b67828ad None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.043236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db15a-8567-453e-9b45-33e3b67828ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.061180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:17.065765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-299db15a-8567-453e-9b45-33e3b67828ad None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:17.067203 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-299db15a-8567-453e-9b45-33e3b67828ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:17.143892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 367/736] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:03:17.144643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299db15a-8567-453e-9b45-33e3b67828ad None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:17.153378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3933a5-cae2-4f40-8e07-bdbf22a6c178 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:17.189113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0483c51-75cf-40ef-b9bd-be5eeca4fd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:17.189859 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483c51-75cf-40ef-b9bd-be5eeca4fd0f None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.190140 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483c51-75cf-40ef-b9bd-be5eeca4fd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.190407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483c51-75cf-40ef-b9bd-be5eeca4fd0f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.199044 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0483c51-75cf-40ef-b9bd-be5eeca4fd0f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:17.200487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0483c51-75cf-40ef-b9bd-be5eeca4fd0f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-e0483c51-75cf-40ef-b9bd-be5eeca4fd0f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:17.212882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:17.213977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:17.214929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:17.214929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:17.214929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:17.214929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:17.214929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:17.214929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:17.214929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:17.214929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:17.214929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:03:17.214929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:17.214929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 370/737] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:03:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:17.214929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0483c51-75cf-40ef-b9bd-be5eeca4fd0f None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:17.231107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:17.260628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299db15a-8567-453e-9b45-33e3b67828ad None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:17.292824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:17.298261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdec52-7b24-4000-a7cd-d6648d108fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:17.298870 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdec52-7b24-4000-a7cd-d6648d108fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.299146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdec52-7b24-4000-a7cd-d6648d108fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.299413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdec52-7b24-4000-a7cd-d6648d108fe9 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.300140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdec52-7b24-4000-a7cd-d6648d108fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:17.300438 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdec52-7b24-4000-a7cd-d6648d108fe9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:17.301907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdec52-7b24-4000-a7cd-d6648d108fe9 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:17.319522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 368/738] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 31 00:03:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:17.321560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1871f-1e02-4362-846a-fcbc4b1dddcd None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.321837 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1871f-1e02-4362-846a-fcbc4b1dddcd None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.322112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1871f-1e02-4362-846a-fcbc4b1dddcd None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.325250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 369/739] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:17.325250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1871f-1e02-4362-846a-fcbc4b1dddcd None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:17.334691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0483c51-75cf-40ef-b9bd-be5eeca4fd0f None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:17.372022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2823bf7-04db-40b0-8b84-ed9cb8992544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:17.372651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2823bf7-04db-40b0-8b84-ed9cb8992544 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.372930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2823bf7-04db-40b0-8b84-ed9cb8992544 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.373348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2823bf7-04db-40b0-8b84-ed9cb8992544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.384655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2823bf7-04db-40b0-8b84-ed9cb8992544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-f2823bf7-04db-40b0-8b84-ed9cb8992544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:17.390186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:17.391116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:17.391972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:17.391972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:17.391972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:17.391972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:17.391972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:17.391972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:17.391972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:17.391972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:17.391972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:17.391972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:17.391972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:17.391972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:17.394643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 371/740] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:03:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:17.395717 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2823bf7-04db-40b0-8b84-ed9cb8992544 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:17.438220 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1871f-1e02-4362-846a-fcbc4b1dddcd None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:17.465633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:17.472649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918c0b4-34f5-419c-b4d9-b131a5bf72ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:17.473271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918c0b4-34f5-419c-b4d9-b131a5bf72ac None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.473547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918c0b4-34f5-419c-b4d9-b131a5bf72ac None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.473827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918c0b4-34f5-419c-b4d9-b131a5bf72ac None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.474737 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918c0b4-34f5-419c-b4d9-b131a5bf72ac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:17.475037 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918c0b4-34f5-419c-b4d9-b131a5bf72ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:17.476447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918c0b4-34f5-419c-b4d9-b131a5bf72ac None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:17.493146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 370/741] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 31 00:03:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:17.494342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc82f-469b-44c0-a7df-3fe9c35d779b None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.494615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc82f-469b-44c0-a7df-3fe9c35d779b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.494881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc82f-469b-44c0-a7df-3fe9c35d779b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.500059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2823bf7-04db-40b0-8b84-ed9cb8992544 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:17.512560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-431cc82f-469b-44c0-a7df-3fe9c35d779b None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:17.513755 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-431cc82f-469b-44c0-a7df-3fe9c35d779b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:17.535344 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d81a1-c1cb-4b7c-8866-b2847cc39008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:17.535945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d81a1-c1cb-4b7c-8866-b2847cc39008 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.536215 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d81a1-c1cb-4b7c-8866-b2847cc39008 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.536481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d81a1-c1cb-4b7c-8866-b2847cc39008 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.558084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:17.580996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 371/742] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:03:17.581836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cc82f-469b-44c0-a7df-3fe9c35d779b None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:17.605484 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d81a1-c1cb-4b7c-8866-b2847cc39008 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:17.606921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d81a1-c1cb-4b7c-8866-b2847cc39008 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:17.676238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:17.683848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cc82f-469b-44c0-a7df-3fe9c35d779b None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:17.708307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 372/743] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:03:17.709414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d81a1-c1cb-4b7c-8866-b2847cc39008 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:17.723358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191d463-9565-48f6-b668-aa5a7c75feb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:17.723976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191d463-9565-48f6-b668-aa5a7c75feb6 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.724308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191d463-9565-48f6-b668-aa5a7c75feb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.724574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191d463-9565-48f6-b668-aa5a7c75feb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.725264 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191d463-9565-48f6-b668-aa5a7c75feb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:17.725562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191d463-9565-48f6-b668-aa5a7c75feb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:17.726923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191d463-9565-48f6-b668-aa5a7c75feb6 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:17.739439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 372/744] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:03:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:17.739439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191d463-9565-48f6-b668-aa5a7c75feb6 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:17.778509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:17.816533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d81a1-c1cb-4b7c-8866-b2847cc39008 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:17.846699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191d463-9565-48f6-b668-aa5a7c75feb6 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:17.853856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885e7ef-8a93-4084-b994-31bdcc22114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:17.854468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885e7ef-8a93-4084-b994-31bdcc22114f None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.854739 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885e7ef-8a93-4084-b994-31bdcc22114f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.855005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885e7ef-8a93-4084-b994-31bdcc22114f None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.855646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885e7ef-8a93-4084-b994-31bdcc22114f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:17.856996 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885e7ef-8a93-4084-b994-31bdcc22114f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:17.873041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 373/745] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:03:17 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:03:17.873874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885e7ef-8a93-4084-b994-31bdcc22114f None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:17.892659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bacd7-2a3d-43fb-9da6-83c619000e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:17.893349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bacd7-2a3d-43fb-9da6-83c619000e7a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:17.893632 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bacd7-2a3d-43fb-9da6-83c619000e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:17.893899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bacd7-2a3d-43fb-9da6-83c619000e7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:17.914544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:17.974152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bacd7-2a3d-43fb-9da6-83c619000e7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:17.975548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bacd7-2a3d-43fb-9da6-83c619000e7a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:17.996811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885e7ef-8a93-4084-b994-31bdcc22114f None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:18.015478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:18.040503 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139004e1-2c0e-478a-981e-4aee1de2c7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:18.041264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139004e1-2c0e-478a-981e-4aee1de2c7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:18.041583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139004e1-2c0e-478a-981e-4aee1de2c7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:18.042000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139004e1-2c0e-478a-981e-4aee1de2c7e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:18.053562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139004e1-2c0e-478a-981e-4aee1de2c7e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:18.055116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139004e1-2c0e-478a-981e-4aee1de2c7e6 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-139004e1-2c0e-478a-981e-4aee1de2c7e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:18.074867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:18.075938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:18.076855 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:18.076855 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:18.076855 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:18.076855 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 374/746] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:18.076855 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139004e1-2c0e-478a-981e-4aee1de2c7e6 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:18.095586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 373/747] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:03:18.095586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bacd7-2a3d-43fb-9da6-83c619000e7a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:18.171606 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:18.188779 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139004e1-2c0e-478a-981e-4aee1de2c7e6 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:18.201022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bacd7-2a3d-43fb-9da6-83c619000e7a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:18.225933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af54572-25d7-4e31-8f2c-6a28c95af695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:18.226616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af54572-25d7-4e31-8f2c-6a28c95af695 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:18.226752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af54572-25d7-4e31-8f2c-6a28c95af695 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:18.226992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af54572-25d7-4e31-8f2c-6a28c95af695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:18.236984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b98b0-8342-4c26-b414-1fd77867e90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:18.237623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b98b0-8342-4c26-b414-1fd77867e90e None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:18.237888 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b98b0-8342-4c26-b414-1fd77867e90e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:18.238153 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b98b0-8342-4c26-b414-1fd77867e90e None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:18.238488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af54572-25d7-4e31-8f2c-6a28c95af695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:18.238794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b98b0-8342-4c26-b414-1fd77867e90e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:18.240086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af54572-25d7-4e31-8f2c-6a28c95af695 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:18.240402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b98b0-8342-4c26-b414-1fd77867e90e None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:18.246216 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-0af54572-25d7-4e31-8f2c-6a28c95af695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:18.256554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:18.257597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:18.258525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:18.258525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:18.258525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:18.258525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 375/748] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:18.259290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af54572-25d7-4e31-8f2c-6a28c95af695 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:18.262292 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 374/749] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:03:18 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:03:18.263316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b98b0-8342-4c26-b414-1fd77867e90e None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:18.406115 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b98b0-8342-4c26-b414-1fd77867e90e None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:18.424141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af54572-25d7-4e31-8f2c-6a28c95af695 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:18.457337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc43ca-6cd6-43c5-b924-c7ec461cdcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:18.457976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc43ca-6cd6-43c5-b924-c7ec461cdcd9 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:18.458243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc43ca-6cd6-43c5-b924-c7ec461cdcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:18.459003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc43ca-6cd6-43c5-b924-c7ec461cdcd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:18.467871 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e761a-052b-46fe-908c-4db82d53137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:18.468878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e761a-052b-46fe-908c-4db82d53137e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:18.469405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e761a-052b-46fe-908c-4db82d53137e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:18.469991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e761a-052b-46fe-908c-4db82d53137e None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:18.470711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e761a-052b-46fe-908c-4db82d53137e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:18.471035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e761a-052b-46fe-908c-4db82d53137e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:18.471998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc43ca-6cd6-43c5-b924-c7ec461cdcd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:18.472380 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e761a-052b-46fe-908c-4db82d53137e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:18.473462 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc43ca-6cd6-43c5-b924-c7ec461cdcd9 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:18.475180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:18.487643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 376/750] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:18.488240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e761a-052b-46fe-908c-4db82d53137e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-3dcc43ca-6cd6-43c5-b924-c7ec461cdcd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:18.489419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:18.490906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:18.491800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:18.491800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:18.491800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:18.491800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 375/751] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:18.498232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc43ca-6cd6-43c5-b924-c7ec461cdcd9 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:18.549085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:18.619554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e761a-052b-46fe-908c-4db82d53137e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:18.626874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc43ca-6cd6-43c5-b924-c7ec461cdcd9 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:18.664228 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7d786-e2a0-47e7-9f19-730cbb6631bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:18.665378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d786-e2a0-47e7-9f19-730cbb6631bc None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:18.665797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d786-e2a0-47e7-9f19-730cbb6631bc None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:18.666072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d786-e2a0-47e7-9f19-730cbb6631bc None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:18.666722 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7d786-e2a0-47e7-9f19-730cbb6631bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:18.667107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7d786-e2a0-47e7-9f19-730cbb6631bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:18.668654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7d786-e2a0-47e7-9f19-730cbb6631bc None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:18.671110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3fc5f-5172-4033-8879-2ffa7593288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:18.672069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3fc5f-5172-4033-8879-2ffa7593288f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:18.672600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3fc5f-5172-4033-8879-2ffa7593288f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:18.673128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3fc5f-5172-4033-8879-2ffa7593288f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:18.682572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 377/752] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:18.683421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7d786-e2a0-47e7-9f19-730cbb6631bc None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:18.687225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3fc5f-5172-4033-8879-2ffa7593288f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:18.689486 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3fc5f-5172-4033-8879-2ffa7593288f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-37e3fc5f-5172-4033-8879-2ffa7593288f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:18.703385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:18.704493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:18.705924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:18.705924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:18.705924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:18.705924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:18.705924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:18.705924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:18.705924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:18.705924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:18.713250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 376/753] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:18.713250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3fc5f-5172-4033-8879-2ffa7593288f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:18.765059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:18.821397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7d786-e2a0-47e7-9f19-730cbb6631bc None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:18.823715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3fc5f-5172-4033-8879-2ffa7593288f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:18.827062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:18.858244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39813013-1f4f-463a-9995-7bed47efcfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:18.859192 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39813013-1f4f-463a-9995-7bed47efcfed None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:18.859650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39813013-1f4f-463a-9995-7bed47efcfed None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:18.860086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39813013-1f4f-463a-9995-7bed47efcfed None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:18.860885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39813013-1f4f-463a-9995-7bed47efcfed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:18.861381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39813013-1f4f-463a-9995-7bed47efcfed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:18.862984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39813013-1f4f-463a-9995-7bed47efcfed None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:18.869783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bf59b-68df-4b2f-9365-0813ea0bb43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:18.870722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf59b-68df-4b2f-9365-0813ea0bb43a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:18.870722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf59b-68df-4b2f-9365-0813ea0bb43a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:18.870975 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf59b-68df-4b2f-9365-0813ea0bb43a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:18.879722 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 378/754] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:18.880693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39813013-1f4f-463a-9995-7bed47efcfed None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:18.883173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bf59b-68df-4b2f-9365-0813ea0bb43a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:18.884950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bf59b-68df-4b2f-9365-0813ea0bb43a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-de9bf59b-68df-4b2f-9365-0813ea0bb43a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:18.897418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:18.898703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:18.899633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:18.899633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:18.899633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:18.899633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:18.899633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:18.899633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:18.899633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:18.899633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:18.899633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:18.899633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:18.906876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 377/755] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 31 00:03:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:18.908066 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bf59b-68df-4b2f-9365-0813ea0bb43a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:19.010885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39813013-1f4f-463a-9995-7bed47efcfed None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:19.025844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bf59b-68df-4b2f-9365-0813ea0bb43a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:19.029921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:19.050105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a1293-6268-49fd-90ac-203e3e785494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:19.051065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a1293-6268-49fd-90ac-203e3e785494 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:19.051542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a1293-6268-49fd-90ac-203e3e785494 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:19.052002 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a1293-6268-49fd-90ac-203e3e785494 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:19.052962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a1293-6268-49fd-90ac-203e3e785494 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:19.053489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a1293-6268-49fd-90ac-203e3e785494 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:19.055297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a1293-6268-49fd-90ac-203e3e785494 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:19.062327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b7d6b-0bd5-48d5-9e79-7ca8c018685d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:19.063197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b7d6b-0bd5-48d5-9e79-7ca8c018685d None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:19.063197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b7d6b-0bd5-48d5-9e79-7ca8c018685d None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:19.063473 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b7d6b-0bd5-48d5-9e79-7ca8c018685d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:19.073239 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b7d6b-0bd5-48d5-9e79-7ca8c018685d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:19.073239 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b7d6b-0bd5-48d5-9e79-7ca8c018685d None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:19.073875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 379/756] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:19.074944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a1293-6268-49fd-90ac-203e3e785494 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-970b7d6b-0bd5-48d5-9e79-7ca8c018685d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:19.084127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:19.085089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:19.086204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:19.086204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:19.086204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:19.086204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:19.086204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:19.086204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:19.086204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:19.086204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:19.086204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 378/757] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:19.086683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b7d6b-0bd5-48d5-9e79-7ca8c018685d None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:19.122137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:19.187290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a1293-6268-49fd-90ac-203e3e785494 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:19.201491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b7d6b-0bd5-48d5-9e79-7ca8c018685d None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:19.226361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0010b1-602c-48a0-b3ec-82116c5452dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:19.227344 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0010b1-602c-48a0-b3ec-82116c5452dc None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:19.227821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0010b1-602c-48a0-b3ec-82116c5452dc None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:19.228294 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0010b1-602c-48a0-b3ec-82116c5452dc None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:19.229240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0010b1-602c-48a0-b3ec-82116c5452dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:19.229788 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0010b1-602c-48a0-b3ec-82116c5452dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:19.231398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0010b1-602c-48a0-b3ec-82116c5452dc None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:19.237730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913859e5-bbed-4138-af16-0802c7f9cb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:19.238538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913859e5-bbed-4138-af16-0802c7f9cb51 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:19.238821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913859e5-bbed-4138-af16-0802c7f9cb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:19.239140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913859e5-bbed-4138-af16-0802c7f9cb51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:19.240014 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913859e5-bbed-4138-af16-0802c7f9cb51 None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=ab3f95b2205c4429acb61bf01ea1ea94) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:19.240235 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913859e5-bbed-4138-af16-0802c7f9cb51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:19.241692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913859e5-bbed-4138-af16-0802c7f9cb51 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:19.253241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 379/758] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:19 2022] GET /identity/v3/role_assignments?user.id=ab3f95b2205c4429acb61bf01ea1ea94&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:19.253241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913859e5-bbed-4138-af16-0802c7f9cb51 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:19.258454 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 380/759] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 31 00:03:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:19.264413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0010b1-602c-48a0-b3ec-82116c5452dc None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:19.323902 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:19.348501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:19.362490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913859e5-bbed-4138-af16-0802c7f9cb51 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:19.399961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cb4ef-76ef-4f6f-813b-ca51657996fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:19.400587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cb4ef-76ef-4f6f-813b-ca51657996fc None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:19.400862 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cb4ef-76ef-4f6f-813b-ca51657996fc None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:19.401133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cb4ef-76ef-4f6f-813b-ca51657996fc None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:19.402173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cb4ef-76ef-4f6f-813b-ca51657996fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:19.402173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cb4ef-76ef-4f6f-813b-ca51657996fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:19.403877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cb4ef-76ef-4f6f-813b-ca51657996fc None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:19.418271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 380/760] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:19.424362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cb4ef-76ef-4f6f-813b-ca51657996fc None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:19.432622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0010b1-602c-48a0-b3ec-82116c5452dc None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:19.472435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0c02c-6e9b-451d-bf01-8bf64dc7ca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:19.473573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c02c-6e9b-451d-bf01-8bf64dc7ca91 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:19.474115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c02c-6e9b-451d-bf01-8bf64dc7ca91 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:19.474706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c02c-6e9b-451d-bf01-8bf64dc7ca91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:19.487498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0c02c-6e9b-451d-bf01-8bf64dc7ca91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:19.489660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0c02c-6e9b-451d-bf01-8bf64dc7ca91 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-6de0c02c-6e9b-451d-bf01-8bf64dc7ca91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:19.507137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:19.508168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:19.509081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:19.509081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:19.509081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:19.511369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 381/761] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:19.521263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0c02c-6e9b-451d-bf01-8bf64dc7ca91 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:19.535943 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cb4ef-76ef-4f6f-813b-ca51657996fc None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:19.572239 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc52d4-73b2-48c9-884f-c47173b12c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:19.572857 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc52d4-73b2-48c9-884f-c47173b12c26 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:19.573128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc52d4-73b2-48c9-884f-c47173b12c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:19.573419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc52d4-73b2-48c9-884f-c47173b12c26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:19.574661 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc52d4-73b2-48c9-884f-c47173b12c26 None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=85c5a65170b046d08b0d1f01c6550730) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:19.574908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc52d4-73b2-48c9-884f-c47173b12c26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:19.576619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc52d4-73b2-48c9-884f-c47173b12c26 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:19.584007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 381/762] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:19 2022] GET /identity/v3/role_assignments?user.id=85c5a65170b046d08b0d1f01c6550730&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:19.629546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:19.649704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0c02c-6e9b-451d-bf01-8bf64dc7ca91 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:19.700781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dc8bf-6e4d-40bd-b0ac-147964a4cd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:19.701511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dc8bf-6e4d-40bd-b0ac-147964a4cd74 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:19.701744 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dc8bf-6e4d-40bd-b0ac-147964a4cd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:19.702013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dc8bf-6e4d-40bd-b0ac-147964a4cd74 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:19.702681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dc8bf-6e4d-40bd-b0ac-147964a4cd74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:19.702981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dc8bf-6e4d-40bd-b0ac-147964a4cd74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:19.704370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dc8bf-6e4d-40bd-b0ac-147964a4cd74 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:19.723010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 382/763] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:19.729036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc52d4-73b2-48c9-884f-c47173b12c26 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:19.749148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:19.869872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc52d4-73b2-48c9-884f-c47173b12c26 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:19.905367 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f120d-14e3-422f-a3eb-9a230c6d7e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:19.905989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f120d-14e3-422f-a3eb-9a230c6d7e30 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:19.906324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f120d-14e3-422f-a3eb-9a230c6d7e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:19.906592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f120d-14e3-422f-a3eb-9a230c6d7e30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:19.913931 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f120d-14e3-422f-a3eb-9a230c6d7e30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:19.915398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f120d-14e3-422f-a3eb-9a230c6d7e30 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-9a7f120d-14e3-422f-a3eb-9a230c6d7e30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:19.927378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:19.928280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:19.929467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:19.929467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:19.929467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:19.929467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:19.929467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:19.929467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:19.929467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:19.929467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:19.929467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 382/764] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:19.934385 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dc8bf-6e4d-40bd-b0ac-147964a4cd74 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:19.979292 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9171f-1ce7-420d-860c-f4e4034d4cd0 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:19.979634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9171f-1ce7-420d-860c-f4e4034d4cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:19.979828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9171f-1ce7-420d-860c-f4e4034d4cd0 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:19.981173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 383/765] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:19.986868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01009a47-db2d-431e-9974-32c71ef3ff4a None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:19.987152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01009a47-db2d-431e-9974-32c71ef3ff4a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:19.987420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01009a47-db2d-431e-9974-32c71ef3ff4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:20.008979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-01009a47-db2d-431e-9974-32c71ef3ff4a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:20.010247 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-01009a47-db2d-431e-9974-32c71ef3ff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:20.075699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dc8bf-6e4d-40bd-b0ac-147964a4cd74 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:20.113524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b554bc-b126-410e-a3e8-d0862cbb4bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:20.114142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b554bc-b126-410e-a3e8-d0862cbb4bbd None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:20.114423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b554bc-b126-410e-a3e8-d0862cbb4bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:20.114815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b554bc-b126-410e-a3e8-d0862cbb4bbd None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:20.115526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b554bc-b126-410e-a3e8-d0862cbb4bbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:20.115829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b554bc-b126-410e-a3e8-d0862cbb4bbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:20.117307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b554bc-b126-410e-a3e8-d0862cbb4bbd None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:20.129798 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 383/766] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:20.135791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b554bc-b126-410e-a3e8-d0862cbb4bbd None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:20.148992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:20.200852 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 384/767] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:20.267451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b554bc-b126-410e-a3e8-d0862cbb4bbd None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:20.303268 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd13b47-04a1-4d67-a333-34f5ac877970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:20.303937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd13b47-04a1-4d67-a333-34f5ac877970 None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:20.304214 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd13b47-04a1-4d67-a333-34f5ac877970 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:20.304486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd13b47-04a1-4d67-a333-34f5ac877970 None admin] PATH_INFO: `/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/2016ed84211d412481d512eae23d2ab6/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:20.306420 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd13b47-04a1-4d67-a333-34f5ac877970 None admin] RBAC: Authorizing `identity:create_grant(project_id=204574e6a3c34ca4a7c266b5549bfdfa, user_id=2016ed84211d412481d512eae23d2ab6, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:20.307843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd13b47-04a1-4d67-a333-34f5ac877970 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:20.327614 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23729-951b-40de-beac-aa8467d70be5 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:20.327978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23729-951b-40de-beac-aa8467d70be5 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:20.328260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23729-951b-40de-beac-aa8467d70be5 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:20.329664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 385/768] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:20.332243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 384/769] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:03:20 2022] PUT /identity/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/2016ed84211d412481d512eae23d2ab6/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:03:20.337363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b60259-c7dd-4fec-b17b-8df9a6288468 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:20.337663 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b60259-c7dd-4fec-b17b-8df9a6288468 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:20.337905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b60259-c7dd-4fec-b17b-8df9a6288468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:20.346645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:20.363156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-e1b60259-c7dd-4fec-b17b-8df9a6288468 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:20.364430 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e1b60259-c7dd-4fec-b17b-8df9a6288468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:20.459001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 386/770] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:20.631414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd13b47-04a1-4d67-a333-34f5ac877970 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:20.699811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:20.736724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd13b47-04a1-4d67-a333-34f5ac877970 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:20.771579 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dadd7b-da1a-4cd0-af85-d802ed2a7629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:20.772233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dadd7b-da1a-4cd0-af85-d802ed2a7629 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:20.772513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dadd7b-da1a-4cd0-af85-d802ed2a7629 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:20.772785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dadd7b-da1a-4cd0-af85-d802ed2a7629 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:20.773431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dadd7b-da1a-4cd0-af85-d802ed2a7629 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:20.774818 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dadd7b-da1a-4cd0-af85-d802ed2a7629 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-67dadd7b-da1a-4cd0-af85-d802ed2a7629 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:20.785242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:20.786292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:20.787304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 385/771] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Aug 31 00:03:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:20.793742 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b60259-c7dd-4fec-b17b-8df9a6288468 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:20.829042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dadd7b-da1a-4cd0-af85-d802ed2a7629 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:20.938611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dadd7b-da1a-4cd0-af85-d802ed2a7629 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:20.973302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c16b15-13b1-4f41-8a44-df091486af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:20.974050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c16b15-13b1-4f41-8a44-df091486af4c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:20.974335 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c16b15-13b1-4f41-8a44-df091486af4c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:20.974677 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c16b15-13b1-4f41-8a44-df091486af4c None admin] PATH_INFO: `/v3/services/network` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:20.975426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c16b15-13b1-4f41-8a44-df091486af4c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:20.976848 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c16b15-13b1-4f41-8a44-df091486af4c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:20.985335 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-70c16b15-13b1-4f41-8a44-df091486af4c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:20.987298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:20.988241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:20.989079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 386/772] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:20 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:20.997362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b60259-c7dd-4fec-b17b-8df9a6288468 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:20.998354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c16b15-13b1-4f41-8a44-df091486af4c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:21.030557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:21.035927 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47ac9-0def-409b-abf2-db1b6e7fe237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:21.036842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47ac9-0def-409b-abf2-db1b6e7fe237 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:21.037417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47ac9-0def-409b-abf2-db1b6e7fe237 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:21.038238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47ac9-0def-409b-abf2-db1b6e7fe237 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:21.039099 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab47ac9-0def-409b-abf2-db1b6e7fe237 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:21.039719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab47ac9-0def-409b-abf2-db1b6e7fe237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:21.041313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab47ac9-0def-409b-abf2-db1b6e7fe237 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:21.046438 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 387/773] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 31 00:03:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:21.053860 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47ac9-0def-409b-abf2-db1b6e7fe237 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:21.181822 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47ac9-0def-409b-abf2-db1b6e7fe237 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:21.218755 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ee2c0-adee-489d-b3e1-87a1caf91df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:21.219769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ee2c0-adee-489d-b3e1-87a1caf91df3 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:21.220266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ee2c0-adee-489d-b3e1-87a1caf91df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:21.220730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ee2c0-adee-489d-b3e1-87a1caf91df3 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:21.221592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ee2c0-adee-489d-b3e1-87a1caf91df3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:21.222226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ee2c0-adee-489d-b3e1-87a1caf91df3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:21.223793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ee2c0-adee-489d-b3e1-87a1caf91df3 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:21.229622 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 388/774] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 31 00:03:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:21.238331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ee2c0-adee-489d-b3e1-87a1caf91df3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:21.240904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c16b15-13b1-4f41-8a44-df091486af4c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:21.315211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176282c0-4606-4aa5-ba8b-9653325f8aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:21.315829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176282c0-4606-4aa5-ba8b-9653325f8aaa None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:21.316105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176282c0-4606-4aa5-ba8b-9653325f8aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:21.316372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176282c0-4606-4aa5-ba8b-9653325f8aaa None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:21.317008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176282c0-4606-4aa5-ba8b-9653325f8aaa None admin] RBAC: Adding query filter params (name=network) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:21.317342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176282c0-4606-4aa5-ba8b-9653325f8aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:21.319790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176282c0-4606-4aa5-ba8b-9653325f8aaa None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:21.331631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 387/775] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 31 00:03:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:21.335755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176282c0-4606-4aa5-ba8b-9653325f8aaa None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:21.345583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:21.404708 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ee2c0-adee-489d-b3e1-87a1caf91df3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:21.455748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:21.484778 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85114d85-d3ff-4ede-9d3d-b3bc60b3180a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:21.485508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85114d85-d3ff-4ede-9d3d-b3bc60b3180a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:21.485693 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85114d85-d3ff-4ede-9d3d-b3bc60b3180a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:21.485962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85114d85-d3ff-4ede-9d3d-b3bc60b3180a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:21.486669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85114d85-d3ff-4ede-9d3d-b3bc60b3180a None admin] RBAC: Adding query filter params (interface=public, service_id=4ecfa5f9fbed4a4c9ddce537e41afe25, region_id=RegionOne) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:21.486972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85114d85-d3ff-4ede-9d3d-b3bc60b3180a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:21.488393 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85114d85-d3ff-4ede-9d3d-b3bc60b3180a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:21.497745 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 389/776] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 31 00:03:21 2022] GET /identity/v3/endpoints?service_id=4ecfa5f9fbed4a4c9ddce537e41afe25&interface=public®ion_id=RegionOne => generated 194 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:21.503561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85114d85-d3ff-4ede-9d3d-b3bc60b3180a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:21.543777 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176282c0-4606-4aa5-ba8b-9653325f8aaa None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:21.620944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048637df-be04-4577-ae25-0d52537dfc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:21.621668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048637df-be04-4577-ae25-0d52537dfc41 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:21.621943 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048637df-be04-4577-ae25-0d52537dfc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:21.622211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048637df-be04-4577-ae25-0d52537dfc41 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:21.626264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048637df-be04-4577-ae25-0d52537dfc41 None admin] RBAC: Adding query filter params (type=network) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:21.626573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048637df-be04-4577-ae25-0d52537dfc41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:21.629442 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048637df-be04-4577-ae25-0d52537dfc41 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:21.643001 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 388/777] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 31 00:03:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:21.648722 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048637df-be04-4577-ae25-0d52537dfc41 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:21.692547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85114d85-d3ff-4ede-9d3d-b3bc60b3180a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:21.719114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:21.731717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5393b-84e3-4c23-ae9e-cf75dcbcad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:21.732331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5393b-84e3-4c23-ae9e-cf75dcbcad97 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:21.732610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5393b-84e3-4c23-ae9e-cf75dcbcad97 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:21.732877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5393b-84e3-4c23-ae9e-cf75dcbcad97 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:21.733534 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5393b-84e3-4c23-ae9e-cf75dcbcad97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:21.735064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5393b-84e3-4c23-ae9e-cf75dcbcad97 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:21.740978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 390/778] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 31 00:03:21 2022] GET /identity/v3/services => generated 772 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:21.742363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a04a3-9dbb-4e28-b4c0-e2f3d01b71bb None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:21.742645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a04a3-9dbb-4e28-b4c0-e2f3d01b71bb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:21.742914 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a04a3-9dbb-4e28-b4c0-e2f3d01b71bb None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:21.748336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 391/779] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:21.750358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753a20c-ef3c-4236-8fdf-29d86e950cc8 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:21.750676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753a20c-ef3c-4236-8fdf-29d86e950cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:21.751038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753a20c-ef3c-4236-8fdf-29d86e950cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:21.779648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-6753a20c-ef3c-4236-8fdf-29d86e950cc8 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:21.781026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6753a20c-ef3c-4236-8fdf-29d86e950cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:21.949716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 392/780] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:21.973100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708773c-eb66-4d01-ab5a-4a97db7977d3 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:21.973644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708773c-eb66-4d01-ab5a-4a97db7977d3 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:21.974228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708773c-eb66-4d01-ab5a-4a97db7977d3 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:21.976254 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 393/781] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:21.981407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048637df-be04-4577-ae25-0d52537dfc41 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:21.982249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9fa28-1c08-4c9c-972f-1fd433792bc1 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:21.982249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9fa28-1c08-4c9c-972f-1fd433792bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:21.982249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9fa28-1c08-4c9c-972f-1fd433792bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:22.007990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:22.009327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a2d9fa28-1c08-4c9c-972f-1fd433792bc1 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:22.013104 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a2d9fa28-1c08-4c9c-972f-1fd433792bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:22.019591 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa906968-5a20-4c9b-9e64-b0cceb0445b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:22.020392 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa906968-5a20-4c9b-9e64-b0cceb0445b9 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:22.020907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa906968-5a20-4c9b-9e64-b0cceb0445b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:22.021443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa906968-5a20-4c9b-9e64-b0cceb0445b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:22.022292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa906968-5a20-4c9b-9e64-b0cceb0445b9 None admin] RBAC: Adding query filter params (interface=public, service_id=cb5fff44990941fc9b013ff93d18e0c1, region_id=RegionOne) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:22.022744 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa906968-5a20-4c9b-9e64-b0cceb0445b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:22.024260 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa906968-5a20-4c9b-9e64-b0cceb0445b9 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:22.033798 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 389/782] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 31 00:03:21 2022] GET /identity/v3/endpoints?service_id=cb5fff44990941fc9b013ff93d18e0c1&interface=public®ion_id=RegionOne => generated 194 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:22.042217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa906968-5a20-4c9b-9e64-b0cceb0445b9 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:22.143138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 394/783] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:22.147421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa906968-5a20-4c9b-9e64-b0cceb0445b9 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:22.182346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316f901-f1c9-4d7e-9dc6-dacadff467dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:22.182948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316f901-f1c9-4d7e-9dc6-dacadff467dc None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:22.183218 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316f901-f1c9-4d7e-9dc6-dacadff467dc None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:22.183480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316f901-f1c9-4d7e-9dc6-dacadff467dc None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:22.184077 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316f901-f1c9-4d7e-9dc6-dacadff467dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:22.185442 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316f901-f1c9-4d7e-9dc6-dacadff467dc None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:22.190922 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 390/784] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 31 00:03:22 2022] GET /identity/v3/services => generated 772 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:22.303885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9fa28-1c08-4c9c-972f-1fd433792bc1 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:22.365446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:22.424726 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9fa28-1c08-4c9c-972f-1fd433792bc1 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:22.460169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d08d5a-c7a9-420f-b278-9d8e16f1d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:22.460858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d08d5a-c7a9-420f-b278-9d8e16f1d28b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:22.461130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d08d5a-c7a9-420f-b278-9d8e16f1d28b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:22.461423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d08d5a-c7a9-420f-b278-9d8e16f1d28b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:22.471903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d08d5a-c7a9-420f-b278-9d8e16f1d28b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-d2d08d5a-c7a9-420f-b278-9d8e16f1d28b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:22.476859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:22.477848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:22.478820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:22.478820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:22.478820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:22.478820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:22.478820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:22.478820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:22.478820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:22.478820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:22.478820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:22.478820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:22.478820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:22.478820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:22.478820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 395/785] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:22.484014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316f901-f1c9-4d7e-9dc6-dacadff467dc None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:22.509632 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d08d5a-c7a9-420f-b278-9d8e16f1d28b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:22.557129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:22.674762 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316f901-f1c9-4d7e-9dc6-dacadff467dc None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:22.691640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d08d5a-c7a9-420f-b278-9d8e16f1d28b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:22.708509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:22.746611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687f79-5e66-4645-b5be-d74d7f8d98de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:22.747245 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687f79-5e66-4645-b5be-d74d7f8d98de None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:22.747515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687f79-5e66-4645-b5be-d74d7f8d98de None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:22.747772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687f79-5e66-4645-b5be-d74d7f8d98de None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:22.748429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687f79-5e66-4645-b5be-d74d7f8d98de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:22.748722 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687f79-5e66-4645-b5be-d74d7f8d98de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:22.750101 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687f79-5e66-4645-b5be-d74d7f8d98de None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:22.760534 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2239d-54b3-437d-b7a0-845448f42d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:22.761162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2239d-54b3-437d-b7a0-845448f42d4c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:22.761458 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2239d-54b3-437d-b7a0-845448f42d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:22.761720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2239d-54b3-437d-b7a0-845448f42d4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:22.764432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 391/786] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:22.769819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687f79-5e66-4645-b5be-d74d7f8d98de None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:22.783940 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2239d-54b3-437d-b7a0-845448f42d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-8ee2239d-54b3-437d-b7a0-845448f42d4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:22.788842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:22.790004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:22.790855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:22.790855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:22.790855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:22.790855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:22.790855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:22.790855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:22.790855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:22.790855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:22.790855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:22.790855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:22.790855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:22.790855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:22.793139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 396/787] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:03:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:22.799138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2239d-54b3-437d-b7a0-845448f42d4c None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:22.930109 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687f79-5e66-4645-b5be-d74d7f8d98de None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:22.931757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2239d-54b3-437d-b7a0-845448f42d4c None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:22.946031 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:22.977059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414f6cd-be95-4884-a2d7-13602c7beea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:22.977770 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f6cd-be95-4884-a2d7-13602c7beea9 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:22.978048 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f6cd-be95-4884-a2d7-13602c7beea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:22.978377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f6cd-be95-4884-a2d7-13602c7beea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:22.992042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414f6cd-be95-4884-a2d7-13602c7beea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:22.993596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414f6cd-be95-4884-a2d7-13602c7beea9 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-f414f6cd-be95-4884-a2d7-13602c7beea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:23.010893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:23.011938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:23.013271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:23.013271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:23.013271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:23.013271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 392/788] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:23.018512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24996dd-b780-4c29-8594-8c84d450a181 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:23.018805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24996dd-b780-4c29-8594-8c84d450a181 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:23.019072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24996dd-b780-4c29-8594-8c84d450a181 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:23.024575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 393/789] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:23.024575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24996dd-b780-4c29-8594-8c84d450a181 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:23.102784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987f8e0-e936-4544-92a2-a4d8304b6825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:23.103782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987f8e0-e936-4544-92a2-a4d8304b6825 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:23.104280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987f8e0-e936-4544-92a2-a4d8304b6825 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:23.104753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987f8e0-e936-4544-92a2-a4d8304b6825 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:23.105656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987f8e0-e936-4544-92a2-a4d8304b6825 None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:23.106156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987f8e0-e936-4544-92a2-a4d8304b6825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:23.107771 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987f8e0-e936-4544-92a2-a4d8304b6825 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:23.116863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 397/790] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:03:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:23.118516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48218fe-ae21-4e20-b047-a3b11b156f19 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:23.119000 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48218fe-ae21-4e20-b047-a3b11b156f19 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:23.119486 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48218fe-ae21-4e20-b047-a3b11b156f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:23.137490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-e48218fe-ae21-4e20-b047-a3b11b156f19 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:23.138962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e48218fe-ae21-4e20-b047-a3b11b156f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:23.151199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24996dd-b780-4c29-8594-8c84d450a181 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:23.163748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:23.191795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46c3f9-445c-4eda-9357-fc09af9e7fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:23.192279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46c3f9-445c-4eda-9357-fc09af9e7fda None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:23.192629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46c3f9-445c-4eda-9357-fc09af9e7fda None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:23.192901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46c3f9-445c-4eda-9357-fc09af9e7fda None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:23.193619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46c3f9-445c-4eda-9357-fc09af9e7fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:23.193921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46c3f9-445c-4eda-9357-fc09af9e7fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:23.195385 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46c3f9-445c-4eda-9357-fc09af9e7fda None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:23.214746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 394/792] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:23.215083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 398/792] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:23.215664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46c3f9-445c-4eda-9357-fc09af9e7fda None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:23.216380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48218fe-ae21-4e20-b047-a3b11b156f19 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:23.243355 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:23.326333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46c3f9-445c-4eda-9357-fc09af9e7fda None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:23.363847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597f49-2327-42cf-900a-853698dd3ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:23.364871 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597f49-2327-42cf-900a-853698dd3ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:23.365397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597f49-2327-42cf-900a-853698dd3ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:23.365935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597f49-2327-42cf-900a-853698dd3ca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:23.377187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8597f49-2327-42cf-900a-853698dd3ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:23.379018 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8597f49-2327-42cf-900a-853698dd3ca1 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:23.383687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48218fe-ae21-4e20-b047-a3b11b156f19 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-c8597f49-2327-42cf-900a-853698dd3ca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:23.395460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:23.396917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:23.397900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:23.397900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:23.397900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:23.400176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 395/793] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:23.405657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597f49-2327-42cf-900a-853698dd3ca1 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:23.450783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f9691-4496-4077-a93a-d99b8dd066c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:23.451126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f9691-4496-4077-a93a-d99b8dd066c0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:23.451402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f9691-4496-4077-a93a-d99b8dd066c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:23.451670 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f9691-4496-4077-a93a-d99b8dd066c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:23.467315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f9691-4496-4077-a93a-d99b8dd066c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:23.468737 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f9691-4496-4077-a93a-d99b8dd066c0 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:23.492858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-167f9691-4496-4077-a93a-d99b8dd066c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:23.493791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:23.494715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:23.495669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:23.495669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:23.495669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:23.495669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:23.495669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:23.495669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:23.495669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:23.495669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:23.495669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:03:23.495669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:23.495669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 399/794] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:03:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:23.509120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f9691-4496-4077-a93a-d99b8dd066c0 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:23.522272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597f49-2327-42cf-900a-853698dd3ca1 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:23.559937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:23.587444 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3102304-b395-432b-a842-919ecd786e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:23.592618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3102304-b395-432b-a842-919ecd786e08 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:23.593109 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3102304-b395-432b-a842-919ecd786e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:23.593625 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3102304-b395-432b-a842-919ecd786e08 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:23.594467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3102304-b395-432b-a842-919ecd786e08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:23.595022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3102304-b395-432b-a842-919ecd786e08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:23.596644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3102304-b395-432b-a842-919ecd786e08 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:23.619275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 396/795] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:23.622841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3102304-b395-432b-a842-919ecd786e08 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:23.707908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f9691-4496-4077-a93a-d99b8dd066c0 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:23.750924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3102304-b395-432b-a842-919ecd786e08 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:23.751485 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed5d04-03de-4ceb-8c69-96d2d13b74f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:23.751861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed5d04-03de-4ceb-8c69-96d2d13b74f0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:23.752132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed5d04-03de-4ceb-8c69-96d2d13b74f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:23.752395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed5d04-03de-4ceb-8c69-96d2d13b74f0 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:23.753127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed5d04-03de-4ceb-8c69-96d2d13b74f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:23.753453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed5d04-03de-4ceb-8c69-96d2d13b74f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:23.755885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed5d04-03de-4ceb-8c69-96d2d13b74f0 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:23.776089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 400/796] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 31 00:03:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:23.777252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed5d04-03de-4ceb-8c69-96d2d13b74f0 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:23.802521 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf07155-c21f-4894-9199-9e428e48240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:23.803362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf07155-c21f-4894-9199-9e428e48240f None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:23.803936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf07155-c21f-4894-9199-9e428e48240f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:23.804219 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf07155-c21f-4894-9199-9e428e48240f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:23.808140 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:23.815367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf07155-c21f-4894-9199-9e428e48240f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:23.817635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf07155-c21f-4894-9199-9e428e48240f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-eaf07155-c21f-4894-9199-9e428e48240f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:23.833852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:23.835166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:23.836322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:23.836322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:23.836322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:23.836322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:23.836322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:23.836322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:23.836322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:23.836322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:23.836322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:03:23.836322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:23.836860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 397/797] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 31 00:03:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:23.837705 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf07155-c21f-4894-9199-9e428e48240f None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:23.871574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:23.896758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed5d04-03de-4ceb-8c69-96d2d13b74f0 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:23.933012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd6418-42a2-473b-9952-33fd08133f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:23.933667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd6418-42a2-473b-9952-33fd08133f67 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:23.933965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd6418-42a2-473b-9952-33fd08133f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:23.934199 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd6418-42a2-473b-9952-33fd08133f67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:23.945697 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd6418-42a2-473b-9952-33fd08133f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-5bfd6418-42a2-473b-9952-33fd08133f67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:23.950399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:23.951346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:23.952273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:23.952273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:23.952273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:23.952273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:23.952273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:23.952273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:23.952273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:23.952273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:23.952273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:23.952273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:23.952273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:23.952273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:23.952273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 401/798] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:03:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:23.952968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd6418-42a2-473b-9952-33fd08133f67 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:23.972291 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf07155-c21f-4894-9199-9e428e48240f None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:24.007746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492c000-62ec-4229-a9a6-52f4ee940712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:24.008614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492c000-62ec-4229-a9a6-52f4ee940712 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.009059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492c000-62ec-4229-a9a6-52f4ee940712 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.009347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492c000-62ec-4229-a9a6-52f4ee940712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.020868 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492c000-62ec-4229-a9a6-52f4ee940712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:24.022530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492c000-62ec-4229-a9a6-52f4ee940712 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-e492c000-62ec-4229-a9a6-52f4ee940712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:24.037982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:24.038984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:24.039892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:24.039892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:24.039892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:24.039892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 398/799] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:24.040481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dcbac-d44d-4bea-8dcd-836edff91365 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.040688 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dcbac-d44d-4bea-8dcd-836edff91365 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.040950 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dcbac-d44d-4bea-8dcd-836edff91365 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.046264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 399/800] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:24.047124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dcbac-d44d-4bea-8dcd-836edff91365 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:24.069266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd6418-42a2-473b-9952-33fd08133f67 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:24.101195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:24.114507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e253af-3e7f-4956-bec0-20fdfd6c53bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:24.115103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e253af-3e7f-4956-bec0-20fdfd6c53bf None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.115396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e253af-3e7f-4956-bec0-20fdfd6c53bf None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.115704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e253af-3e7f-4956-bec0-20fdfd6c53bf None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.116819 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e253af-3e7f-4956-bec0-20fdfd6c53bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:24.117063 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e253af-3e7f-4956-bec0-20fdfd6c53bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:24.118598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e253af-3e7f-4956-bec0-20fdfd6c53bf None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:24.127090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:24.143458 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 402/801] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 31 00:03:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:24.143458 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e253af-3e7f-4956-bec0-20fdfd6c53bf None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:24.162415 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dcbac-d44d-4bea-8dcd-836edff91365 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:24.199275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08cebf-45b1-416a-9d3e-b46375509648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:24.200031 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08cebf-45b1-416a-9d3e-b46375509648 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.200310 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08cebf-45b1-416a-9d3e-b46375509648 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.200881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08cebf-45b1-416a-9d3e-b46375509648 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.201832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08cebf-45b1-416a-9d3e-b46375509648 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:24.202133 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08cebf-45b1-416a-9d3e-b46375509648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:24.203916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08cebf-45b1-416a-9d3e-b46375509648 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:24.214408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 400/802] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:03:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:24.215605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b682f-0dab-4a02-a1e6-55b4c6bc6a60 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.215883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b682f-0dab-4a02-a1e6-55b4c6bc6a60 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.216144 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b682f-0dab-4a02-a1e6-55b4c6bc6a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.234254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-644b682f-0dab-4a02-a1e6-55b4c6bc6a60 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:24.235356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-644b682f-0dab-4a02-a1e6-55b4c6bc6a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:24.251122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e253af-3e7f-4956-bec0-20fdfd6c53bf None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:24.287659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e82e54-2932-4b74-ad94-e9091cc144c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:24.288488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e82e54-2932-4b74-ad94-e9091cc144c8 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.288763 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e82e54-2932-4b74-ad94-e9091cc144c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.289025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e82e54-2932-4b74-ad94-e9091cc144c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.289692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e82e54-2932-4b74-ad94-e9091cc144c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:24.290054 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e82e54-2932-4b74-ad94-e9091cc144c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:24.291489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e82e54-2932-4b74-ad94-e9091cc144c8 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:24.303100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 403/803] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:24.303904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e82e54-2932-4b74-ad94-e9091cc144c8 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:24.313899 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 401/804] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:24.315087 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b682f-0dab-4a02-a1e6-55b4c6bc6a60 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:24.361951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:24.381638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:24.426527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e82e54-2932-4b74-ad94-e9091cc144c8 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:24.431433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b682f-0dab-4a02-a1e6-55b4c6bc6a60 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:24.460175 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ea611-9395-4a87-81c7-a5cdc35e0368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:24.460806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ea611-9395-4a87-81c7-a5cdc35e0368 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.461075 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ea611-9395-4a87-81c7-a5cdc35e0368 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.461364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ea611-9395-4a87-81c7-a5cdc35e0368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.469842 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881f918-830d-4a96-ad1d-30b141beb16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:24.470468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881f918-830d-4a96-ad1d-30b141beb16b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.470742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881f918-830d-4a96-ad1d-30b141beb16b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.471013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881f918-830d-4a96-ad1d-30b141beb16b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.471897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ea611-9395-4a87-81c7-a5cdc35e0368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:24.473360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ea611-9395-4a87-81c7-a5cdc35e0368 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:24.482461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881f918-830d-4a96-ad1d-30b141beb16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:24.483924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881f918-830d-4a96-ad1d-30b141beb16b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-940ea611-9395-4a87-81c7-a5cdc35e0368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:24.487689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:24.488605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:24.490416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:24.490416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:24.490416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:24.493753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 404/805] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:24.494584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ea611-9395-4a87-81c7-a5cdc35e0368 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-1881f918-830d-4a96-ad1d-30b141beb16b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:24.500361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:24.501339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:24.502270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:24.502270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:24.502270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:24.502836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 402/806] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:24.503740 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753308fc-dc90-4b69-b1f8-dd55c3a73607 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.504027 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753308fc-dc90-4b69-b1f8-dd55c3a73607 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.504290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753308fc-dc90-4b69-b1f8-dd55c3a73607 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.505937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 403/807] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:24.506620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753308fc-dc90-4b69-b1f8-dd55c3a73607 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:24.609192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ea611-9395-4a87-81c7-a5cdc35e0368 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:24.609767 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:24.618695 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:24.619679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753308fc-dc90-4b69-b1f8-dd55c3a73607 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:24.645649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2929d-3b66-4faa-a725-bf03665986d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:24.646459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2929d-3b66-4faa-a725-bf03665986d7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.646742 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2929d-3b66-4faa-a725-bf03665986d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.647001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2929d-3b66-4faa-a725-bf03665986d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.653612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2929d-3b66-4faa-a725-bf03665986d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:24.654764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bce128-2905-4634-b378-6f52a6b46d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:24.655409 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2929d-3b66-4faa-a725-bf03665986d7 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:24.655506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bce128-2905-4634-b378-6f52a6b46d57 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.655719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bce128-2905-4634-b378-6f52a6b46d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.655986 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bce128-2905-4634-b378-6f52a6b46d57 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.656614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bce128-2905-4634-b378-6f52a6b46d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:24.656909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bce128-2905-4634-b378-6f52a6b46d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:24.658265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bce128-2905-4634-b378-6f52a6b46d57 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-e7a2929d-3b66-4faa-a725-bf03665986d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:24.666603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:24.667555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:24.668456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:24.668456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:24.668456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:24.668456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:24.668456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:24.668456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:24.668456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:24.668456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:24.668456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 405/808] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:24.668456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2929d-3b66-4faa-a725-bf03665986d7 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:24.677241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 404/809] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:24.677241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cbf20-6df1-4372-8878-cdc44d71ee5e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.677241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cbf20-6df1-4372-8878-cdc44d71ee5e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.677241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cbf20-6df1-4372-8878-cdc44d71ee5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.693732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-274cbf20-6df1-4372-8878-cdc44d71ee5e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:24.694903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-274cbf20-6df1-4372-8878-cdc44d71ee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:24.761118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 405/810] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:24.761977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cbf20-6df1-4372-8878-cdc44d71ee5e None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:24.774420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2929d-3b66-4faa-a725-bf03665986d7 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:24.811377 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444afaa-669a-4045-987a-899677fe9204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:24.811982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444afaa-669a-4045-987a-899677fe9204 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.812230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444afaa-669a-4045-987a-899677fe9204 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.812490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444afaa-669a-4045-987a-899677fe9204 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.813134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444afaa-669a-4045-987a-899677fe9204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:24.813585 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444afaa-669a-4045-987a-899677fe9204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:24.814822 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444afaa-669a-4045-987a-899677fe9204 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:24.830823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 406/811] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:24.830823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444afaa-669a-4045-987a-899677fe9204 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:24.851600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:24.860511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:24.871439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cbf20-6df1-4372-8878-cdc44d71ee5e None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:24.907181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b143c-ed6d-48c1-ab6e-3f1836730d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:24.907803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b143c-ed6d-48c1-ab6e-3f1836730d3e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.908130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b143c-ed6d-48c1-ab6e-3f1836730d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.908433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b143c-ed6d-48c1-ab6e-3f1836730d3e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.909010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b143c-ed6d-48c1-ab6e-3f1836730d3e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:24.910504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b143c-ed6d-48c1-ab6e-3f1836730d3e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-343b143c-ed6d-48c1-ab6e-3f1836730d3e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:24.920545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:24.921772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:24.922776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 406/812] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Aug 31 00:03:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:24.923751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b143c-ed6d-48c1-ab6e-3f1836730d3e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:24.940827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444afaa-669a-4045-987a-899677fe9204 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:24.975522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b5795-aed2-4610-9948-787f8b2f3495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:24.976277 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b5795-aed2-4610-9948-787f8b2f3495 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:24.976554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b5795-aed2-4610-9948-787f8b2f3495 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:24.976778 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b5795-aed2-4610-9948-787f8b2f3495 None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:24.978049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b5795-aed2-4610-9948-787f8b2f3495 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:24.978349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b5795-aed2-4610-9948-787f8b2f3495 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:24.979759 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b5795-aed2-4610-9948-787f8b2f3495 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:24.996520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 407/813] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:24.996520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b5795-aed2-4610-9948-787f8b2f3495 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:25.027716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b143c-ed6d-48c1-ab6e-3f1836730d3e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:25.061919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b154c07-4ade-44fb-80ba-a3d85db4b859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:25.062546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b154c07-4ade-44fb-80ba-a3d85db4b859 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:25.062814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b154c07-4ade-44fb-80ba-a3d85db4b859 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:25.063081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b154c07-4ade-44fb-80ba-a3d85db4b859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:25.069822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b154c07-4ade-44fb-80ba-a3d85db4b859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:25.071253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b154c07-4ade-44fb-80ba-a3d85db4b859 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-6b154c07-4ade-44fb-80ba-a3d85db4b859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:25.082644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:25.083550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:25.084864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:25.084864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:25.084864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:25.084864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:25.084864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:25.084864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:25.084864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:25.084864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:25.084864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 407/814] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:25.085407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:25.085482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b154c07-4ade-44fb-80ba-a3d85db4b859 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:25.097505 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:25.100271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b5795-aed2-4610-9948-787f8b2f3495 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:25.134097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e701eb-8607-4ecc-9c00-6e4e078a05a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:25.134712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e701eb-8607-4ecc-9c00-6e4e078a05a2 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:25.135002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e701eb-8607-4ecc-9c00-6e4e078a05a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:25.135245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e701eb-8607-4ecc-9c00-6e4e078a05a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:25.142404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e701eb-8607-4ecc-9c00-6e4e078a05a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:25.143832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e701eb-8607-4ecc-9c00-6e4e078a05a2 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-97e701eb-8607-4ecc-9c00-6e4e078a05a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:25.155296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:25.156240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:25.157166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:25.157166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:25.157166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:25.157166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:25.157166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:25.157166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:25.157166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:25.157166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:25.157166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:25.157166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:25.157166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 408/815] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 31 00:03:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:25.157166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e701eb-8607-4ecc-9c00-6e4e078a05a2 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:25.189895 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b154c07-4ade-44fb-80ba-a3d85db4b859 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:25.223020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ba4b-9f4c-41ab-adce-6016ba71f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:25.223616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ba4b-9f4c-41ab-adce-6016ba71f1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:25.224030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ba4b-9f4c-41ab-adce-6016ba71f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:25.224308 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ba4b-9f4c-41ab-adce-6016ba71f1c8 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:25.224928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063ba4b-9f4c-41ab-adce-6016ba71f1c8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:25.225313 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063ba4b-9f4c-41ab-adce-6016ba71f1c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:25.226784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063ba4b-9f4c-41ab-adce-6016ba71f1c8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:25.231129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 408/816] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 31 00:03:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:25.231981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ba4b-9f4c-41ab-adce-6016ba71f1c8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:25.256519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e701eb-8607-4ecc-9c00-6e4e078a05a2 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:25.291336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38157d46-0010-4961-a965-b3e8928c8d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:25.291884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38157d46-0010-4961-a965-b3e8928c8d04 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:25.292148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38157d46-0010-4961-a965-b3e8928c8d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:25.292429 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38157d46-0010-4961-a965-b3e8928c8d04 None admin] PATH_INFO: `/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/85c5a65170b046d08b0d1f01c6550730/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:25.294307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38157d46-0010-4961-a965-b3e8928c8d04 None admin] RBAC: Authorizing `identity:create_grant(project_id=204574e6a3c34ca4a7c266b5549bfdfa, user_id=85c5a65170b046d08b0d1f01c6550730, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:25.295703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38157d46-0010-4961-a965-b3e8928c8d04 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:25.304781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:25.308809 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 409/817] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:03:25 2022] PUT /identity/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/85c5a65170b046d08b0d1f01c6550730/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:03:25.309630 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38157d46-0010-4961-a965-b3e8928c8d04 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:25.322472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:25.340625 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ba4b-9f4c-41ab-adce-6016ba71f1c8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:25.383642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf5ee0-1af8-42d6-be81-f3ac0a5e4b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:25.384298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf5ee0-1af8-42d6-be81-f3ac0a5e4b36 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:25.384592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf5ee0-1af8-42d6-be81-f3ac0a5e4b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:25.384843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf5ee0-1af8-42d6-be81-f3ac0a5e4b36 None admin] PATH_INFO: `/v3/services/network` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:25.385480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf5ee0-1af8-42d6-be81-f3ac0a5e4b36 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:25.386924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf5ee0-1af8-42d6-be81-f3ac0a5e4b36 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-b9cf5ee0-1af8-42d6-be81-f3ac0a5e4b36 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:25.396633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:25.398013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:25.398984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 409/818] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:25 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:25.399927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf5ee0-1af8-42d6-be81-f3ac0a5e4b36 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:25.435260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38157d46-0010-4961-a965-b3e8928c8d04 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:25.480266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04312e5f-3abc-4fbe-9d42-2916ed1984cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:25.481029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04312e5f-3abc-4fbe-9d42-2916ed1984cc None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:25.481494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04312e5f-3abc-4fbe-9d42-2916ed1984cc None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:25.481830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04312e5f-3abc-4fbe-9d42-2916ed1984cc None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:25.482587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04312e5f-3abc-4fbe-9d42-2916ed1984cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:25.482970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04312e5f-3abc-4fbe-9d42-2916ed1984cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:25.484400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04312e5f-3abc-4fbe-9d42-2916ed1984cc None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:25.497868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 410/819] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:25.498807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04312e5f-3abc-4fbe-9d42-2916ed1984cc None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:25.514414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf5ee0-1af8-42d6-be81-f3ac0a5e4b36 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:25.553525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70837297-68a1-4cb4-9fd5-82419a8b927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:25.554093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70837297-68a1-4cb4-9fd5-82419a8b927a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:25.554350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70837297-68a1-4cb4-9fd5-82419a8b927a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:25.554622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70837297-68a1-4cb4-9fd5-82419a8b927a None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:25.555356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70837297-68a1-4cb4-9fd5-82419a8b927a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:25.555660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70837297-68a1-4cb4-9fd5-82419a8b927a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:25.557096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70837297-68a1-4cb4-9fd5-82419a8b927a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:25.558977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:25.569769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:25.578199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 410/820] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 31 00:03:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:25.583487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70837297-68a1-4cb4-9fd5-82419a8b927a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:25.605949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04312e5f-3abc-4fbe-9d42-2916ed1984cc None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:25.640580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e01020-8597-4d6a-a116-7c43ce4691d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:25.641259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e01020-8597-4d6a-a116-7c43ce4691d0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:25.641470 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e01020-8597-4d6a-a116-7c43ce4691d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:25.641733 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e01020-8597-4d6a-a116-7c43ce4691d0 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:25.642359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e01020-8597-4d6a-a116-7c43ce4691d0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:25.642657 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e01020-8597-4d6a-a116-7c43ce4691d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:25.644007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e01020-8597-4d6a-a116-7c43ce4691d0 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:25.649226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 411/821] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 31 00:03:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:25.649916 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e01020-8597-4d6a-a116-7c43ce4691d0 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:25.693354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70837297-68a1-4cb4-9fd5-82419a8b927a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:25.727943 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd4594-bfab-4a1e-ab10-2b9478170199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:25.728576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4594-bfab-4a1e-ab10-2b9478170199 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:25.728925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4594-bfab-4a1e-ab10-2b9478170199 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:25.729193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4594-bfab-4a1e-ab10-2b9478170199 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:25.729835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd4594-bfab-4a1e-ab10-2b9478170199 None admin] RBAC: Adding query filter params (name=network) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:25.730129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd4594-bfab-4a1e-ab10-2b9478170199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:25.731585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd4594-bfab-4a1e-ab10-2b9478170199 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:25.741339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 411/822] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 31 00:03:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:25.742384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd4594-bfab-4a1e-ab10-2b9478170199 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:25.751127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e01020-8597-4d6a-a116-7c43ce4691d0 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:25.782360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:25.788265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1499d-b257-4184-a4fe-c3675091f650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:25.789289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1499d-b257-4184-a4fe-c3675091f650 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:25.789760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1499d-b257-4184-a4fe-c3675091f650 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:25.790193 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1499d-b257-4184-a4fe-c3675091f650 None admin] PATH_INFO: `/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/ab3f95b2205c4429acb61bf01ea1ea94/roles/25b5ec65e62b4d48881026cb00fbd74f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:25.807105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:25.808326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1499d-b257-4184-a4fe-c3675091f650 None admin] RBAC: Authorizing `identity:create_grant(project_id=204574e6a3c34ca4a7c266b5549bfdfa, user_id=ab3f95b2205c4429acb61bf01ea1ea94, role_id=25b5ec65e62b4d48881026cb00fbd74f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:25.810272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1499d-b257-4184-a4fe-c3675091f650 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:25.825851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 412/823] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:03:25 2022] PUT /identity/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/ab3f95b2205c4429acb61bf01ea1ea94/roles/25b5ec65e62b4d48881026cb00fbd74f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:03:25.827400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1499d-b257-4184-a4fe-c3675091f650 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:25.861466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd4594-bfab-4a1e-ab10-2b9478170199 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:25.901012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553625a-ae8f-45c8-b77e-4ad66fb987fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:25.901685 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553625a-ae8f-45c8-b77e-4ad66fb987fc None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:25.901961 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553625a-ae8f-45c8-b77e-4ad66fb987fc None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:25.902230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553625a-ae8f-45c8-b77e-4ad66fb987fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:25.963040 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1499d-b257-4184-a4fe-c3675091f650 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:25.989655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553625a-ae8f-45c8-b77e-4ad66fb987fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:25.991329 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553625a-ae8f-45c8-b77e-4ad66fb987fc None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:26.013531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800f4a4-3784-4ce5-9f16-3adcbe12421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:26.014288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800f4a4-3784-4ce5-9f16-3adcbe12421e None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:26.014516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800f4a4-3784-4ce5-9f16-3adcbe12421e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:26.014782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800f4a4-3784-4ce5-9f16-3adcbe12421e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:26.015451 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800f4a4-3784-4ce5-9f16-3adcbe12421e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:26.016797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800f4a4-3784-4ce5-9f16-3adcbe12421e None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:26.044665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 413/824] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:03:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:03:26.045865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800f4a4-3784-4ce5-9f16-3adcbe12421e None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:26.064058 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:26.115429 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:26.134333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 412/825] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:03:26.142757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553625a-ae8f-45c8-b77e-4ad66fb987fc None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:26.195337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800f4a4-3784-4ce5-9f16-3adcbe12421e None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:26.231901 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80147ac1-f0c9-4d91-a5de-6cf8fec8741e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:26.232532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80147ac1-f0c9-4d91-a5de-6cf8fec8741e None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:26.232786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80147ac1-f0c9-4d91-a5de-6cf8fec8741e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:26.233054 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80147ac1-f0c9-4d91-a5de-6cf8fec8741e None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:26.233776 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80147ac1-f0c9-4d91-a5de-6cf8fec8741e None admin] RBAC: Adding query filter params (type=network) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:26.234078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80147ac1-f0c9-4d91-a5de-6cf8fec8741e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:26.235527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80147ac1-f0c9-4d91-a5de-6cf8fec8741e None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:26.245347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 414/826] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 31 00:03:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:26.247576 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80147ac1-f0c9-4d91-a5de-6cf8fec8741e None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:26.347015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553625a-ae8f-45c8-b77e-4ad66fb987fc None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:26.351465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:26.356121 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80147ac1-f0c9-4d91-a5de-6cf8fec8741e None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:26.396175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bf658-33a7-4d35-8a6f-1362f8fc701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:26.397627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bf658-33a7-4d35-8a6f-1362f8fc701c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:26.397992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bf658-33a7-4d35-8a6f-1362f8fc701c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:26.398356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bf658-33a7-4d35-8a6f-1362f8fc701c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:26.412580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bf658-33a7-4d35-8a6f-1362f8fc701c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:26.414261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bf658-33a7-4d35-8a6f-1362f8fc701c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:26.419285 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a71850-13d7-4a9a-a2c5-414edb2e43ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:26.420095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a71850-13d7-4a9a-a2c5-414edb2e43ec None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:26.420515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a71850-13d7-4a9a-a2c5-414edb2e43ec None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:26.420929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a71850-13d7-4a9a-a2c5-414edb2e43ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:26.421798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a71850-13d7-4a9a-a2c5-414edb2e43ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:26.423497 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a71850-13d7-4a9a-a2c5-414edb2e43ec None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-f22bf658-33a7-4d35-8a6f-1362f8fc701c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:26.433980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:26.435161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:26.436265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:26.436265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:26.436265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:26.437602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 413/827] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:26.444641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bf658-33a7-4d35-8a6f-1362f8fc701c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:26.461490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 415/828] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:03:26 2022] POST /identity/v3/endpoints => generated 337 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:03:26.461680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:26.578314 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bf658-33a7-4d35-8a6f-1362f8fc701c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:26.641875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee0cd3-1de8-46b9-929f-72373801fc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:26.642850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee0cd3-1de8-46b9-929f-72373801fc3b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:26.643330 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee0cd3-1de8-46b9-929f-72373801fc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:26.643775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee0cd3-1de8-46b9-929f-72373801fc3b None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:26.644619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee0cd3-1de8-46b9-929f-72373801fc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:26.645099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee0cd3-1de8-46b9-929f-72373801fc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:26.646912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee0cd3-1de8-46b9-929f-72373801fc3b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:26.665564 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 414/829] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:26.671292 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a71850-13d7-4a9a-a2c5-414edb2e43ec None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:26.785433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a71850-13d7-4a9a-a2c5-414edb2e43ec None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:26.822507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853564d-2281-42fb-884f-970152318cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:26.823492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853564d-2281-42fb-884f-970152318cfb None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:26.823946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853564d-2281-42fb-884f-970152318cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:26.824391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853564d-2281-42fb-884f-970152318cfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:26.831682 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853564d-2281-42fb-884f-970152318cfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:26.833532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853564d-2281-42fb-884f-970152318cfb None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-3853564d-2281-42fb-884f-970152318cfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:26.845249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:26.846180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:26.847098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:26.847098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:26.847098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:26.847098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:26.847098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:26.847098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:26.847098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:26.847098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:26.849118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 416/830] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:26.854826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee0cd3-1de8-46b9-929f-72373801fc3b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:26.942028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:26.994559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee0cd3-1de8-46b9-929f-72373801fc3b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:27.031742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf40c2-9c1b-4c0e-812b-d1cf3e5e5243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:27.032354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf40c2-9c1b-4c0e-812b-d1cf3e5e5243 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:27.032627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf40c2-9c1b-4c0e-812b-d1cf3e5e5243 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:27.032892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf40c2-9c1b-4c0e-812b-d1cf3e5e5243 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:27.033604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf40c2-9c1b-4c0e-812b-d1cf3e5e5243 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:27.033903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf40c2-9c1b-4c0e-812b-d1cf3e5e5243 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:27.035360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf40c2-9c1b-4c0e-812b-d1cf3e5e5243 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:27.053727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 415/831] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:27.059417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853564d-2281-42fb-884f-970152318cfb None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:27.075739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:27.166448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853564d-2281-42fb-884f-970152318cfb None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:27.202780 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b5a65-f756-4f01-84b0-4b60fd32cbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:27.203727 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b5a65-f756-4f01-84b0-4b60fd32cbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:27.204197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b5a65-f756-4f01-84b0-4b60fd32cbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:27.204671 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b5a65-f756-4f01-84b0-4b60fd32cbb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:27.205618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b5a65-f756-4f01-84b0-4b60fd32cbb9 None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=2016ed84211d412481d512eae23d2ab6) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:27.206135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b5a65-f756-4f01-84b0-4b60fd32cbb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:27.207746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b5a65-f756-4f01-84b0-4b60fd32cbb9 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:27.215057 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 417/832] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:27 2022] GET /identity/v3/role_assignments?user.id=2016ed84211d412481d512eae23d2ab6&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:27.345283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666ce11-09fd-4836-bfe3-aeb35eee154f None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:27.345941 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666ce11-09fd-4836-bfe3-aeb35eee154f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:27.346439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666ce11-09fd-4836-bfe3-aeb35eee154f None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:27.348310 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 416/833] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:27.353823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed238659-4b2b-48c0-844b-42a0a9ef4285 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:27.354215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed238659-4b2b-48c0-844b-42a0a9ef4285 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:27.354581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed238659-4b2b-48c0-844b-42a0a9ef4285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:27.374436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ed238659-4b2b-48c0-844b-42a0a9ef4285 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:27.375775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ed238659-4b2b-48c0-844b-42a0a9ef4285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:27.451174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 418/834] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:27.721174 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666ce11-09fd-4836-bfe3-aeb35eee154f None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:27.828221 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666ce11-09fd-4836-bfe3-aeb35eee154f None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:27.853116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:27.865301 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d3c6f-ea8a-47e3-a05e-5f3cf844c93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:27.865913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d3c6f-ea8a-47e3-a05e-5f3cf844c93a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:27.866140 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d3c6f-ea8a-47e3-a05e-5f3cf844c93a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:27.866409 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d3c6f-ea8a-47e3-a05e-5f3cf844c93a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:27.877286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d3c6f-ea8a-47e3-a05e-5f3cf844c93a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-c72d3c6f-ea8a-47e3-a05e-5f3cf844c93a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:27.882492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:27.883424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:27.884299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:27.884299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:27.884299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:27.884299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:27.884299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:27.884299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:27.884299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:27.884299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:27.884299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:27.884299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:27.884299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:27.884299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:27.884299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 417/835] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:03:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:27.889926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed238659-4b2b-48c0-844b-42a0a9ef4285 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:27.901196 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:27.973966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be696-8618-452e-a44b-490a79df916d None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:27.973966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be696-8618-452e-a44b-490a79df916d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:27.973966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be696-8618-452e-a44b-490a79df916d None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:27.973966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 418/836] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:27.978097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0047c-633a-41d5-905a-9de55b1c26e7 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:27.978379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0047c-633a-41d5-905a-9de55b1c26e7 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:27.978650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0047c-633a-41d5-905a-9de55b1c26e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:27.996744 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-9ff0047c-633a-41d5-905a-9de55b1c26e7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:27.997958 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9ff0047c-633a-41d5-905a-9de55b1c26e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:27.998933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed238659-4b2b-48c0-844b-42a0a9ef4285 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:28.035794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3280dc8-c024-4a0b-b1bf-5385077a3c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:28.036460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3280dc8-c024-4a0b-b1bf-5385077a3c7e None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:28.036755 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3280dc8-c024-4a0b-b1bf-5385077a3c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:28.037025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3280dc8-c024-4a0b-b1bf-5385077a3c7e None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:28.037726 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3280dc8-c024-4a0b-b1bf-5385077a3c7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:28.038030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3280dc8-c024-4a0b-b1bf-5385077a3c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:28.039439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3280dc8-c024-4a0b-b1bf-5385077a3c7e None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:28.048659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 419/837] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:03:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:28.058696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3280dc8-c024-4a0b-b1bf-5385077a3c7e None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:28.084395 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 419/838] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:28.140487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:28.173004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3280dc8-c024-4a0b-b1bf-5385077a3c7e None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:28.207512 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37700eae-cfa0-4c29-98d2-5bc3bf423b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:28.208201 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37700eae-cfa0-4c29-98d2-5bc3bf423b07 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:28.208508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37700eae-cfa0-4c29-98d2-5bc3bf423b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:28.209114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37700eae-cfa0-4c29-98d2-5bc3bf423b07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:28.219948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37700eae-cfa0-4c29-98d2-5bc3bf423b07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:28.221491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37700eae-cfa0-4c29-98d2-5bc3bf423b07 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-37700eae-cfa0-4c29-98d2-5bc3bf423b07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:28.236420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:28.237407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:28.238298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:28.238298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:28.238298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:28.238298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 420/839] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:28.244207 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0047c-633a-41d5-905a-9de55b1c26e7 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:28.348919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0047c-633a-41d5-905a-9de55b1c26e7 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:28.365536 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:28.366807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37700eae-cfa0-4c29-98d2-5bc3bf423b07 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:28.390351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac5afc-672b-4bbc-953b-ba9d4d85eacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:28.390968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac5afc-672b-4bbc-953b-ba9d4d85eacb None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:28.391249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac5afc-672b-4bbc-953b-ba9d4d85eacb None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:28.391515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac5afc-672b-4bbc-953b-ba9d4d85eacb None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:28.392164 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac5afc-672b-4bbc-953b-ba9d4d85eacb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:28.392465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac5afc-672b-4bbc-953b-ba9d4d85eacb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:28.393921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac5afc-672b-4bbc-953b-ba9d4d85eacb None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:28.407007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 420/840] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:28.408276 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9902059-33cf-4695-a4c2-668405769fbf None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:28.408561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9902059-33cf-4695-a4c2-668405769fbf None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:28.408832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9902059-33cf-4695-a4c2-668405769fbf None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:28.410349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 421/841] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:28.415480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230f805-9199-49a2-9158-bf11f8cadaa0 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:28.415872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230f805-9199-49a2-9158-bf11f8cadaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:28.416086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230f805-9199-49a2-9158-bf11f8cadaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:28.434980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-6230f805-9199-49a2-9158-bf11f8cadaa0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:28.437026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-6230f805-9199-49a2-9158-bf11f8cadaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:28.483922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37700eae-cfa0-4c29-98d2-5bc3bf423b07 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:28.509114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 422/842] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:28.509714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:28.518116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230f805-9199-49a2-9158-bf11f8cadaa0 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:28.525996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5fbaf-6e0a-402d-86f2-5f1899f68013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:28.530116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5fbaf-6e0a-402d-86f2-5f1899f68013 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:28.530520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5fbaf-6e0a-402d-86f2-5f1899f68013 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:28.530867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5fbaf-6e0a-402d-86f2-5f1899f68013 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:28.544566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5fbaf-6e0a-402d-86f2-5f1899f68013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-e5f5fbaf-6e0a-402d-86f2-5f1899f68013 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:28.551548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:28.552662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:28.558627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:28.558627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:28.558627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:28.558627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:28.558627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:28.558627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:28.558627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:28.558627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:28.558627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:28.558627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:28.558627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:03:28.558627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:28.558627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 421/843] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:03:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:28.560908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5fbaf-6e0a-402d-86f2-5f1899f68013 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:28.631962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230f805-9199-49a2-9158-bf11f8cadaa0 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:28.634825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:28.670030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e4ae3-c174-447a-b4ca-a04d5bab60d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:28.671005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e4ae3-c174-447a-b4ca-a04d5bab60d6 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:28.671480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e4ae3-c174-447a-b4ca-a04d5bab60d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:28.671946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e4ae3-c174-447a-b4ca-a04d5bab60d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:28.679941 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e4ae3-c174-447a-b4ca-a04d5bab60d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:28.681678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e4ae3-c174-447a-b4ca-a04d5bab60d6 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:28.688692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5fbaf-6e0a-402d-86f2-5f1899f68013 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-5c6e4ae3-c174-447a-b4ca-a04d5bab60d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:28.694068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:28.695024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:28.695973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:28.695973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:28.695973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:28.695973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:28.695973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:28.695973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:28.695973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:28.695973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:28.695973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:03:28.695973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:28.703027 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 423/844] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:03:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:28.704558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e4ae3-c174-447a-b4ca-a04d5bab60d6 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:28.728297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316382-4524-4acb-92cb-a60e74a6b933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:28.728933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316382-4524-4acb-92cb-a60e74a6b933 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:28.729563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316382-4524-4acb-92cb-a60e74a6b933 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:28.731037 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316382-4524-4acb-92cb-a60e74a6b933 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:28.731954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f316382-4524-4acb-92cb-a60e74a6b933 None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:28.732616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f316382-4524-4acb-92cb-a60e74a6b933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:28.735249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f316382-4524-4acb-92cb-a60e74a6b933 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:28.750984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 422/845] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:03:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:28.754028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316382-4524-4acb-92cb-a60e74a6b933 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:28.803770 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:28.827634 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e4ae3-c174-447a-b4ca-a04d5bab60d6 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:28.860203 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316382-4524-4acb-92cb-a60e74a6b933 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:28.863493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54ae89-89ae-487d-b067-f0963d81be30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:28.864103 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54ae89-89ae-487d-b067-f0963d81be30 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:28.864468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54ae89-89ae-487d-b067-f0963d81be30 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:28.864743 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54ae89-89ae-487d-b067-f0963d81be30 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:28.865498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54ae89-89ae-487d-b067-f0963d81be30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:28.866034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54ae89-89ae-487d-b067-f0963d81be30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:28.867256 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54ae89-89ae-487d-b067-f0963d81be30 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:28.889510 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 424/846] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 31 00:03:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:28.889510 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54ae89-89ae-487d-b067-f0963d81be30 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:28.903091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0046b26-77cc-4653-b668-926ccc593750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:28.903761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0046b26-77cc-4653-b668-926ccc593750 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:28.903991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0046b26-77cc-4653-b668-926ccc593750 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:28.904579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0046b26-77cc-4653-b668-926ccc593750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:28.910973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:28.917312 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0046b26-77cc-4653-b668-926ccc593750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:28.918780 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0046b26-77cc-4653-b668-926ccc593750 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-d0046b26-77cc-4653-b668-926ccc593750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:28.933516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:28.934583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:28.935527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:28.935527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:28.935527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:28.935527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 423/847] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:28.935527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0046b26-77cc-4653-b668-926ccc593750 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:28.995448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54ae89-89ae-487d-b067-f0963d81be30 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:29.034423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc04be1-7dbd-48f6-b21e-3a646d6a1272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:29.035205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc04be1-7dbd-48f6-b21e-3a646d6a1272 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:29.035479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc04be1-7dbd-48f6-b21e-3a646d6a1272 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:29.035745 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc04be1-7dbd-48f6-b21e-3a646d6a1272 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:29.036452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc04be1-7dbd-48f6-b21e-3a646d6a1272 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:29.037826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc04be1-7dbd-48f6-b21e-3a646d6a1272 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:29.040718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:29.046815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0046b26-77cc-4653-b668-926ccc593750 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-3bc04be1-7dbd-48f6-b21e-3a646d6a1272 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:29.047348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:29.048351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:29.049942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 425/848] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:03:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:29.050753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc04be1-7dbd-48f6-b21e-3a646d6a1272 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:29.096276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f0d86-4b65-4315-b852-1d7642193882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:29.096985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0d86-4b65-4315-b852-1d7642193882 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:29.097350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0d86-4b65-4315-b852-1d7642193882 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:29.097806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0d86-4b65-4315-b852-1d7642193882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:29.145419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:29.162476 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc04be1-7dbd-48f6-b21e-3a646d6a1272 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:29.167769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f0d86-4b65-4315-b852-1d7642193882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:29.169245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f0d86-4b65-4315-b852-1d7642193882 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:29.198850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5a4cb-1ea6-44db-bd28-fb7651421930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:29.199692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5a4cb-1ea6-44db-bd28-fb7651421930 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:29.200221 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5a4cb-1ea6-44db-bd28-fb7651421930 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:29.200483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5a4cb-1ea6-44db-bd28-fb7651421930 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:29.201116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5a4cb-1ea6-44db-bd28-fb7651421930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:29.201438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5a4cb-1ea6-44db-bd28-fb7651421930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:29.202885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5a4cb-1ea6-44db-bd28-fb7651421930 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:29.219643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 426/849] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:29.219643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5a4cb-1ea6-44db-bd28-fb7651421930 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:29.274151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:29.286334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 424/850] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:03:29.286334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f0d86-4b65-4315-b852-1d7642193882 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:29.323627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5a4cb-1ea6-44db-bd28-fb7651421930 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:29.358855 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8447c8-1adc-4f1a-98fe-280a2128103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:29.359377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8447c8-1adc-4f1a-98fe-280a2128103e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:29.359649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8447c8-1adc-4f1a-98fe-280a2128103e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:29.359912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8447c8-1adc-4f1a-98fe-280a2128103e None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:29.360529 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8447c8-1adc-4f1a-98fe-280a2128103e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:29.360822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8447c8-1adc-4f1a-98fe-280a2128103e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:29.362194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8447c8-1adc-4f1a-98fe-280a2128103e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:29.366680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 427/851] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:03:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:29.367524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8447c8-1adc-4f1a-98fe-280a2128103e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:29.378952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:29.389981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f0d86-4b65-4315-b852-1d7642193882 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:29.425687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59823219-8a56-44a3-b39a-0ac1d575498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:29.426315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59823219-8a56-44a3-b39a-0ac1d575498d None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:29.426583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59823219-8a56-44a3-b39a-0ac1d575498d None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:29.426933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59823219-8a56-44a3-b39a-0ac1d575498d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:29.434807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59823219-8a56-44a3-b39a-0ac1d575498d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:29.436250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59823219-8a56-44a3-b39a-0ac1d575498d None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-59823219-8a56-44a3-b39a-0ac1d575498d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:29.448157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:29.449297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:29.450265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:29.450265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:29.450265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:29.450265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:29.450265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:29.450265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:29.450265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:29.450265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:29.450265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:03:29.450265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:29.450265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 425/852] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 31 00:03:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:29.450892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7a14-f447-4713-aab4-0cfc58981298 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:29.451105 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7a14-f447-4713-aab4-0cfc58981298 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:29.451286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7a14-f447-4713-aab4-0cfc58981298 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:29.452498 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 426/853] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:29.453186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e7a14-f447-4713-aab4-0cfc58981298 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:29.471413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8447c8-1adc-4f1a-98fe-280a2128103e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:29.506402 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ac41a-eeeb-411b-9d17-a8567b312ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:29.507012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ac41a-eeeb-411b-9d17-a8567b312ead None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:29.507281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ac41a-eeeb-411b-9d17-a8567b312ead None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:29.507546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ac41a-eeeb-411b-9d17-a8567b312ead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:29.509988 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:29.517471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ac41a-eeeb-411b-9d17-a8567b312ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:29.518899 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ac41a-eeeb-411b-9d17-a8567b312ead None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-1e2ac41a-eeeb-411b-9d17-a8567b312ead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:29.535892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:29.536933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:29.537883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:29.537883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:29.537883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:29.537883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 428/854] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:29.538790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ac41a-eeeb-411b-9d17-a8567b312ead None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:29.562070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e7a14-f447-4713-aab4-0cfc58981298 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:29.596508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b634fd-cff0-4980-b64d-364107a284b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:29.597108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b634fd-cff0-4980-b64d-364107a284b5 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:29.597411 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b634fd-cff0-4980-b64d-364107a284b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:29.597675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b634fd-cff0-4980-b64d-364107a284b5 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:29.598312 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b634fd-cff0-4980-b64d-364107a284b5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:29.598595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b634fd-cff0-4980-b64d-364107a284b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:29.600000 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b634fd-cff0-4980-b64d-364107a284b5 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:29.603335 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:29.617003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 427/855] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:03:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:29.617003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daee2fc-b0aa-4541-96c6-1cf1218aa9ba None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:29.617003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daee2fc-b0aa-4541-96c6-1cf1218aa9ba None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:29.617003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daee2fc-b0aa-4541-96c6-1cf1218aa9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:29.638738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-0daee2fc-b0aa-4541-96c6-1cf1218aa9ba None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:29.640012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0daee2fc-b0aa-4541-96c6-1cf1218aa9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:29.649068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ac41a-eeeb-411b-9d17-a8567b312ead None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:29.691701 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91cdfb-ee37-47d2-a38b-2f64391a90af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:29.692792 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cdfb-ee37-47d2-a38b-2f64391a90af None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:29.693354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cdfb-ee37-47d2-a38b-2f64391a90af None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:29.693818 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cdfb-ee37-47d2-a38b-2f64391a90af None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:29.694766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91cdfb-ee37-47d2-a38b-2f64391a90af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:29.695171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91cdfb-ee37-47d2-a38b-2f64391a90af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:29.696711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91cdfb-ee37-47d2-a38b-2f64391a90af None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:29.725247 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 428/856] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:29.725247 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daee2fc-b0aa-4541-96c6-1cf1218aa9ba None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:29.729400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 429/857] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 31 00:03:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:29.735042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91cdfb-ee37-47d2-a38b-2f64391a90af None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:29.786745 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:29.840240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daee2fc-b0aa-4541-96c6-1cf1218aa9ba None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:29.876781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0586c-be46-46dc-ae7f-6b939c3d80e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:29.877441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0586c-be46-46dc-ae7f-6b939c3d80e3 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:29.877656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0586c-be46-46dc-ae7f-6b939c3d80e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:29.877980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0586c-be46-46dc-ae7f-6b939c3d80e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:29.878632 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0586c-be46-46dc-ae7f-6b939c3d80e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:29.879110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0586c-be46-46dc-ae7f-6b939c3d80e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:29.880841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0586c-be46-46dc-ae7f-6b939c3d80e3 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:29.882379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91cdfb-ee37-47d2-a38b-2f64391a90af None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:29.892904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 429/858] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:29.898562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0586c-be46-46dc-ae7f-6b939c3d80e3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:29.907388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:29.925855 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823603fa-4cfe-49b1-8fe7-f475e95b2501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:29.927069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823603fa-4cfe-49b1-8fe7-f475e95b2501 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:29.927520 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823603fa-4cfe-49b1-8fe7-f475e95b2501 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:29.928125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823603fa-4cfe-49b1-8fe7-f475e95b2501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:30.005049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0586c-be46-46dc-ae7f-6b939c3d80e3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:30.012439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823603fa-4cfe-49b1-8fe7-f475e95b2501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:30.013901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823603fa-4cfe-49b1-8fe7-f475e95b2501 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:30.016313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:30.046160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70205cb-95d7-49bc-8666-5981152c935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:30.046786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70205cb-95d7-49bc-8666-5981152c935d None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:30.047056 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70205cb-95d7-49bc-8666-5981152c935d None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:30.047318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70205cb-95d7-49bc-8666-5981152c935d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:30.054125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70205cb-95d7-49bc-8666-5981152c935d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:30.055552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70205cb-95d7-49bc-8666-5981152c935d None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-a70205cb-95d7-49bc-8666-5981152c935d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:30.067652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:30.068779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:30.069760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:30.069760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:30.069760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:30.069760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:30.069760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:30.069760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:30.069760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:30.069760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:30.069760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 430/859] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:30.070248 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70205cb-95d7-49bc-8666-5981152c935d None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:30.133475 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 430/860] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:03:30.134651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823603fa-4cfe-49b1-8fe7-f475e95b2501 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:30.158138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:30.203941 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70205cb-95d7-49bc-8666-5981152c935d None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:30.238258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46b067-bc1c-4399-8447-6c0f1fc2b055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:30.238945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46b067-bc1c-4399-8447-6c0f1fc2b055 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:30.239270 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46b067-bc1c-4399-8447-6c0f1fc2b055 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:30.239537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46b067-bc1c-4399-8447-6c0f1fc2b055 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:30.240274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46b067-bc1c-4399-8447-6c0f1fc2b055 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:30.241680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46b067-bc1c-4399-8447-6c0f1fc2b055 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:30.241785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823603fa-4cfe-49b1-8fe7-f475e95b2501 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-ca46b067-bc1c-4399-8447-6c0f1fc2b055 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:30.251065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:30.252030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:30.252908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 431/861] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Aug 31 00:03:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:30.254544 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46b067-bc1c-4399-8447-6c0f1fc2b055 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:30.283645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50055d57-c45d-4261-b873-02194ba91d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:30.284248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50055d57-c45d-4261-b873-02194ba91d13 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:30.284516 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50055d57-c45d-4261-b873-02194ba91d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:30.284780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50055d57-c45d-4261-b873-02194ba91d13 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:30.285490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50055d57-c45d-4261-b873-02194ba91d13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:30.285784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50055d57-c45d-4261-b873-02194ba91d13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:30.287275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50055d57-c45d-4261-b873-02194ba91d13 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:30.289711 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:30.299609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 431/862] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:30.300508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50055d57-c45d-4261-b873-02194ba91d13 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:30.367521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46b067-bc1c-4399-8447-6c0f1fc2b055 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:30.391744 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:30.403103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543827f1-f3e3-4196-80c9-504b93dca296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:30.403741 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543827f1-f3e3-4196-80c9-504b93dca296 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:30.404012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543827f1-f3e3-4196-80c9-504b93dca296 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:30.404605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543827f1-f3e3-4196-80c9-504b93dca296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:30.413386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50055d57-c45d-4261-b873-02194ba91d13 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:30.414883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543827f1-f3e3-4196-80c9-504b93dca296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:30.416397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543827f1-f3e3-4196-80c9-504b93dca296 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-543827f1-f3e3-4196-80c9-504b93dca296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:30.431867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:30.432841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:30.433765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:30.433765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:30.433765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:30.433765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 432/863] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:30.433996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543827f1-f3e3-4196-80c9-504b93dca296 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:30.455957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e4667-3a10-4572-9a79-00215aa0af04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:30.456841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e4667-3a10-4572-9a79-00215aa0af04 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:30.457114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e4667-3a10-4572-9a79-00215aa0af04 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:30.457423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e4667-3a10-4572-9a79-00215aa0af04 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:30.458100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e4667-3a10-4572-9a79-00215aa0af04 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:30.458398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e4667-3a10-4572-9a79-00215aa0af04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:30.459976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e4667-3a10-4572-9a79-00215aa0af04 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:30.468844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 432/864] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 31 00:03:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:30.468844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e4667-3a10-4572-9a79-00215aa0af04 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:30.539559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:30.555072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543827f1-f3e3-4196-80c9-504b93dca296 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:30.570847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e4667-3a10-4572-9a79-00215aa0af04 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:30.590120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0b1ee-e9bb-4210-999b-21ff8790664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:30.590731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0b1ee-e9bb-4210-999b-21ff8790664f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:30.591006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0b1ee-e9bb-4210-999b-21ff8790664f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:30.591700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0b1ee-e9bb-4210-999b-21ff8790664f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:30.592576 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0b1ee-e9bb-4210-999b-21ff8790664f None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=85c5a65170b046d08b0d1f01c6550730) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:30.593019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0b1ee-e9bb-4210-999b-21ff8790664f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:30.594956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0b1ee-e9bb-4210-999b-21ff8790664f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:30.603348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 433/865] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:30 2022] GET /identity/v3/role_assignments?user.id=85c5a65170b046d08b0d1f01c6550730&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:30.606149 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0b1ee-e9bb-4210-999b-21ff8790664f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:30.615800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647538b-8574-4aae-bdac-a55ab967c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:30.616890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647538b-8574-4aae-bdac-a55ab967c81b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:30.617404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647538b-8574-4aae-bdac-a55ab967c81b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:30.617992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647538b-8574-4aae-bdac-a55ab967c81b None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:30.619366 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647538b-8574-4aae-bdac-a55ab967c81b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:30.620669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647538b-8574-4aae-bdac-a55ab967c81b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:30.622142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647538b-8574-4aae-bdac-a55ab967c81b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:30.637256 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 433/866] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:30.644063 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647538b-8574-4aae-bdac-a55ab967c81b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:30.650067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:30.740327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0b1ee-e9bb-4210-999b-21ff8790664f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:30.781996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e9799-df4d-47a4-b819-b2b1cd7e4f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:30.782607 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e9799-df4d-47a4-b819-b2b1cd7e4f48 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:30.782937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e9799-df4d-47a4-b819-b2b1cd7e4f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:30.783208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e9799-df4d-47a4-b819-b2b1cd7e4f48 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:30.783845 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e9799-df4d-47a4-b819-b2b1cd7e4f48 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:30.784140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e9799-df4d-47a4-b819-b2b1cd7e4f48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:30.784734 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647538b-8574-4aae-bdac-a55ab967c81b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:30.785558 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e9799-df4d-47a4-b819-b2b1cd7e4f48 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:30.792528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 434/867] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 31 00:03:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:30.831028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b64797-3c14-419b-a620-659f6d3d841d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:30.831831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b64797-3c14-419b-a620-659f6d3d841d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:30.832224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b64797-3c14-419b-a620-659f6d3d841d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:30.832588 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b64797-3c14-419b-a620-659f6d3d841d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:30.840497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b64797-3c14-419b-a620-659f6d3d841d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:30.842215 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b64797-3c14-419b-a620-659f6d3d841d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-b3b64797-3c14-419b-a620-659f6d3d841d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:30.856551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:30.857733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:30.858841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:30.858841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:30.858841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:30.858841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:30.858841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:30.858841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:30.858841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:30.858841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:30.860534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 434/868] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:30.867227 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e9799-df4d-47a4-b819-b2b1cd7e4f48 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:30.885559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:30.980437 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e9799-df4d-47a4-b819-b2b1cd7e4f48 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:31.016915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4f12f-9078-4b2c-b15b-f39d0219c3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:31.018239 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4f12f-9078-4b2c-b15b-f39d0219c3fc None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:31.018655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4f12f-9078-4b2c-b15b-f39d0219c3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:31.019089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4f12f-9078-4b2c-b15b-f39d0219c3fc None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:31.019926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4f12f-9078-4b2c-b15b-f39d0219c3fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:31.020401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4f12f-9078-4b2c-b15b-f39d0219c3fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:31.021997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4f12f-9078-4b2c-b15b-f39d0219c3fc None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:31.036220 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 435/869] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:31.042445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b64797-3c14-419b-a620-659f6d3d841d None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:31.110727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:31.152676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b64797-3c14-419b-a620-659f6d3d841d None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:31.189810 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968ca31-64e6-4dd6-9092-a5308bcfcde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:31.190673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968ca31-64e6-4dd6-9092-a5308bcfcde4 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:31.191124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968ca31-64e6-4dd6-9092-a5308bcfcde4 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:31.191535 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968ca31-64e6-4dd6-9092-a5308bcfcde4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:31.192596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968ca31-64e6-4dd6-9092-a5308bcfcde4 None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=ab3f95b2205c4429acb61bf01ea1ea94) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:31.193098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968ca31-64e6-4dd6-9092-a5308bcfcde4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:31.194692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968ca31-64e6-4dd6-9092-a5308bcfcde4 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:31.201549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 435/870] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:31 2022] GET /identity/v3/role_assignments?user.id=ab3f95b2205c4429acb61bf01ea1ea94&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:31.577881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a4f35-8eef-4b4c-8909-ec48b7db809b None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:31.578604 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a4f35-8eef-4b4c-8909-ec48b7db809b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:31.579087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a4f35-8eef-4b4c-8909-ec48b7db809b None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:31.580638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 436/871] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:31.586264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db3992-3887-4bc1-90c7-2cb11971bc79 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:31.586785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db3992-3887-4bc1-90c7-2cb11971bc79 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:31.587263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db3992-3887-4bc1-90c7-2cb11971bc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:31.606271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-45db3992-3887-4bc1-90c7-2cb11971bc79 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:31.607827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-45db3992-3887-4bc1-90c7-2cb11971bc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:31.679714 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 436/872] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:31.949579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a4f35-8eef-4b4c-8909-ec48b7db809b None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:32.034092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:32.061721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a4f35-8eef-4b4c-8909-ec48b7db809b None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:32.100401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c8561-de51-4f23-8dcd-e5a55fc204ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:32.100401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c8561-de51-4f23-8dcd-e5a55fc204ff None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:32.100401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c8561-de51-4f23-8dcd-e5a55fc204ff None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:32.100401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c8561-de51-4f23-8dcd-e5a55fc204ff None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:32.100819 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c8561-de51-4f23-8dcd-e5a55fc204ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:32.101188 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c8561-de51-4f23-8dcd-e5a55fc204ff None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:32.119595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 437/873] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:03:31 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:03:32.672253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c87040-47a3-4908-8d5c-2d8c72a78980 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:32.673359 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c87040-47a3-4908-8d5c-2d8c72a78980 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:32.673842 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c87040-47a3-4908-8d5c-2d8c72a78980 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:32.675672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 437/874] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:32.681443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382a332-283a-4205-af9a-720525f75482 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:32.681993 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382a332-283a-4205-af9a-720525f75482 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:32.682461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382a332-283a-4205-af9a-720525f75482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:32.701965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-0382a332-283a-4205-af9a-720525f75482 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:32.703478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0382a332-283a-4205-af9a-720525f75482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:32.780199 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 438/875] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:32.804666 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808855-3983-41a0-ac1c-30c70bcd9c27 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:32.804969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808855-3983-41a0-ac1c-30c70bcd9c27 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:32.805239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808855-3983-41a0-ac1c-30c70bcd9c27 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:32.806886 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 438/876] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:32.812148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da7fd4-2587-422f-ba28-dc6468561dde None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:32.812433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da7fd4-2587-422f-ba28-dc6468561dde None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:32.812708 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da7fd4-2587-422f-ba28-dc6468561dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:32.831413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-73da7fd4-2587-422f-ba28-dc6468561dde None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:32.832594 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-73da7fd4-2587-422f-ba28-dc6468561dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:32.892342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:32.909581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 439/877] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:33.066183 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f808855-3983-41a0-ac1c-30c70bcd9c27 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:33.155758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:33.173453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da7fd4-2587-422f-ba28-dc6468561dde None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:33.201585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f808855-3983-41a0-ac1c-30c70bcd9c27 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:33.239828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e90dd-3ed6-4b98-ab66-2194162bd2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:33.240466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e90dd-3ed6-4b98-ab66-2194162bd2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:33.240743 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e90dd-3ed6-4b98-ab66-2194162bd2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:33.241151 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e90dd-3ed6-4b98-ab66-2194162bd2a5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:33.241655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e90dd-3ed6-4b98-ab66-2194162bd2a5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:33.243023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e90dd-3ed6-4b98-ab66-2194162bd2a5 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-fa3e90dd-3ed6-4b98-ab66-2194162bd2a5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:33.252302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:33.253572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:33.254419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 439/878] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 31 00:03:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:33.255399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e37853-e46e-4d19-a61d-e6006fe36c64 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:33.255399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e37853-e46e-4d19-a61d-e6006fe36c64 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:33.256296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e37853-e46e-4d19-a61d-e6006fe36c64 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:33.257370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 440/879] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:33.259617 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e37853-e46e-4d19-a61d-e6006fe36c64 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:33.283494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da7fd4-2587-422f-ba28-dc6468561dde None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:33.319997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d704d6-46a2-4e4a-900b-1c500180c670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:33.320522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d704d6-46a2-4e4a-900b-1c500180c670 None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:33.320921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d704d6-46a2-4e4a-900b-1c500180c670 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:33.321192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d704d6-46a2-4e4a-900b-1c500180c670 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:33.321982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d704d6-46a2-4e4a-900b-1c500180c670 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:33.323415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d704d6-46a2-4e4a-900b-1c500180c670 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:33.353237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 440/880] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:03:33 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:03:33.353237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775796d-9eb5-44f8-b646-94c132d2f18f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:33.353237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775796d-9eb5-44f8-b646-94c132d2f18f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:33.353237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775796d-9eb5-44f8-b646-94c132d2f18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:33.372921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a775796d-9eb5-44f8-b646-94c132d2f18f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:33.374738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a775796d-9eb5-44f8-b646-94c132d2f18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:33.375132 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e37853-e46e-4d19-a61d-e6006fe36c64 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:33.414863 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11789266-264c-4dea-a2bc-08f4c324cd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:33.415490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11789266-264c-4dea-a2bc-08f4c324cd98 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:33.415769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11789266-264c-4dea-a2bc-08f4c324cd98 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:33.416039 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11789266-264c-4dea-a2bc-08f4c324cd98 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:33.416937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11789266-264c-4dea-a2bc-08f4c324cd98 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:33.417544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11789266-264c-4dea-a2bc-08f4c324cd98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:33.418991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11789266-264c-4dea-a2bc-08f4c324cd98 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:33.425240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 441/881] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 31 00:03:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:33.425607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:33.431063 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11789266-264c-4dea-a2bc-08f4c324cd98 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:33.432555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:33.461964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 441/882] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:33.548310 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11789266-264c-4dea-a2bc-08f4c324cd98 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:33.584235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2dd01-de7b-4429-8a5e-1fa44ddfbfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:33.585078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2dd01-de7b-4429-8a5e-1fa44ddfbfc4 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:33.585448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2dd01-de7b-4429-8a5e-1fa44ddfbfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:33.585711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2dd01-de7b-4429-8a5e-1fa44ddfbfc4 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:33.586337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2dd01-de7b-4429-8a5e-1fa44ddfbfc4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:33.586632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2dd01-de7b-4429-8a5e-1fa44ddfbfc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:33.588037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2dd01-de7b-4429-8a5e-1fa44ddfbfc4 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:33.593611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 442/883] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 31 00:03:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:33.731086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775796d-9eb5-44f8-b646-94c132d2f18f None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:33.839095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775796d-9eb5-44f8-b646-94c132d2f18f None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:33.874783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe609e9c-d829-4cd7-b9b1-aab97900b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:33.875411 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe609e9c-d829-4cd7-b9b1-aab97900b6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:33.875683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe609e9c-d829-4cd7-b9b1-aab97900b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:33.875951 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe609e9c-d829-4cd7-b9b1-aab97900b6b3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:33.887207 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe609e9c-d829-4cd7-b9b1-aab97900b6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-fe609e9c-d829-4cd7-b9b1-aab97900b6b3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:33.892005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:33.892935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:33.893833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:33.893833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:33.893833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:33.893833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:33.893833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:33.893833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:33.893833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:33.893833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:33.893833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:33.893833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:33.893833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:03:33.893833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:33.893833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 442/884] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 31 00:03:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:33.899929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2dd01-de7b-4429-8a5e-1fa44ddfbfc4 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:33.948498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:34.009792 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2dd01-de7b-4429-8a5e-1fa44ddfbfc4 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:34.047418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c87d5-6ab2-4c27-9dfb-a3254a78923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:34.048029 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c87d5-6ab2-4c27-9dfb-a3254a78923e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:34.048304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c87d5-6ab2-4c27-9dfb-a3254a78923e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:34.048567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c87d5-6ab2-4c27-9dfb-a3254a78923e None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:34.049236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c87d5-6ab2-4c27-9dfb-a3254a78923e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:34.049543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c87d5-6ab2-4c27-9dfb-a3254a78923e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:34.050889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c87d5-6ab2-4c27-9dfb-a3254a78923e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:34.060186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 443/885] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 31 00:03:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:34.065503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe609e9c-d829-4cd7-b9b1-aab97900b6b3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:34.098839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7889c70-0509-4046-875c-046704ab74db None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:34.099098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7889c70-0509-4046-875c-046704ab74db None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:34.099387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7889c70-0509-4046-875c-046704ab74db None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:34.100993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 444/886] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:34.106042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275a94-88ba-45cf-bb61-8e53f6119653 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:34.106316 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275a94-88ba-45cf-bb61-8e53f6119653 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:34.106583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275a94-88ba-45cf-bb61-8e53f6119653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:34.121390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:34.126615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-66275a94-88ba-45cf-bb61-8e53f6119653 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:34.127993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-66275a94-88ba-45cf-bb61-8e53f6119653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:34.180882 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe609e9c-d829-4cd7-b9b1-aab97900b6b3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:34.205539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 445/887] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:34.215208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1d7f2-71c7-406b-aeed-9fa8df070ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:34.215889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d7f2-71c7-406b-aeed-9fa8df070ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:34.216159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d7f2-71c7-406b-aeed-9fa8df070ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:34.216423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d7f2-71c7-406b-aeed-9fa8df070ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:34.227297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1d7f2-71c7-406b-aeed-9fa8df070ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:34.228749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1d7f2-71c7-406b-aeed-9fa8df070ee2 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-3cf1d7f2-71c7-406b-aeed-9fa8df070ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:34.244390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:34.246634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:34.248957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:34.248957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:34.248957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:34.248957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 443/888] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:34.251884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66275a94-88ba-45cf-bb61-8e53f6119653 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:34.293200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:34.358173 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66275a94-88ba-45cf-bb61-8e53f6119653 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:34.393928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f19da-cc8a-4188-8d6a-5320b974b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:34.394539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f19da-cc8a-4188-8d6a-5320b974b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:34.394815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f19da-cc8a-4188-8d6a-5320b974b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:34.395082 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f19da-cc8a-4188-8d6a-5320b974b6c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:34.395861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f19da-cc8a-4188-8d6a-5320b974b6c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:34.396273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f19da-cc8a-4188-8d6a-5320b974b6c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:34.397739 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f19da-cc8a-4188-8d6a-5320b974b6c0 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:34.410285 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 446/889] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:34.415764 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1d7f2-71c7-406b-aeed-9fa8df070ee2 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:34.501009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f19da-cc8a-4188-8d6a-5320b974b6c0 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:34.519469 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:34.529491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1d7f2-71c7-406b-aeed-9fa8df070ee2 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:34.566877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6ab12-180c-4f33-ab16-53e9da355054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:34.567559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6ab12-180c-4f33-ab16-53e9da355054 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:34.567820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6ab12-180c-4f33-ab16-53e9da355054 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:34.568090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6ab12-180c-4f33-ab16-53e9da355054 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:34.576104 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6ab12-180c-4f33-ab16-53e9da355054 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:34.577704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6ab12-180c-4f33-ab16-53e9da355054 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-4ba6ab12-180c-4f33-ab16-53e9da355054 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:34.589226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:34.591382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:34.593653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:34.593653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:34.593653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:34.593653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:34.593653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:34.593653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:34.593653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:34.593653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:34.593653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:03:34.593653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:34.593653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 444/890] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 31 00:03:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:34.601408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6ab12-180c-4f33-ab16-53e9da355054 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:34.626287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f19da-cc8a-4188-8d6a-5320b974b6c0 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:34.629539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:34.671157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c59af-448d-49c6-b98f-7d3193af824e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:34.671794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c59af-448d-49c6-b98f-7d3193af824e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:34.672064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c59af-448d-49c6-b98f-7d3193af824e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:34.672332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c59af-448d-49c6-b98f-7d3193af824e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:34.672908 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c59af-448d-49c6-b98f-7d3193af824e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:34.674335 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c59af-448d-49c6-b98f-7d3193af824e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-f49c59af-448d-49c6-b98f-7d3193af824e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:34.683604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:34.685907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:34.687880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 447/891] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:03:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:34.694034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c59af-448d-49c6-b98f-7d3193af824e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:34.715484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6ab12-180c-4f33-ab16-53e9da355054 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:34.756507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493266c5-fc98-4e63-8245-464eacad33de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:34.757126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493266c5-fc98-4e63-8245-464eacad33de None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:34.757430 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493266c5-fc98-4e63-8245-464eacad33de None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:34.757701 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493266c5-fc98-4e63-8245-464eacad33de None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:34.758443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493266c5-fc98-4e63-8245-464eacad33de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:34.758746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493266c5-fc98-4e63-8245-464eacad33de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:34.760555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493266c5-fc98-4e63-8245-464eacad33de None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:34.790527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 445/892] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 31 00:03:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:34.791806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493266c5-fc98-4e63-8245-464eacad33de None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:34.805229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:34.844130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c59af-448d-49c6-b98f-7d3193af824e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:34.888701 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a3676-9950-4f3e-aa3b-f4181923992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:34.889277 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a3676-9950-4f3e-aa3b-f4181923992e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:34.889558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a3676-9950-4f3e-aa3b-f4181923992e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:34.889854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a3676-9950-4f3e-aa3b-f4181923992e None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:34.890463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a3676-9950-4f3e-aa3b-f4181923992e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:34.890767 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a3676-9950-4f3e-aa3b-f4181923992e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:34.892128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a3676-9950-4f3e-aa3b-f4181923992e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:34.901237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 448/893] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:03:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:34.903862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a3676-9950-4f3e-aa3b-f4181923992e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:34.911934 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493266c5-fc98-4e63-8245-464eacad33de None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:34.939496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:34.956274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5624c-bd70-4f1c-bf87-83f4cf205dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:34.956891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5624c-bd70-4f1c-bf87-83f4cf205dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:34.957166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5624c-bd70-4f1c-bf87-83f4cf205dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:34.957455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5624c-bd70-4f1c-bf87-83f4cf205dc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:35.036174 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a3676-9950-4f3e-aa3b-f4181923992e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:35.043907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5624c-bd70-4f1c-bf87-83f4cf205dc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:35.045408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5624c-bd70-4f1c-bf87-83f4cf205dc7 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:35.060436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:35.098547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e61141-c500-4d15-93d8-3c9ee39019d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:35.099299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e61141-c500-4d15-93d8-3c9ee39019d2 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:35.099670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e61141-c500-4d15-93d8-3c9ee39019d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:35.100033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e61141-c500-4d15-93d8-3c9ee39019d2 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:35.100761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e61141-c500-4d15-93d8-3c9ee39019d2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:35.101154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e61141-c500-4d15-93d8-3c9ee39019d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:35.103981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e61141-c500-4d15-93d8-3c9ee39019d2 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:35.113519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 449/894] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:03:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:35.115958 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e61141-c500-4d15-93d8-3c9ee39019d2 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:35.184325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 446/895] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:34 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:03:35.185482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5624c-bd70-4f1c-bf87-83f4cf205dc7 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:35.251175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:35.264800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e61141-c500-4d15-93d8-3c9ee39019d2 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:35.301635 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5624c-bd70-4f1c-bf87-83f4cf205dc7 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:35.313915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:35.315454 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16435e73-f4ca-4173-b958-e4fe077c9c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:35.316367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16435e73-f4ca-4173-b958-e4fe077c9c27 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:35.317145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16435e73-f4ca-4173-b958-e4fe077c9c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:35.318214 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16435e73-f4ca-4173-b958-e4fe077c9c27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:35.319288 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16435e73-f4ca-4173-b958-e4fe077c9c27 None admin] RBAC: Adding query filter params (interface=public, service_id=88e14be9a3f04093868d911bdd4e0e79, region_id=RegionOne) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:35.320045 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16435e73-f4ca-4173-b958-e4fe077c9c27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:35.321787 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16435e73-f4ca-4173-b958-e4fe077c9c27 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:35.333703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 450/896] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 31 00:03:35 2022] GET /identity/v3/endpoints?service_id=88e14be9a3f04093868d911bdd4e0e79&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:35.334442 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16435e73-f4ca-4173-b958-e4fe077c9c27 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:35.347278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5682f-ac63-4805-809f-607c9301c160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:35.347772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5682f-ac63-4805-809f-607c9301c160 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:35.348049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5682f-ac63-4805-809f-607c9301c160 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:35.348397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5682f-ac63-4805-809f-607c9301c160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:35.359594 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5682f-ac63-4805-809f-607c9301c160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:35.361050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5682f-ac63-4805-809f-607c9301c160 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-dae5682f-ac63-4805-809f-607c9301c160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:35.375833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:35.376805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:35.377747 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:35.377747 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:35.377747 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:35.381413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 447/897] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:35.382983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e53bf-2028-4ee2-97ed-20399386e303 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:35.383263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e53bf-2028-4ee2-97ed-20399386e303 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:35.383530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e53bf-2028-4ee2-97ed-20399386e303 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:35.384935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 448/898] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:35.385618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e53bf-2028-4ee2-97ed-20399386e303 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:35.450512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16435e73-f4ca-4173-b958-e4fe077c9c27 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:35.484183 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56397-a481-4984-8cf8-c52f8e529086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:35.484793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56397-a481-4984-8cf8-c52f8e529086 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:35.485068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56397-a481-4984-8cf8-c52f8e529086 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:35.485373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56397-a481-4984-8cf8-c52f8e529086 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:35.485967 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56397-a481-4984-8cf8-c52f8e529086 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:35.487326 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56397-a481-4984-8cf8-c52f8e529086 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:35.493101 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 451/899] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 31 00:03:35 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:03:35.494370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a237-4daa-4a2e-9823-b9d4549333d0 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:35.494654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a237-4daa-4a2e-9823-b9d4549333d0 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:35.494920 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a237-4daa-4a2e-9823-b9d4549333d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:35.512329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e53bf-2028-4ee2-97ed-20399386e303 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:35.514438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-80a1a237-4daa-4a2e-9823-b9d4549333d0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:35.515759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-80a1a237-4daa-4a2e-9823-b9d4549333d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:35.532418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:35.558094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99fc64-bc33-43b8-932d-55d153a99afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:35.559114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99fc64-bc33-43b8-932d-55d153a99afb None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:35.559579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99fc64-bc33-43b8-932d-55d153a99afb None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:35.559904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99fc64-bc33-43b8-932d-55d153a99afb None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:35.560573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99fc64-bc33-43b8-932d-55d153a99afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:35.560883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99fc64-bc33-43b8-932d-55d153a99afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:35.562331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99fc64-bc33-43b8-932d-55d153a99afb None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:35.580011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 449/900] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:35.580011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a846f72-339e-4a03-b8fe-c99708d07c9d None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:35.580011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a846f72-339e-4a03-b8fe-c99708d07c9d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:35.580011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a846f72-339e-4a03-b8fe-c99708d07c9d None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:35.580011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 450/901] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:35.582051 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a846f72-339e-4a03-b8fe-c99708d07c9d None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:35.608492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 452/902] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:35.609851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:35.612025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae139e-113d-4cac-a33d-9e6484cb8202 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:35.613748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae139e-113d-4cac-a33d-9e6484cb8202 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:35.613748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae139e-113d-4cac-a33d-9e6484cb8202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:35.635104 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d0ae139e-113d-4cac-a33d-9e6484cb8202 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:35.636706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d0ae139e-113d-4cac-a33d-9e6484cb8202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:35.714004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a846f72-339e-4a03-b8fe-c99708d07c9d None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:35.722494 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 453/903] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:35.752150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38270e-c13b-4add-a28c-c732a18c4e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:35.753149 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38270e-c13b-4add-a28c-c732a18c4e47 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:35.753662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38270e-c13b-4add-a28c-c732a18c4e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:35.754117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38270e-c13b-4add-a28c-c732a18c4e47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:35.761730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38270e-c13b-4add-a28c-c732a18c4e47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:35.763455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38270e-c13b-4add-a28c-c732a18c4e47 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-6b38270e-c13b-4add-a28c-c732a18c4e47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:35.775460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:35.776398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:35.777335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:35.777335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:35.777335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:35.777335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:35.777335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:35.777335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:35.777335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:35.777335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:35.780022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 451/904] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:35.785887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae139e-113d-4cac-a33d-9e6484cb8202 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:35.872595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:35.896617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38270e-c13b-4add-a28c-c732a18c4e47 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:35.900089 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae139e-113d-4cac-a33d-9e6484cb8202 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:35.944447 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37474f0-464c-4d04-b1a6-38a9a751a7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:35.946224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37474f0-464c-4d04-b1a6-38a9a751a7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:35.946915 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37474f0-464c-4d04-b1a6-38a9a751a7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:35.947318 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37474f0-464c-4d04-b1a6-38a9a751a7d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:35.948409 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37474f0-464c-4d04-b1a6-38a9a751a7d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:35.948852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37474f0-464c-4d04-b1a6-38a9a751a7d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:35.950652 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37474f0-464c-4d04-b1a6-38a9a751a7d9 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:35.967893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 454/905] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:35.977229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37474f0-464c-4d04-b1a6-38a9a751a7d9 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:35.993659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:36.015729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38270e-c13b-4add-a28c-c732a18c4e47 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:36.052869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a16a30-10b9-4b92-b544-29e5598af601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:36.053531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a16a30-10b9-4b92-b544-29e5598af601 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:36.053804 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a16a30-10b9-4b92-b544-29e5598af601 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:36.054069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a16a30-10b9-4b92-b544-29e5598af601 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:36.054652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a16a30-10b9-4b92-b544-29e5598af601 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:36.056020 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a16a30-10b9-4b92-b544-29e5598af601 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-06a16a30-10b9-4b92-b544-29e5598af601 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:36.066022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:36.066923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 452/906] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Aug 31 00:03:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:36.067801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a16a30-10b9-4b92-b544-29e5598af601 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:36.102747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37474f0-464c-4d04-b1a6-38a9a751a7d9 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:36.146827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c676c7-3311-4d18-b0f7-43d3309c7c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:36.147474 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c676c7-3311-4d18-b0f7-43d3309c7c8c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:36.147745 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c676c7-3311-4d18-b0f7-43d3309c7c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:36.148010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c676c7-3311-4d18-b0f7-43d3309c7c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:36.148720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c676c7-3311-4d18-b0f7-43d3309c7c8c None admin] RBAC: Adding query filter params (role.id=f11bf727fddc4d8ea38916144f32515d, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=ab3f95b2205c4429acb61bf01ea1ea94) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:36.149022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c676c7-3311-4d18-b0f7-43d3309c7c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:36.150509 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c676c7-3311-4d18-b0f7-43d3309c7c8c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:36.156308 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 455/907] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:35 2022] GET /identity/v3/role_assignments?user.id=ab3f95b2205c4429acb61bf01ea1ea94&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=f11bf727fddc4d8ea38916144f32515d => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:36.157095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c676c7-3311-4d18-b0f7-43d3309c7c8c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:36.159764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:36.210303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a16a30-10b9-4b92-b544-29e5598af601 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:36.250733 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c83a4-f106-4c8c-9861-218aad053436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:36.251434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c83a4-f106-4c8c-9861-218aad053436 None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:36.251799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c83a4-f106-4c8c-9861-218aad053436 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:36.252257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c83a4-f106-4c8c-9861-218aad053436 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:36.252927 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c83a4-f106-4c8c-9861-218aad053436 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:36.254470 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c83a4-f106-4c8c-9861-218aad053436 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:36.280845 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 453/908] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:03:36 2022] POST /identity/v3/services => generated 241 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:03:36.294426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c676c7-3311-4d18-b0f7-43d3309c7c8c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:36.346819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7e84d-e5c2-4278-ac12-761cd38198fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:36.347850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e84d-e5c2-4278-ac12-761cd38198fa None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:36.348129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e84d-e5c2-4278-ac12-761cd38198fa None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:36.348451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e84d-e5c2-4278-ac12-761cd38198fa None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:36.349528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7e84d-e5c2-4278-ac12-761cd38198fa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:36.349528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7e84d-e5c2-4278-ac12-761cd38198fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:36.350951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7e84d-e5c2-4278-ac12-761cd38198fa None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:36.357853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 456/909] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 31 00:03:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:36.363472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c83a4-f106-4c8c-9861-218aad053436 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:36.376828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:36.482403 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c83a4-f106-4c8c-9861-218aad053436 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:36.518909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350e5d7-23b1-4dcd-a5af-511f3e262eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:36.519525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350e5d7-23b1-4dcd-a5af-511f3e262eaf None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:36.519864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350e5d7-23b1-4dcd-a5af-511f3e262eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:36.520216 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350e5d7-23b1-4dcd-a5af-511f3e262eaf None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:36.520979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350e5d7-23b1-4dcd-a5af-511f3e262eaf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:36.521394 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350e5d7-23b1-4dcd-a5af-511f3e262eaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:36.522731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350e5d7-23b1-4dcd-a5af-511f3e262eaf None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:36.528329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 454/910] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 31 00:03:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:36.534691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7e84d-e5c2-4278-ac12-761cd38198fa None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:36.598416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:36.638693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7e84d-e5c2-4278-ac12-761cd38198fa None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:36.675816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4f0b8-5015-419c-ad1d-3175487270ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:36.676463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4f0b8-5015-419c-ad1d-3175487270ec None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:36.676983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4f0b8-5015-419c-ad1d-3175487270ec None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:36.677607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4f0b8-5015-419c-ad1d-3175487270ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:36.678025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4f0b8-5015-419c-ad1d-3175487270ec None admin] RBAC: Adding query filter params (interface=public, service_id=3c78920d5cc04c2ea5ec26ed7f6a0f1d, region_id=RegionOne) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:36.678339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4f0b8-5015-419c-ad1d-3175487270ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:36.679703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4f0b8-5015-419c-ad1d-3175487270ec None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:36.685777 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 457/911] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 31 00:03:36 2022] GET /identity/v3/endpoints?service_id=3c78920d5cc04c2ea5ec26ed7f6a0f1d&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:36.691101 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350e5d7-23b1-4dcd-a5af-511f3e262eaf None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:36.766709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:36.800555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350e5d7-23b1-4dcd-a5af-511f3e262eaf None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:36.835522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b3642-2139-4f06-b92c-404308998ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:36.836131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b3642-2139-4f06-b92c-404308998ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:36.836412 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b3642-2139-4f06-b92c-404308998ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:36.836677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b3642-2139-4f06-b92c-404308998ac2 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:36.837313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b3642-2139-4f06-b92c-404308998ac2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:36.838759 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b3642-2139-4f06-b92c-404308998ac2 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:36.845379 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 455/912] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 31 00:03:36 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:03:37.562486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256c21e-5f06-4110-b8b0-9b97324b7b14 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:37.563020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256c21e-5f06-4110-b8b0-9b97324b7b14 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:37.563275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256c21e-5f06-4110-b8b0-9b97324b7b14 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:37.565649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 458/913] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:37.572706 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac48c5-5ad2-4e2d-bca7-9ed0b9746b73 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:37.573150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac48c5-5ad2-4e2d-bca7-9ed0b9746b73 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:37.573531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac48c5-5ad2-4e2d-bca7-9ed0b9746b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:37.593828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-1eac48c5-5ad2-4e2d-bca7-9ed0b9746b73 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:37.595008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1eac48c5-5ad2-4e2d-bca7-9ed0b9746b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:37.662201 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 456/914] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:37.972003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256c21e-5f06-4110-b8b0-9b97324b7b14 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:38.079987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256c21e-5f06-4110-b8b0-9b97324b7b14 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:38.118392 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:38.128588 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aebf3-e333-4397-b770-aa5379edba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:38.129242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aebf3-e333-4397-b770-aa5379edba45 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:38.129619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aebf3-e333-4397-b770-aa5379edba45 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:38.130012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aebf3-e333-4397-b770-aa5379edba45 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:38.130599 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aebf3-e333-4397-b770-aa5379edba45 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:38.132006 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aebf3-e333-4397-b770-aa5379edba45 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-2b9aebf3-e333-4397-b770-aa5379edba45 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:38.141439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:38.142451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:38.143709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 459/915] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:03:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:38.148967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac48c5-5ad2-4e2d-bca7-9ed0b9746b73 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:38.202864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b88949-a431-425c-bb40-9f3af26934ef None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:38.203211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b88949-a431-425c-bb40-9f3af26934ef None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:38.203397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b88949-a431-425c-bb40-9f3af26934ef None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:38.204977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 460/916] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:38.212357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdefcad-f3b4-4b4c-9edc-f9568226bb79 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:38.212633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdefcad-f3b4-4b4c-9edc-f9568226bb79 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:38.212899 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdefcad-f3b4-4b4c-9edc-f9568226bb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:38.242371 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-5cdefcad-f3b4-4b4c-9edc-f9568226bb79 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:38.244367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-5cdefcad-f3b4-4b4c-9edc-f9568226bb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:38.253596 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:38.262339 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac48c5-5ad2-4e2d-bca7-9ed0b9746b73 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:38.302125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a205d-002f-4a91-bf26-2e775335124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:38.303325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a205d-002f-4a91-bf26-2e775335124c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:38.303800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a205d-002f-4a91-bf26-2e775335124c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:38.304266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a205d-002f-4a91-bf26-2e775335124c None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:38.305276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a205d-002f-4a91-bf26-2e775335124c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:38.305786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a205d-002f-4a91-bf26-2e775335124c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:38.307400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a205d-002f-4a91-bf26-2e775335124c None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:38.312945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 457/917] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:03:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:38.314415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b7474-b845-4896-a6ce-b40b94e225be None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:38.314754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b7474-b845-4896-a6ce-b40b94e225be None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:38.315091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b7474-b845-4896-a6ce-b40b94e225be None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:38.316828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 458/918] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:38.318295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b7474-b845-4896-a6ce-b40b94e225be None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:38.346791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 461/919] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:38.348114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff336d05-6faa-4a09-951b-1f1fae4bddb1 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:38.348457 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff336d05-6faa-4a09-951b-1f1fae4bddb1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:38.348732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff336d05-6faa-4a09-951b-1f1fae4bddb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:38.376627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-ff336d05-6faa-4a09-951b-1f1fae4bddb1 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:38.378333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ff336d05-6faa-4a09-951b-1f1fae4bddb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:38.436943 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b7474-b845-4896-a6ce-b40b94e225be None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:38.467469 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:38.469819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 462/920] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:38.480699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32a4e5-ea63-403c-ba03-957b729b31b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:38.481693 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32a4e5-ea63-403c-ba03-957b729b31b4 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:38.482207 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32a4e5-ea63-403c-ba03-957b729b31b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:38.482655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32a4e5-ea63-403c-ba03-957b729b31b4 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:38.483525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32a4e5-ea63-403c-ba03-957b729b31b4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:38.484013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32a4e5-ea63-403c-ba03-957b729b31b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:38.485917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32a4e5-ea63-403c-ba03-957b729b31b4 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:38.492265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 459/921] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 31 00:03:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:38.501317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff336d05-6faa-4a09-951b-1f1fae4bddb1 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:38.555704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:38.612014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff336d05-6faa-4a09-951b-1f1fae4bddb1 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:38.652296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c36e87-0dbb-46fe-ac6f-8accd608e981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:38.652907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c36e87-0dbb-46fe-ac6f-8accd608e981 None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:38.653178 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c36e87-0dbb-46fe-ac6f-8accd608e981 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:38.653469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c36e87-0dbb-46fe-ac6f-8accd608e981 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:38.654448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c36e87-0dbb-46fe-ac6f-8accd608e981 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:38.655790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c36e87-0dbb-46fe-ac6f-8accd608e981 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:38.662360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32a4e5-ea63-403c-ba03-957b729b31b4 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:38.679977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 463/922] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:03:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:03:38.785378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32a4e5-ea63-403c-ba03-957b729b31b4 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:38.790332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c36e87-0dbb-46fe-ac6f-8accd608e981 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:38.833159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9332e-6e51-4c4a-aac0-321ea4f35c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:38.833812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9332e-6e51-4c4a-aac0-321ea4f35c98 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:38.834083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9332e-6e51-4c4a-aac0-321ea4f35c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:38.834349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9332e-6e51-4c4a-aac0-321ea4f35c98 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:38.846253 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9332e-6e51-4c4a-aac0-321ea4f35c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-88d9332e-6e51-4c4a-aac0-321ea4f35c98 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:38.851049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:38.852031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:38.852947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:38.852947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:38.852947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:38.852947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:38.852947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:38.852947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:38.852947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:38.852947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:38.852947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:38.852947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:38.852947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:03:38.852947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:38.852947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 460/923] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 31 00:03:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:38.853799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eeddac-30fb-497c-80d7-e48aff3fab2a None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:38.854120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eeddac-30fb-497c-80d7-e48aff3fab2a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:38.854928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eeddac-30fb-497c-80d7-e48aff3fab2a None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:38.856301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 461/924] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:38.858192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eeddac-30fb-497c-80d7-e48aff3fab2a None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:38.910804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c36e87-0dbb-46fe-ac6f-8accd608e981 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:38.914288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:38.919236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:38.950216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46c5a0-8386-44a4-aab5-6a9abd005fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:38.950872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46c5a0-8386-44a4-aab5-6a9abd005fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:38.951232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46c5a0-8386-44a4-aab5-6a9abd005fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:38.951403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46c5a0-8386-44a4-aab5-6a9abd005fa5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:38.951983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46c5a0-8386-44a4-aab5-6a9abd005fa5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:38.953368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46c5a0-8386-44a4-aab5-6a9abd005fa5 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-9e46c5a0-8386-44a4-aab5-6a9abd005fa5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:38.962428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:38.963433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:38.964246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 464/925] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 31 00:03:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:38.965433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fb796-e7e9-487b-acf9-7f0706d02f51 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:38.965501 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fb796-e7e9-487b-acf9-7f0706d02f51 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:38.965724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fb796-e7e9-487b-acf9-7f0706d02f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:38.975970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eeddac-30fb-497c-80d7-e48aff3fab2a None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:38.983716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-0f5fb796-e7e9-487b-acf9-7f0706d02f51 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:38.984901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0f5fb796-e7e9-487b-acf9-7f0706d02f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:39.015255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d900d8e-7f59-448c-acf8-3802e78b6ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:39.015918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d900d8e-7f59-448c-acf8-3802e78b6ecf None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:39.016189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d900d8e-7f59-448c-acf8-3802e78b6ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:39.016455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d900d8e-7f59-448c-acf8-3802e78b6ecf None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:39.017123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d900d8e-7f59-448c-acf8-3802e78b6ecf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:39.017457 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d900d8e-7f59-448c-acf8-3802e78b6ecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:39.018893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d900d8e-7f59-448c-acf8-3802e78b6ecf None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:39.027416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 462/926] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 31 00:03:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:39.028287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d900d8e-7f59-448c-acf8-3802e78b6ecf None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:39.061657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 465/927] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:39.062888 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fb796-e7e9-487b-acf9-7f0706d02f51 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:39.167822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:39.170540 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d900d8e-7f59-448c-acf8-3802e78b6ecf None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:39.173699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fb796-e7e9-487b-acf9-7f0706d02f51 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:39.185555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:39.211750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7f4e5-1ced-4cef-8f6e-a3797e6ec1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:39.212382 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7f4e5-1ced-4cef-8f6e-a3797e6ec1ce None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:39.212654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7f4e5-1ced-4cef-8f6e-a3797e6ec1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:39.212919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7f4e5-1ced-4cef-8f6e-a3797e6ec1ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:39.217567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1636a14-9f16-4cde-a43f-1e046d234ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:39.218413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1636a14-9f16-4cde-a43f-1e046d234ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:39.218887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1636a14-9f16-4cde-a43f-1e046d234ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:39.219356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1636a14-9f16-4cde-a43f-1e046d234ec7 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:39.220638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1636a14-9f16-4cde-a43f-1e046d234ec7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:39.221145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1636a14-9f16-4cde-a43f-1e046d234ec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:39.223541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1636a14-9f16-4cde-a43f-1e046d234ec7 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:39.224217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7f4e5-1ced-4cef-8f6e-a3797e6ec1ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:39.226091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7f4e5-1ced-4cef-8f6e-a3797e6ec1ce None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:39.235030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 463/928] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 31 00:03:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:39.235625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1636a14-9f16-4cde-a43f-1e046d234ec7 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-51c7f4e5-1ced-4cef-8f6e-a3797e6ec1ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:39.244305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:39.245302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:39.246208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:39.246208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:39.246208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:39.249356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 466/929] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:39.251429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7f4e5-1ced-4cef-8f6e-a3797e6ec1ce None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:39.361379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7f4e5-1ced-4cef-8f6e-a3797e6ec1ce None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:39.368445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1636a14-9f16-4cde-a43f-1e046d234ec7 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:39.402355 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d28e64-4ad1-4468-9dca-dd299e539580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:39.402959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d28e64-4ad1-4468-9dca-dd299e539580 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:39.403229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca467d63-6090-408c-9a70-0b7532481821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:39.403350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d28e64-4ad1-4468-9dca-dd299e539580 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:39.403533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d28e64-4ad1-4468-9dca-dd299e539580 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:39.403829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467d63-6090-408c-9a70-0b7532481821 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:39.404418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467d63-6090-408c-9a70-0b7532481821 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:39.404515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d28e64-4ad1-4468-9dca-dd299e539580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:39.404697 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467d63-6090-408c-9a70-0b7532481821 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:39.404794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d28e64-4ad1-4468-9dca-dd299e539580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:39.405348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca467d63-6090-408c-9a70-0b7532481821 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:39.405649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca467d63-6090-408c-9a70-0b7532481821 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:39.406076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d28e64-4ad1-4468-9dca-dd299e539580 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:39.406988 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca467d63-6090-408c-9a70-0b7532481821 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:39.417861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 464/930] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 31 00:03:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:39.417861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca467d63-6090-408c-9a70-0b7532481821 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:39.424034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 467/931] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:39.431224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d28e64-4ad1-4468-9dca-dd299e539580 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:39.446301 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:39.460882 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:39.525137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca467d63-6090-408c-9a70-0b7532481821 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:39.536438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d28e64-4ad1-4468-9dca-dd299e539580 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:39.560076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f4231-b907-4526-89cd-67d8e8556956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:39.560727 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f4231-b907-4526-89cd-67d8e8556956 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:39.561001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f4231-b907-4526-89cd-67d8e8556956 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:39.561287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f4231-b907-4526-89cd-67d8e8556956 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:39.561875 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f4231-b907-4526-89cd-67d8e8556956 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:39.563226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f4231-b907-4526-89cd-67d8e8556956 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-ea8f4231-b907-4526-89cd-67d8e8556956 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:39.571865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:39.572863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:39.573848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 465/932] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Aug 31 00:03:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:39.574638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f4231-b907-4526-89cd-67d8e8556956 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:39.575925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fac6a6-7933-42c3-86fd-7d0d06d2e5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:39.576525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fac6a6-7933-42c3-86fd-7d0d06d2e5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:39.576794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fac6a6-7933-42c3-86fd-7d0d06d2e5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:39.577054 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fac6a6-7933-42c3-86fd-7d0d06d2e5b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:39.578091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fac6a6-7933-42c3-86fd-7d0d06d2e5b4 None admin] RBAC: Adding query filter params (interface=public, service_id=3c20994c51fc4a12822f49aa2993efc5, region_id=RegionOne) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:39.578397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fac6a6-7933-42c3-86fd-7d0d06d2e5b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:39.579731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fac6a6-7933-42c3-86fd-7d0d06d2e5b4 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:39.585320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 468/933] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 31 00:03:39 2022] GET /identity/v3/endpoints?service_id=3c20994c51fc4a12822f49aa2993efc5&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:39.589944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fac6a6-7933-42c3-86fd-7d0d06d2e5b4 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:39.670657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:39.682833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f4231-b907-4526-89cd-67d8e8556956 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:39.684487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:39.699753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fac6a6-7933-42c3-86fd-7d0d06d2e5b4 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:39.721112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3050a8-2346-444b-98ff-eb5ac4618ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:39.722058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3050a8-2346-444b-98ff-eb5ac4618ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:39.722474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3050a8-2346-444b-98ff-eb5ac4618ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:39.722898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3050a8-2346-444b-98ff-eb5ac4618ae7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:39.730549 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3050a8-2346-444b-98ff-eb5ac4618ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:39.732169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3050a8-2346-444b-98ff-eb5ac4618ae7 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:39.735923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711d84d-467f-45f9-a042-8ff3a62bdaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:39.736528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711d84d-467f-45f9-a042-8ff3a62bdaea None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:39.736796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711d84d-467f-45f9-a042-8ff3a62bdaea None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:39.737057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711d84d-467f-45f9-a042-8ff3a62bdaea None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:39.737730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711d84d-467f-45f9-a042-8ff3a62bdaea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:39.738022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711d84d-467f-45f9-a042-8ff3a62bdaea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:39.739567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711d84d-467f-45f9-a042-8ff3a62bdaea None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:39.744524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 469/934] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 31 00:03:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:39.745323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711d84d-467f-45f9-a042-8ff3a62bdaea None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-ad3050a8-2346-444b-98ff-eb5ac4618ae7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:39.745802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:39.746717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:39.747641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:39.747641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:39.747641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:39.747641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:39.747641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:39.747641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:39.747641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:39.747641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:39.747641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:03:39.747641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:39.747641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 466/935] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 31 00:03:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:39.750061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3050a8-2346-444b-98ff-eb5ac4618ae7 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:39.858594 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711d84d-467f-45f9-a042-8ff3a62bdaea None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:39.861629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3050a8-2346-444b-98ff-eb5ac4618ae7 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:39.893763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a5a47-6658-41e8-8848-b684fdc442a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:39.894373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5a47-6658-41e8-8848-b684fdc442a7 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:39.894646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5a47-6658-41e8-8848-b684fdc442a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:39.894980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5a47-6658-41e8-8848-b684fdc442a7 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:39.895531 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a5a47-6658-41e8-8848-b684fdc442a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:39.896366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111288ff-501e-4e59-8398-ad0b76cb1616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:39.896873 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a5a47-6658-41e8-8848-b684fdc442a7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:39.896983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111288ff-501e-4e59-8398-ad0b76cb1616 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:39.897230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111288ff-501e-4e59-8398-ad0b76cb1616 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:39.897522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111288ff-501e-4e59-8398-ad0b76cb1616 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:39.898126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111288ff-501e-4e59-8398-ad0b76cb1616 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:39.898417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111288ff-501e-4e59-8398-ad0b76cb1616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:39.899753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111288ff-501e-4e59-8398-ad0b76cb1616 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:39.909890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 470/936] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 31 00:03:39 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:03:39.909890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a5a47-6658-41e8-8848-b684fdc442a7 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:39.910160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 467/937] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 31 00:03:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:39.912439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111288ff-501e-4e59-8398-ad0b76cb1616 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:39.914596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:39.951103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:40.037030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111288ff-501e-4e59-8398-ad0b76cb1616 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:40.057370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a5a47-6658-41e8-8848-b684fdc442a7 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:40.076156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6f0eb-5f06-4c84-a0ea-b2145197c920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:40.076788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6f0eb-5f06-4c84-a0ea-b2145197c920 None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:40.077027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6f0eb-5f06-4c84-a0ea-b2145197c920 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:40.077339 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6f0eb-5f06-4c84-a0ea-b2145197c920 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:40.078009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6f0eb-5f06-4c84-a0ea-b2145197c920 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:40.079395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6f0eb-5f06-4c84-a0ea-b2145197c920 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:40.107251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 468/938] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:03:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:03:40.114236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255de82-c96f-48b9-be33-f8291639d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:40.114890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255de82-c96f-48b9-be33-f8291639d7dc None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:40.115154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255de82-c96f-48b9-be33-f8291639d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:40.115443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255de82-c96f-48b9-be33-f8291639d7dc None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:40.116406 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255de82-c96f-48b9-be33-f8291639d7dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:40.116706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255de82-c96f-48b9-be33-f8291639d7dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:40.118770 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255de82-c96f-48b9-be33-f8291639d7dc None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:40.144826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 471/939] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 31 00:03:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:40.151682 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6f0eb-5f06-4c84-a0ea-b2145197c920 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:40.247965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:40.271419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6f0eb-5f06-4c84-a0ea-b2145197c920 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:40.307141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ce8ea-b246-44e3-a394-54e1b108c30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:40.307781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ce8ea-b246-44e3-a394-54e1b108c30e None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:40.308052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ce8ea-b246-44e3-a394-54e1b108c30e None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:40.308315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ce8ea-b246-44e3-a394-54e1b108c30e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:40.320936 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ce8ea-b246-44e3-a394-54e1b108c30e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:40.322301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ce8ea-b246-44e3-a394-54e1b108c30e None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-9d9ce8ea-b246-44e3-a394-54e1b108c30e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:40.337798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:40.338982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:40.340154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:40.340154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:40.340154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:40.340154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 469/940] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:40.347128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255de82-c96f-48b9-be33-f8291639d7dc None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:40.410950 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:40.457575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255de82-c96f-48b9-be33-f8291639d7dc None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:40.496834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f598163-c7ac-41b2-8c28-adbe099e191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:40.497750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f598163-c7ac-41b2-8c28-adbe099e191d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:40.498228 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f598163-c7ac-41b2-8c28-adbe099e191d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:40.498644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f598163-c7ac-41b2-8c28-adbe099e191d None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:40.499423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f598163-c7ac-41b2-8c28-adbe099e191d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:40.499861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f598163-c7ac-41b2-8c28-adbe099e191d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:40.501392 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f598163-c7ac-41b2-8c28-adbe099e191d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:40.519000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 472/941] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:40.520693 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ce8ea-b246-44e3-a394-54e1b108c30e None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:40.629140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ce8ea-b246-44e3-a394-54e1b108c30e None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:40.642543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232d0c9-35ee-4a43-b9bc-fc1cda3f059c None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:40.642915 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232d0c9-35ee-4a43-b9bc-fc1cda3f059c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:40.643250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232d0c9-35ee-4a43-b9bc-fc1cda3f059c None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:40.645003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 473/942] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:40.651097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c73bad-88fb-4827-ad71-5cdda0a15e74 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:40.651373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c73bad-88fb-4827-ad71-5cdda0a15e74 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:40.651643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c73bad-88fb-4827-ad71-5cdda0a15e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:40.671190 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d8c73bad-88fb-4827-ad71-5cdda0a15e74 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:40.671991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ecae2-368d-405b-bbbe-a9ebdb152394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:40.672362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d8c73bad-88fb-4827-ad71-5cdda0a15e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:40.672628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ecae2-368d-405b-bbbe-a9ebdb152394 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:40.672899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ecae2-368d-405b-bbbe-a9ebdb152394 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:40.673167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ecae2-368d-405b-bbbe-a9ebdb152394 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:40.675182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:40.681074 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ecae2-368d-405b-bbbe-a9ebdb152394 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:40.683107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ecae2-368d-405b-bbbe-a9ebdb152394 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-801ecae2-368d-405b-bbbe-a9ebdb152394 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:40.696315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:40.697278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:40.698200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:40.698200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:40.698200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:40.698200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:40.698200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:40.698200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:40.698200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:40.698200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:40.702395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 470/943] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:40.703701 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ecae2-368d-405b-bbbe-a9ebdb152394 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:40.752874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 474/944] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:40.811033 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ecae2-368d-405b-bbbe-a9ebdb152394 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:40.846549 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0edef-ea4b-4b5a-9a5a-74cfc6e233e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:40.847163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0edef-ea4b-4b5a-9a5a-74cfc6e233e3 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:40.847433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0edef-ea4b-4b5a-9a5a-74cfc6e233e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:40.847703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0edef-ea4b-4b5a-9a5a-74cfc6e233e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:40.848707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0edef-ea4b-4b5a-9a5a-74cfc6e233e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:40.849106 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0edef-ea4b-4b5a-9a5a-74cfc6e233e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:40.850609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0edef-ea4b-4b5a-9a5a-74cfc6e233e3 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:40.867365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 471/945] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:40.873405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c73bad-88fb-4827-ad71-5cdda0a15e74 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:40.925880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:40.983055 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c73bad-88fb-4827-ad71-5cdda0a15e74 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:41.017883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe27bec-5324-422a-a95e-6d6824ebe622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:41.018805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe27bec-5324-422a-a95e-6d6824ebe622 None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:41.019227 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe27bec-5324-422a-a95e-6d6824ebe622 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:41.019636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe27bec-5324-422a-a95e-6d6824ebe622 None admin] PATH_INFO: `/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/ab3f95b2205c4429acb61bf01ea1ea94/roles/f11bf727fddc4d8ea38916144f32515d` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:41.022195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe27bec-5324-422a-a95e-6d6824ebe622 None admin] RBAC: Authorizing `identity:create_grant(project_id=204574e6a3c34ca4a7c266b5549bfdfa, user_id=ab3f95b2205c4429acb61bf01ea1ea94, role_id=f11bf727fddc4d8ea38916144f32515d)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:41.023762 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe27bec-5324-422a-a95e-6d6824ebe622 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:41.039683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0edef-ea4b-4b5a-9a5a-74cfc6e233e3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:41.040735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 475/946] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:03:40 2022] PUT /identity/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/ab3f95b2205c4429acb61bf01ea1ea94/roles/f11bf727fddc4d8ea38916144f32515d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:03:41.103332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:41.153599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0edef-ea4b-4b5a-9a5a-74cfc6e233e3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:41.194971 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1780d3-355d-45e4-ab27-f0be534d3e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:41.195759 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1780d3-355d-45e4-ab27-f0be534d3e79 None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:41.196142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1780d3-355d-45e4-ab27-f0be534d3e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:41.196508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1780d3-355d-45e4-ab27-f0be534d3e79 None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:41.197330 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1780d3-355d-45e4-ab27-f0be534d3e79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:41.199006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1780d3-355d-45e4-ab27-f0be534d3e79 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:41.202080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: WARNING keystone.server.flask.common [None req-8b1780d3-355d-45e4-ab27-f0be534d3e79 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 00:03:41.224006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.sql.core [None req-8b1780d3-355d-45e4-ab27-f0be534d3e79 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:03:41.224006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 00:03:41.224006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [parameters: {'id': '59287796ec6b43c1829692e64ed7c9f9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 00:03:41.224006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81710) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:03:41.233323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-8b1780d3-355d-45e4-ab27-f0be534d3e79 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59287796ec6b43c1829692e64ed7c9f9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59287796ec6b43c1829692e64ed7c9f9. Aug 31 00:03:41.233323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:41.233323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:03:41.233323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:03:41.233323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:03:41.233323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:03:41.233323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:03:41.233323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:03:41.233323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:03:41.233323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:03:41.233323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:03:41.233323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:03:41.233323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application result.read() Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 00:03:41.234294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application yield resource Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise self.value Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application session.commit() Aug 31 00:03:41.235384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:03:41.236278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:03:41.238263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application result.read() Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:03:41.240463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [parameters: {'id': '59287796ec6b43c1829692e64ed7c9f9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:41.244915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:41.246841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:41.249343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:41.249343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 00:03:41.249343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 00:03:41.249343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:41.249343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:41.249343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 00:03:41.249343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 00:03:41.249343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59287796ec6b43c1829692e64ed7c9f9. Aug 31 00:03:41.249343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:41.249343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 472/947] 10.222.0.60 () {60 vars in 1140 bytes} [Wed Aug 31 00:03:41 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:41.250636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe27bec-5324-422a-a95e-6d6824ebe622 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:41.352895 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe27bec-5324-422a-a95e-6d6824ebe622 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:41.362417 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:41.389147 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f7702-338a-4f54-b018-ca6221a39af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:41.389805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f7702-338a-4f54-b018-ca6221a39af8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:41.390139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f7702-338a-4f54-b018-ca6221a39af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:41.390404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f7702-338a-4f54-b018-ca6221a39af8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:41.397510 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f7702-338a-4f54-b018-ca6221a39af8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:41.398944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f7702-338a-4f54-b018-ca6221a39af8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-b01f7702-338a-4f54-b018-ca6221a39af8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:41.410694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:41.412904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:41.414052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:41.414052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:41.414052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:41.414052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:41.414052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:41.414052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:41.414052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:41.414052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:41.414052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 476/948] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:41.418618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1780d3-355d-45e4-ab27-f0be534d3e79 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:41.531453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1780d3-355d-45e4-ab27-f0be534d3e79 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:41.543431 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:41.568061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701412e-e1af-42fd-88ed-1913cf5530ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:41.568676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701412e-e1af-42fd-88ed-1913cf5530ef None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:41.568951 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701412e-e1af-42fd-88ed-1913cf5530ef None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:41.569244 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701412e-e1af-42fd-88ed-1913cf5530ef None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:41.569920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701412e-e1af-42fd-88ed-1913cf5530ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:41.570279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701412e-e1af-42fd-88ed-1913cf5530ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:41.571976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701412e-e1af-42fd-88ed-1913cf5530ef None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:41.597350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 473/949] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 31 00:03:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:42.082051 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf3e2c-7352-46ab-ae0d-3157049a6d46 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:42.083068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf3e2c-7352-46ab-ae0d-3157049a6d46 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:42.083068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf3e2c-7352-46ab-ae0d-3157049a6d46 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:42.084198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 477/950] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:42.090153 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa73919-5150-4e93-86e3-2e1fd86eeb91 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:42.090521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa73919-5150-4e93-86e3-2e1fd86eeb91 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:42.090674 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa73919-5150-4e93-86e3-2e1fd86eeb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:42.116261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-caa73919-5150-4e93-86e3-2e1fd86eeb91 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:42.117893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-caa73919-5150-4e93-86e3-2e1fd86eeb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:42.120003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be658030-7c57-4c4c-8202-4c9f11cb37c6 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:42.120277 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be658030-7c57-4c4c-8202-4c9f11cb37c6 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:42.120541 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be658030-7c57-4c4c-8202-4c9f11cb37c6 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:42.122099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 478/951] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:42.127176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3874-8834-473d-b189-a971ed0f89f0 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:42.127466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3874-8834-473d-b189-a971ed0f89f0 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:42.127720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3874-8834-473d-b189-a971ed0f89f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:42.148015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-af7d3874-8834-473d-b189-a971ed0f89f0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:42.149195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-af7d3874-8834-473d-b189-a971ed0f89f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:42.211977 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 474/952] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:42.225769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 479/953] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:42.490718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa73919-5150-4e93-86e3-2e1fd86eeb91 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:42.496274 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3874-8834-473d-b189-a971ed0f89f0 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:42.604857 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:42.608711 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa73919-5150-4e93-86e3-2e1fd86eeb91 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:42.621550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:42.632202 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3874-8834-473d-b189-a971ed0f89f0 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:42.658669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f0901-d20a-4300-ad4c-16b55c91ae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:42.659303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f0901-d20a-4300-ad4c-16b55c91ae36 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:42.659575 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f0901-d20a-4300-ad4c-16b55c91ae36 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:42.659840 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f0901-d20a-4300-ad4c-16b55c91ae36 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:42.660425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f0901-d20a-4300-ad4c-16b55c91ae36 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:42.661919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f0901-d20a-4300-ad4c-16b55c91ae36 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-e72f0901-d20a-4300-ad4c-16b55c91ae36 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:42.671136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:42.672442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:42.673884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:42.677509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 475/954] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 31 00:03:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:42.678779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f0901-d20a-4300-ad4c-16b55c91ae36 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:42.683698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aef58-d415-4f43-8589-2f4c20f76f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:42.684581 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aef58-d415-4f43-8589-2f4c20f76f36 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:42.685042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aef58-d415-4f43-8589-2f4c20f76f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:42.685511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aef58-d415-4f43-8589-2f4c20f76f36 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:42.686279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548aef58-d415-4f43-8589-2f4c20f76f36 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:42.687798 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548aef58-d415-4f43-8589-2f4c20f76f36 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-548aef58-d415-4f43-8589-2f4c20f76f36 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:42.700828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:42.701929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:03:42.702857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:42.706052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 480/955] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:42.711981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aef58-d415-4f43-8589-2f4c20f76f36 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:42.793118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f0901-d20a-4300-ad4c-16b55c91ae36 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:42.824376 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aef58-d415-4f43-8589-2f4c20f76f36 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:42.829544 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c171c12-ea3e-4c35-83d0-e0cfa8584c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:42.830532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c171c12-ea3e-4c35-83d0-e0cfa8584c80 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:42.831122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c171c12-ea3e-4c35-83d0-e0cfa8584c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:42.831593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c171c12-ea3e-4c35-83d0-e0cfa8584c80 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:42.832595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c171c12-ea3e-4c35-83d0-e0cfa8584c80 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:42.833456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c171c12-ea3e-4c35-83d0-e0cfa8584c80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:42.835034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c171c12-ea3e-4c35-83d0-e0cfa8584c80 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:42.845611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 476/956] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 31 00:03:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:42.846755 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c171c12-ea3e-4c35-83d0-e0cfa8584c80 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:42.860448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09270c1f-7d7f-40d7-8c6f-f6cdbf7ef321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:42.861053 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09270c1f-7d7f-40d7-8c6f-f6cdbf7ef321 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:42.861355 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09270c1f-7d7f-40d7-8c6f-f6cdbf7ef321 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:42.861620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09270c1f-7d7f-40d7-8c6f-f6cdbf7ef321 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:42.862301 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09270c1f-7d7f-40d7-8c6f-f6cdbf7ef321 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:42.862600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09270c1f-7d7f-40d7-8c6f-f6cdbf7ef321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:42.864002 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09270c1f-7d7f-40d7-8c6f-f6cdbf7ef321 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:42.873314 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 481/957] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 31 00:03:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:42.875817 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09270c1f-7d7f-40d7-8c6f-f6cdbf7ef321 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:42.880026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:42.904814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:42.958628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c171c12-ea3e-4c35-83d0-e0cfa8584c80 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:42.984390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09270c1f-7d7f-40d7-8c6f-f6cdbf7ef321 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:42.995535 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2f321-e1c4-46d4-a368-8f651dd44399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:42.996513 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2f321-e1c4-46d4-a368-8f651dd44399 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:42.997000 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2f321-e1c4-46d4-a368-8f651dd44399 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:42.997509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2f321-e1c4-46d4-a368-8f651dd44399 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:42.998351 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2f321-e1c4-46d4-a368-8f651dd44399 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:42.998869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2f321-e1c4-46d4-a368-8f651dd44399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:43.000604 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2f321-e1c4-46d4-a368-8f651dd44399 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:43.011273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 477/958] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 31 00:03:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:43.012512 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2f321-e1c4-46d4-a368-8f651dd44399 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:43.019602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c74c2-89af-4f6f-9ae7-87a900f1e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:43.020427 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c74c2-89af-4f6f-9ae7-87a900f1e40a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:43.020785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c74c2-89af-4f6f-9ae7-87a900f1e40a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:43.021073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c74c2-89af-4f6f-9ae7-87a900f1e40a None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:43.022619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c74c2-89af-4f6f-9ae7-87a900f1e40a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:43.023110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c74c2-89af-4f6f-9ae7-87a900f1e40a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:43.025306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c74c2-89af-4f6f-9ae7-87a900f1e40a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:43.037473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 482/959] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 31 00:03:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:43.106160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192538-e9f5-44e0-a6c1-4343fa25db36 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:43.106813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192538-e9f5-44e0-a6c1-4343fa25db36 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:43.106813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192538-e9f5-44e0-a6c1-4343fa25db36 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:43.112165 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 483/960] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:43.114652 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c558b-4b64-4e4b-b500-3eccff96ba95 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:43.114652 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c558b-4b64-4e4b-b500-3eccff96ba95 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:43.115108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c558b-4b64-4e4b-b500-3eccff96ba95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:43.126482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:43.135929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-054c558b-4b64-4e4b-b500-3eccff96ba95 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:43.137154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-054c558b-4b64-4e4b-b500-3eccff96ba95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:43.138823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2f321-e1c4-46d4-a368-8f651dd44399 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:43.177689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f513ac9-bc80-4bfd-bca8-d9a1cfc410c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:43.178306 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f513ac9-bc80-4bfd-bca8-d9a1cfc410c5 None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:43.178579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f513ac9-bc80-4bfd-bca8-d9a1cfc410c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:43.178846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f513ac9-bc80-4bfd-bca8-d9a1cfc410c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:43.179528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f513ac9-bc80-4bfd-bca8-d9a1cfc410c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:43.180927 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f513ac9-bc80-4bfd-bca8-d9a1cfc410c5 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:43.205387 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 478/961] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:03:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:03:43.237327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 484/962] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:43.507727 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f513ac9-bc80-4bfd-bca8-d9a1cfc410c5 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:43.582831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f3232-6c97-410a-8b68-883d9523d6f5 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:43.583200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f3232-6c97-410a-8b68-883d9523d6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:43.583373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f3232-6c97-410a-8b68-883d9523d6f5 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:43.584993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 485/963] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:43.590128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4bbc-690a-4f5c-8b5c-e7de1bfe2b0c None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:43.590406 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4bbc-690a-4f5c-8b5c-e7de1bfe2b0c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:43.590678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4bbc-690a-4f5c-8b5c-e7de1bfe2b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:43.612839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-45dc4bbc-690a-4f5c-8b5c-e7de1bfe2b0c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:43.614805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-45dc4bbc-690a-4f5c-8b5c-e7de1bfe2b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:43.617561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f513ac9-bc80-4bfd-bca8-d9a1cfc410c5 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:43.628320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:43.655617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7e3a6-ae8d-4854-971c-e391fcda1793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:43.656249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7e3a6-ae8d-4854-971c-e391fcda1793 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:43.656521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7e3a6-ae8d-4854-971c-e391fcda1793 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:43.656894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7e3a6-ae8d-4854-971c-e391fcda1793 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:43.669117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7e3a6-ae8d-4854-971c-e391fcda1793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-5ae7e3a6-ae8d-4854-971c-e391fcda1793 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:43.674417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:43.675496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:43.676397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:43.676397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:43.676397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:43.676397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:43.676397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:43.676397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:43.676397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:43.676397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:43.676397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:43.676397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:43.676397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:03:43.676397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:43.680255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 479/964] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 31 00:03:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:43.682428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7e3a6-ae8d-4854-971c-e391fcda1793 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:43.694419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:43.705496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 486/965] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:43.796099 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7e3a6-ae8d-4854-971c-e391fcda1793 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:43.832704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c58db-34d8-455d-b09f-816a485f0c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:43.833367 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c58db-34d8-455d-b09f-816a485f0c52 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:43.833632 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c58db-34d8-455d-b09f-816a485f0c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:43.833904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c58db-34d8-455d-b09f-816a485f0c52 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:43.834568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c58db-34d8-455d-b09f-816a485f0c52 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:43.834863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c58db-34d8-455d-b09f-816a485f0c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:43.836233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c58db-34d8-455d-b09f-816a485f0c52 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:43.849342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 480/966] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 31 00:03:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:43.851502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4bbc-690a-4f5c-8b5c-e7de1bfe2b0c None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:43.952241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4bbc-690a-4f5c-8b5c-e7de1bfe2b0c None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:43.987017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471c715-3082-472e-81fe-a6aa4d5779b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:43.987651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471c715-3082-472e-81fe-a6aa4d5779b8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:43.987922 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471c715-3082-472e-81fe-a6aa4d5779b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:43.988188 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471c715-3082-472e-81fe-a6aa4d5779b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:43.998850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471c715-3082-472e-81fe-a6aa4d5779b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:44.000289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471c715-3082-472e-81fe-a6aa4d5779b8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:44.007459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-b471c715-3082-472e-81fe-a6aa4d5779b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:44.015706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:44.017105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:44.018050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:44.018050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:44.018050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:44.018050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 487/967] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:44.025915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c58db-34d8-455d-b09f-816a485f0c52 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:44.038792 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471c715-3082-472e-81fe-a6aa4d5779b8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:44.106986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:44.141726 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c58db-34d8-455d-b09f-816a485f0c52 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:44.165096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471c715-3082-472e-81fe-a6aa4d5779b8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:44.180269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa4cf6-cc5e-4ba1-b5ce-c9756393a83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:44.181303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa4cf6-cc5e-4ba1-b5ce-c9756393a83b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:44.181809 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa4cf6-cc5e-4ba1-b5ce-c9756393a83b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:44.182278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa4cf6-cc5e-4ba1-b5ce-c9756393a83b None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:44.183123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa4cf6-cc5e-4ba1-b5ce-c9756393a83b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:44.183627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa4cf6-cc5e-4ba1-b5ce-c9756393a83b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:44.185307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa4cf6-cc5e-4ba1-b5ce-c9756393a83b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:44.203538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 481/968] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:44.205307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa4cf6-cc5e-4ba1-b5ce-c9756393a83b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:44.206758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a08e7d-cf1b-4583-96e9-a131085afeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:44.207462 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a08e7d-cf1b-4583-96e9-a131085afeaa None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:44.207750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a08e7d-cf1b-4583-96e9-a131085afeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:44.208009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a08e7d-cf1b-4583-96e9-a131085afeaa None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:44.208662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a08e7d-cf1b-4583-96e9-a131085afeaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:44.210125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a08e7d-cf1b-4583-96e9-a131085afeaa None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:44.212763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: WARNING keystone.server.flask.common [None req-a7a08e7d-cf1b-4583-96e9-a131085afeaa None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 00:03:44.227244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.sql.core [None req-a7a08e7d-cf1b-4583-96e9-a131085afeaa None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:03:44.227244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 00:03:44.227244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [parameters: {'user_id': 'cdb4832fb89b45ec8c0fbd949656e8f5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 00:03:44.227244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81709) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-a7a08e7d-cf1b-4583-96e9-a131085afeaa None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application result.read() Aug 31 00:03:44.246217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:03:44.247223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application yield resource Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise self.value Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application session.commit() Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:03:44.248867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:03:44.249839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:03:44.251398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application result.read() Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:03:44.254694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cdb4832fb89b45ec8c0fbd949656e8f5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:44.256977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 00:03:44.258927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 00:03:44.261043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 00:03:44.261043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 00:03:44.261043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:03:44.261043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:03:44.261043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 00:03:44.261043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:44.261043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 488/969] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 31 00:03:44 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:44.261043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a08e7d-cf1b-4583-96e9-a131085afeaa None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:44.325909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:44.331689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa4cf6-cc5e-4ba1-b5ce-c9756393a83b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:44.363004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:44.370251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5af24d-5e59-4a06-b63d-1eea146497ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:44.371143 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5af24d-5e59-4a06-b63d-1eea146497ec None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:44.371664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5af24d-5e59-4a06-b63d-1eea146497ec None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:44.372170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5af24d-5e59-4a06-b63d-1eea146497ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:44.378949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a08e7d-cf1b-4583-96e9-a131085afeaa None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:44.380458 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5af24d-5e59-4a06-b63d-1eea146497ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:44.382141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5af24d-5e59-4a06-b63d-1eea146497ec None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-af5af24d-5e59-4a06-b63d-1eea146497ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:44.395866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:44.396864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:44.397896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:44.397896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:44.397896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:44.397896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:44.397896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:44.397896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:44.397896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:44.397896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:44.397896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:03:44.397896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:44.405383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 482/970] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 31 00:03:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:44.406931 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5af24d-5e59-4a06-b63d-1eea146497ec None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:44.415101 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8f012-88bc-4979-8fb2-d84b27b73023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:44.415743 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8f012-88bc-4979-8fb2-d84b27b73023 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:44.416016 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8f012-88bc-4979-8fb2-d84b27b73023 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:44.416282 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8f012-88bc-4979-8fb2-d84b27b73023 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:44.425787 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8f012-88bc-4979-8fb2-d84b27b73023 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:44.427541 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8f012-88bc-4979-8fb2-d84b27b73023 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-9ff8f012-88bc-4979-8fb2-d84b27b73023 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:44.439662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:44.440618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:44.442802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:44.442802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:44.442802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:44.442802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:44.442802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:44.442802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:44.442802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:44.442802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:44.442802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:03:44.442802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:44.442802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 489/971] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:03:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:44.450755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8f012-88bc-4979-8fb2-d84b27b73023 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:44.530293 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5af24d-5e59-4a06-b63d-1eea146497ec None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:44.567920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b38c41-6246-4a49-bf3a-11057bc50f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:44.569078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b38c41-6246-4a49-bf3a-11057bc50f4c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:44.569932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b38c41-6246-4a49-bf3a-11057bc50f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:44.570710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b38c41-6246-4a49-bf3a-11057bc50f4c None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:44.571657 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b38c41-6246-4a49-bf3a-11057bc50f4c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:44.572156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b38c41-6246-4a49-bf3a-11057bc50f4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:44.572273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8f012-88bc-4979-8fb2-d84b27b73023 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:44.574093 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b38c41-6246-4a49-bf3a-11057bc50f4c None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:44.596386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:44.597744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 483/972] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 31 00:03:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:44.603710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b38c41-6246-4a49-bf3a-11057bc50f4c None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:44.619208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83054ef-8a33-489b-95af-83e2a0086283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:44.620104 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83054ef-8a33-489b-95af-83e2a0086283 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:44.620570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83054ef-8a33-489b-95af-83e2a0086283 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:44.620988 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83054ef-8a33-489b-95af-83e2a0086283 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:44.621915 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83054ef-8a33-489b-95af-83e2a0086283 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:44.622358 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83054ef-8a33-489b-95af-83e2a0086283 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:44.624005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83054ef-8a33-489b-95af-83e2a0086283 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:44.658753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:44.673326 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 490/973] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 31 00:03:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:44.720611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b38c41-6246-4a49-bf3a-11057bc50f4c None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:44.761983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d840a7c-41e6-48dc-8d6f-2dcb9892cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:44.762601 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d840a7c-41e6-48dc-8d6f-2dcb9892cae9 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:44.762871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d840a7c-41e6-48dc-8d6f-2dcb9892cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:44.763135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d840a7c-41e6-48dc-8d6f-2dcb9892cae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:44.839813 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d840a7c-41e6-48dc-8d6f-2dcb9892cae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:44.841717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d840a7c-41e6-48dc-8d6f-2dcb9892cae9 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:44.892454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:44.950756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 484/974] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:44 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:03:44.956301 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83054ef-8a33-489b-95af-83e2a0086283 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:45.058141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83054ef-8a33-489b-95af-83e2a0086283 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:45.064924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1018a-3c4d-4664-8b0f-ecf1d8f41a73 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:45.065198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1018a-3c4d-4664-8b0f-ecf1d8f41a73 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:45.065498 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1018a-3c4d-4664-8b0f-ecf1d8f41a73 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:45.067097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 485/975] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:45.072250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506f26f-e5f5-4519-999d-62819e56a98b None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:45.072502 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506f26f-e5f5-4519-999d-62819e56a98b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:45.072802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506f26f-e5f5-4519-999d-62819e56a98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:45.096432 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-9506f26f-e5f5-4519-999d-62819e56a98b None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:45.097639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-9506f26f-e5f5-4519-999d-62819e56a98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:45.102216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708a41b-ad65-4c71-bdb2-fe5e46745817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:45.103097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708a41b-ad65-4c71-bdb2-fe5e46745817 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:45.103581 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708a41b-ad65-4c71-bdb2-fe5e46745817 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:45.104022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708a41b-ad65-4c71-bdb2-fe5e46745817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:45.116071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708a41b-ad65-4c71-bdb2-fe5e46745817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:45.117972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708a41b-ad65-4c71-bdb2-fe5e46745817 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-e708a41b-ad65-4c71-bdb2-fe5e46745817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:45.133472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:45.134463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:45.135369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:45.135369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:45.135369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:45.135369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 491/976] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:45.140114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708a41b-ad65-4c71-bdb2-fe5e46745817 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:45.169636 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 486/977] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:45.174819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:45.217112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa30323-2edc-4c3e-a297-cf54b0b03145 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:45.217423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa30323-2edc-4c3e-a297-cf54b0b03145 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:45.217698 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa30323-2edc-4c3e-a297-cf54b0b03145 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:45.219149 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 487/978] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:45.224140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741d0ce-4f79-46f4-9f24-3889731a2dc7 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:45.224420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741d0ce-4f79-46f4-9f24-3889731a2dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:45.224695 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741d0ce-4f79-46f4-9f24-3889731a2dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:45.244362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-3741d0ce-4f79-46f4-9f24-3889731a2dc7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:45.245579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3741d0ce-4f79-46f4-9f24-3889731a2dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:45.250238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708a41b-ad65-4c71-bdb2-fe5e46745817 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:45.285592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee5918-c347-4b63-b141-6ad8f695b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:45.286248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee5918-c347-4b63-b141-6ad8f695b050 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:45.286529 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee5918-c347-4b63-b141-6ad8f695b050 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:45.286795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee5918-c347-4b63-b141-6ad8f695b050 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:45.287449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee5918-c347-4b63-b141-6ad8f695b050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:45.287750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee5918-c347-4b63-b141-6ad8f695b050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:45.289103 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee5918-c347-4b63-b141-6ad8f695b050 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:45.301010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 492/979] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:45.306589 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee5918-c347-4b63-b141-6ad8f695b050 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:45.324326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 488/980] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:45.398346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:45.409813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee5918-c347-4b63-b141-6ad8f695b050 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:45.433524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741d0ce-4f79-46f4-9f24-3889731a2dc7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:45.444743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:45.448287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de497c74-ea17-48be-9732-512c4563bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:45.448894 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de497c74-ea17-48be-9732-512c4563bb3f None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:45.449233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de497c74-ea17-48be-9732-512c4563bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:45.449481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de497c74-ea17-48be-9732-512c4563bb3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:45.457372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de497c74-ea17-48be-9732-512c4563bb3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:45.458925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de497c74-ea17-48be-9732-512c4563bb3f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-de497c74-ea17-48be-9732-512c4563bb3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:45.470608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:45.471512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:45.472728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:45.472728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:45.472728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:45.472728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:45.472728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:45.472728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:45.472728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:45.472728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:45.472728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 493/981] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:45.477758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de497c74-ea17-48be-9732-512c4563bb3f None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:45.548478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741d0ce-4f79-46f4-9f24-3889731a2dc7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:45.584448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c64ed-3501-45e1-8b89-1c952b20ad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:45.585051 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c64ed-3501-45e1-8b89-1c952b20ad6a None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:45.585421 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c64ed-3501-45e1-8b89-1c952b20ad6a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:45.585691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c64ed-3501-45e1-8b89-1c952b20ad6a None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:45.586357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c64ed-3501-45e1-8b89-1c952b20ad6a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:45.587805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c64ed-3501-45e1-8b89-1c952b20ad6a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:45.601086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de497c74-ea17-48be-9732-512c4563bb3f None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:45.603132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 489/982] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:03:45 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:03:45.606195 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c64ed-3501-45e1-8b89-1c952b20ad6a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:45.649574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394268cd-96aa-4f09-ae97-dbc1c842caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:45.650245 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394268cd-96aa-4f09-ae97-dbc1c842caa7 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:45.650519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394268cd-96aa-4f09-ae97-dbc1c842caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:45.650778 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394268cd-96aa-4f09-ae97-dbc1c842caa7 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:45.651472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394268cd-96aa-4f09-ae97-dbc1c842caa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:45.651944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394268cd-96aa-4f09-ae97-dbc1c842caa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:45.653427 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394268cd-96aa-4f09-ae97-dbc1c842caa7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:45.673305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 494/983] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:45.675632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394268cd-96aa-4f09-ae97-dbc1c842caa7 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:45.684241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:45.689818 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:45.722888 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c64ed-3501-45e1-8b89-1c952b20ad6a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:45.761299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528b8d9-4126-43b6-9f3e-66ebe9bd4ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:45.762215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528b8d9-4126-43b6-9f3e-66ebe9bd4ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:45.762215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528b8d9-4126-43b6-9f3e-66ebe9bd4ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:45.762507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528b8d9-4126-43b6-9f3e-66ebe9bd4ef0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:45.763444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528b8d9-4126-43b6-9f3e-66ebe9bd4ef0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:45.764718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528b8d9-4126-43b6-9f3e-66ebe9bd4ef0 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-6528b8d9-4126-43b6-9f3e-66ebe9bd4ef0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:45.774593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:45.775626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:45.776492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 490/984] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 31 00:03:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:45.782192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528b8d9-4126-43b6-9f3e-66ebe9bd4ef0 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:45.794587 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394268cd-96aa-4f09-ae97-dbc1c842caa7 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:45.830346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dc544-49a2-42ed-833e-c318cff03f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:45.831020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dc544-49a2-42ed-833e-c318cff03f13 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:45.831295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dc544-49a2-42ed-833e-c318cff03f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:45.831562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dc544-49a2-42ed-833e-c318cff03f13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:45.832425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3dc544-49a2-42ed-833e-c318cff03f13 None admin] RBAC: Adding query filter params (role.id=f11bf727fddc4d8ea38916144f32515d, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=ab3f95b2205c4429acb61bf01ea1ea94) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:45.832897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3dc544-49a2-42ed-833e-c318cff03f13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:45.835297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3dc544-49a2-42ed-833e-c318cff03f13 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:45.841596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 495/985] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:45 2022] GET /identity/v3/role_assignments?user.id=ab3f95b2205c4429acb61bf01ea1ea94&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=f11bf727fddc4d8ea38916144f32515d => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:45.891043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528b8d9-4126-43b6-9f3e-66ebe9bd4ef0 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:45.929401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:45.935255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddacfb-e140-4fd4-b9c1-b86779c31c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:45.936410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddacfb-e140-4fd4-b9c1-b86779c31c15 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:45.936670 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddacfb-e140-4fd4-b9c1-b86779c31c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:45.937188 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddacfb-e140-4fd4-b9c1-b86779c31c15 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:45.938271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddacfb-e140-4fd4-b9c1-b86779c31c15 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:45.938570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddacfb-e140-4fd4-b9c1-b86779c31c15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:45.939950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddacfb-e140-4fd4-b9c1-b86779c31c15 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:45.945999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 491/986] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 31 00:03:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:45.951819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dc544-49a2-42ed-833e-c318cff03f13 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:46.038816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:46.072985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dc544-49a2-42ed-833e-c318cff03f13 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:46.112845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6f277-0148-40ed-9f7c-4425a89ceaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:46.113626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6f277-0148-40ed-9f7c-4425a89ceaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:46.113873 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6f277-0148-40ed-9f7c-4425a89ceaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:46.114150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6f277-0148-40ed-9f7c-4425a89ceaf3 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:46.114801 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6f277-0148-40ed-9f7c-4425a89ceaf3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:46.115104 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6f277-0148-40ed-9f7c-4425a89ceaf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:46.116476 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6f277-0148-40ed-9f7c-4425a89ceaf3 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:46.121565 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 496/987] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 31 00:03:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:46.127858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddacfb-e140-4fd4-b9c1-b86779c31c15 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:46.234144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddacfb-e140-4fd4-b9c1-b86779c31c15 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:46.268965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37f082-247b-4050-ab15-06ad48cfe13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:46.269598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f082-247b-4050-ab15-06ad48cfe13f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:46.270084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f082-247b-4050-ab15-06ad48cfe13f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:46.270245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f082-247b-4050-ab15-06ad48cfe13f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:46.270884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37f082-247b-4050-ab15-06ad48cfe13f None admin] RBAC: Adding query filter params (interface=admin, service_id=3c20994c51fc4a12822f49aa2993efc5, region_id=RegionOne) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:46.271176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37f082-247b-4050-ab15-06ad48cfe13f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:46.272519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37f082-247b-4050-ab15-06ad48cfe13f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:46.278247 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 492/988] 10.222.0.60 () {56 vars in 1249 bytes} [Wed Aug 31 00:03:46 2022] GET /identity/v3/endpoints?service_id=3c20994c51fc4a12822f49aa2993efc5&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:46.284216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6f277-0148-40ed-9f7c-4425a89ceaf3 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:46.389844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6f277-0148-40ed-9f7c-4425a89ceaf3 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:46.424682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68c81b-0658-4201-9c30-c810beeeecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:46.425315 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68c81b-0658-4201-9c30-c810beeeecb5 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:46.425593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68c81b-0658-4201-9c30-c810beeeecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:46.425859 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68c81b-0658-4201-9c30-c810beeeecb5 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:46.426541 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68c81b-0658-4201-9c30-c810beeeecb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:46.428003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68c81b-0658-4201-9c30-c810beeeecb5 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:46.429097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:46.435945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 497/989] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 31 00:03:46 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:03:47.572355 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3daab-85f3-424b-b5d1-0b53c0194dff None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:47.572907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3daab-85f3-424b-b5d1-0b53c0194dff None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:47.572907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3daab-85f3-424b-b5d1-0b53c0194dff None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:47.574452 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 493/990] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:47.579780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e19517-5e93-4c49-aa96-76c0f442d33e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:47.580194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e19517-5e93-4c49-aa96-76c0f442d33e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:47.580378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e19517-5e93-4c49-aa96-76c0f442d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:47.600697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-f6e19517-5e93-4c49-aa96-76c0f442d33e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:47.602349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f6e19517-5e93-4c49-aa96-76c0f442d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:47.674683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 498/991] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:47.782376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78403c46-b1a1-43d0-a74b-ceb8065c8000 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:47.782619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78403c46-b1a1-43d0-a74b-ceb8065c8000 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:47.782909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78403c46-b1a1-43d0-a74b-ceb8065c8000 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:47.784415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 494/992] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:47.790065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871fa26-f5f9-43b9-b47b-8fd2a53aae01 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:47.790314 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871fa26-f5f9-43b9-b47b-8fd2a53aae01 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:47.790606 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871fa26-f5f9-43b9-b47b-8fd2a53aae01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:47.809332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c871fa26-f5f9-43b9-b47b-8fd2a53aae01 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:47.810521 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c871fa26-f5f9-43b9-b47b-8fd2a53aae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:47.879567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 499/993] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:47.941476 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78403c46-b1a1-43d0-a74b-ceb8065c8000 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:48.007044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:48.052185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78403c46-b1a1-43d0-a74b-ceb8065c8000 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:48.090353 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f4e4f-1cf1-4b37-9467-2993ff1128a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:48.091415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f4e4f-1cf1-4b37-9467-2993ff1128a7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:48.091415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f4e4f-1cf1-4b37-9467-2993ff1128a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:48.091590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f4e4f-1cf1-4b37-9467-2993ff1128a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:48.092082 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f4e4f-1cf1-4b37-9467-2993ff1128a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:48.093516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f4e4f-1cf1-4b37-9467-2993ff1128a7 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-ac3f4e4f-1cf1-4b37-9467-2993ff1128a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:48.103639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:48.104653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:48.106276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 495/994] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:48.110946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871fa26-f5f9-43b9-b47b-8fd2a53aae01 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:48.144094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f4e4f-1cf1-4b37-9467-2993ff1128a7 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:48.178011 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:48.221473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871fa26-f5f9-43b9-b47b-8fd2a53aae01 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:48.257149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6738a7-018b-4855-baf1-311f50345881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:48.257811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6738a7-018b-4855-baf1-311f50345881 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:48.258053 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6738a7-018b-4855-baf1-311f50345881 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:48.258320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6738a7-018b-4855-baf1-311f50345881 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:48.258941 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6738a7-018b-4855-baf1-311f50345881 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:48.259238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6738a7-018b-4855-baf1-311f50345881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:48.260612 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6738a7-018b-4855-baf1-311f50345881 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:48.262434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f4e4f-1cf1-4b37-9467-2993ff1128a7 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:48.266601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 500/995] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 31 00:03:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:48.272993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6738a7-018b-4855-baf1-311f50345881 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:48.289248 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:48.302325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca646b-1545-4e69-8309-fc8732bb801f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:48.302955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca646b-1545-4e69-8309-fc8732bb801f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:48.303220 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca646b-1545-4e69-8309-fc8732bb801f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:48.303483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca646b-1545-4e69-8309-fc8732bb801f None admin] PATH_INFO: `/v3/services/image` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:48.304066 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca646b-1545-4e69-8309-fc8732bb801f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:48.305445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca646b-1545-4e69-8309-fc8732bb801f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-24ca646b-1545-4e69-8309-fc8732bb801f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:48.314087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:48.315081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:48.318135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 496/996] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Aug 31 00:03:48 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:48.321001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca646b-1545-4e69-8309-fc8732bb801f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:48.381052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6738a7-018b-4855-baf1-311f50345881 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:48.405340 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:48.418698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991abda3-5ece-4285-8ffa-e217d3a9a5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:48.419411 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991abda3-5ece-4285-8ffa-e217d3a9a5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:48.419700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991abda3-5ece-4285-8ffa-e217d3a9a5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:48.419969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991abda3-5ece-4285-8ffa-e217d3a9a5f2 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:48.420597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991abda3-5ece-4285-8ffa-e217d3a9a5f2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:48.420897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991abda3-5ece-4285-8ffa-e217d3a9a5f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:48.422278 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991abda3-5ece-4285-8ffa-e217d3a9a5f2 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:48.422477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca646b-1545-4e69-8309-fc8732bb801f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:48.427123 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 501/997] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 31 00:03:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:48.428350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720112db-a839-49f7-850a-8edc4caee557 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:48.428635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720112db-a839-49f7-850a-8edc4caee557 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:48.428902 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720112db-a839-49f7-850a-8edc4caee557 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:48.430132 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 502/998] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:48.432761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720112db-a839-49f7-850a-8edc4caee557 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:48.459880 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fc08e-b887-4225-bcb8-94882f72fc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:48.460496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fc08e-b887-4225-bcb8-94882f72fc52 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:48.460765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fc08e-b887-4225-bcb8-94882f72fc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:48.461026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fc08e-b887-4225-bcb8-94882f72fc52 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:48.461676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fc08e-b887-4225-bcb8-94882f72fc52 None admin] RBAC: Adding query filter params (name=image) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:48.461967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fc08e-b887-4225-bcb8-94882f72fc52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:48.463326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fc08e-b887-4225-bcb8-94882f72fc52 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:48.467981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 497/999] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:48.469080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5781d1-1664-4b1f-a6d6-cf17da5042cf None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:48.469459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5781d1-1664-4b1f-a6d6-cf17da5042cf None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:48.469730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5781d1-1664-4b1f-a6d6-cf17da5042cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:48.486981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-bc5781d1-1664-4b1f-a6d6-cf17da5042cf None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:48.488165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-bc5781d1-1664-4b1f-a6d6-cf17da5042cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:48.534593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:48.534872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720112db-a839-49f7-850a-8edc4caee557 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:48.556659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 498/1000] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:48.557848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5781d1-1664-4b1f-a6d6-cf17da5042cf None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:48.581322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb90e3-1cb4-49a4-84e0-46b8f4bf438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:48.582123 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb90e3-1cb4-49a4-84e0-46b8f4bf438e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:48.583101 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb90e3-1cb4-49a4-84e0-46b8f4bf438e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:48.583280 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb90e3-1cb4-49a4-84e0-46b8f4bf438e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:48.583974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb90e3-1cb4-49a4-84e0-46b8f4bf438e None admin] RBAC: Adding query filter params (interface=public, service_id=ef97b39cec6c4cbba21472f206d79fcf, region_id=RegionOne) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:48.584265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb90e3-1cb4-49a4-84e0-46b8f4bf438e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:48.586024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb90e3-1cb4-49a4-84e0-46b8f4bf438e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:48.595747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 503/1001] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 31 00:03:48 2022] GET /identity/v3/endpoints?service_id=ef97b39cec6c4cbba21472f206d79fcf&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:48.596805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb90e3-1cb4-49a4-84e0-46b8f4bf438e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:48.649810 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:48.667496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5781d1-1664-4b1f-a6d6-cf17da5042cf None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:48.705391 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb90e3-1cb4-49a4-84e0-46b8f4bf438e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:48.706362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c1f9a-9562-411f-982a-fc64dcafb6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:48.706972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c1f9a-9562-411f-982a-fc64dcafb6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:48.707305 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c1f9a-9562-411f-982a-fc64dcafb6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:48.707970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c1f9a-9562-411f-982a-fc64dcafb6c7 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:48.708884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c1f9a-9562-411f-982a-fc64dcafb6c7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:48.708884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c1f9a-9562-411f-982a-fc64dcafb6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:48.709871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c1f9a-9562-411f-982a-fc64dcafb6c7 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:48.714624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 499/1002] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:48.744243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c732fc-dc72-45b9-9040-38a0dec4f1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:48.744943 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c732fc-dc72-45b9-9040-38a0dec4f1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:48.745251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c732fc-dc72-45b9-9040-38a0dec4f1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:48.745514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c732fc-dc72-45b9-9040-38a0dec4f1a5 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:48.746128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c732fc-dc72-45b9-9040-38a0dec4f1a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:48.747513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c732fc-dc72-45b9-9040-38a0dec4f1a5 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:48.755419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 504/1003] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 31 00:03:48 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:03:48.826345 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c1f9a-9562-411f-982a-fc64dcafb6c7 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:48.884587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:48.944873 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c1f9a-9562-411f-982a-fc64dcafb6c7 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:48.982761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29d940-eb93-4abf-a4ba-9094c1b4eebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:48.983518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29d940-eb93-4abf-a4ba-9094c1b4eebe None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:48.983782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29d940-eb93-4abf-a4ba-9094c1b4eebe None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:48.984087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29d940-eb93-4abf-a4ba-9094c1b4eebe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:48.984741 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29d940-eb93-4abf-a4ba-9094c1b4eebe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:48.986120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29d940-eb93-4abf-a4ba-9094c1b4eebe None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-8c29d940-eb93-4abf-a4ba-9094c1b4eebe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:48.995229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:48.996262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:48.998092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 500/1004] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 31 00:03:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:49.002706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c732fc-dc72-45b9-9040-38a0dec4f1a5 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:49.123170 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c732fc-dc72-45b9-9040-38a0dec4f1a5 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:49.143326 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:49.174555 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548c86-1815-4a40-ad8e-edda3712fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:49.175169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548c86-1815-4a40-ad8e-edda3712fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:49.175490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548c86-1815-4a40-ad8e-edda3712fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:49.175728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548c86-1815-4a40-ad8e-edda3712fcd4 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:49.176360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548c86-1815-4a40-ad8e-edda3712fcd4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:49.176650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548c86-1815-4a40-ad8e-edda3712fcd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:49.178121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548c86-1815-4a40-ad8e-edda3712fcd4 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:49.187455 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 505/1005] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 31 00:03:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:49.192542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29d940-eb93-4abf-a4ba-9094c1b4eebe None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:49.335686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29d940-eb93-4abf-a4ba-9094c1b4eebe None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:49.347401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:49.376055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619719d8-fa5c-4de6-9b80-5232a3e95aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:49.376930 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619719d8-fa5c-4de6-9b80-5232a3e95aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:49.377386 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619719d8-fa5c-4de6-9b80-5232a3e95aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:49.377819 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619719d8-fa5c-4de6-9b80-5232a3e95aa2 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:49.380111 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619719d8-fa5c-4de6-9b80-5232a3e95aa2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:49.380602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619719d8-fa5c-4de6-9b80-5232a3e95aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:49.384295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619719d8-fa5c-4de6-9b80-5232a3e95aa2 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:49.395402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 501/1006] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 31 00:03:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:49.397036 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548c86-1815-4a40-ad8e-edda3712fcd4 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:49.520947 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548c86-1815-4a40-ad8e-edda3712fcd4 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:49.563809 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e006900-3e97-4890-a7ba-f71ebec4e48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:49.564674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e006900-3e97-4890-a7ba-f71ebec4e48f None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:49.565118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e006900-3e97-4890-a7ba-f71ebec4e48f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:49.565591 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e006900-3e97-4890-a7ba-f71ebec4e48f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:49.566400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e006900-3e97-4890-a7ba-f71ebec4e48f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:49.568026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e006900-3e97-4890-a7ba-f71ebec4e48f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:49.597333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 506/1007] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:03:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:03:50.763243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316d581-c3db-4fc9-8a4e-3b6fa96f0aa4 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:50.763788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316d581-c3db-4fc9-8a4e-3b6fa96f0aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:50.763788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316d581-c3db-4fc9-8a4e-3b6fa96f0aa4 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:50.765348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 502/1008] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:50.771313 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594e8e4-3f5d-42d3-9798-8373e8ff4e0a None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:50.771857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594e8e4-3f5d-42d3-9798-8373e8ff4e0a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:50.771857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594e8e4-3f5d-42d3-9798-8373e8ff4e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:50.791987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219a89d-300e-4f36-89fb-b10a7174495a None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:50.792235 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219a89d-300e-4f36-89fb-b10a7174495a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:50.792696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219a89d-300e-4f36-89fb-b10a7174495a None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:50.793250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d594e8e4-3f5d-42d3-9798-8373e8ff4e0a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:50.794299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 503/1009] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:50.794490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d594e8e4-3f5d-42d3-9798-8373e8ff4e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:50.799189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e04a2e-cee7-4319-a265-0e68e94522a1 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:50.799440 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e04a2e-cee7-4319-a265-0e68e94522a1 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:50.799741 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e04a2e-cee7-4319-a265-0e68e94522a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:50.818836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-51e04a2e-cee7-4319-a265-0e68e94522a1 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:50.820181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-51e04a2e-cee7-4319-a265-0e68e94522a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:50.827584 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:50.897255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 504/1010] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:50.905264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 507/1011] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:51.163754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e04a2e-cee7-4319-a265-0e68e94522a1 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:51.166903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594e8e4-3f5d-42d3-9798-8373e8ff4e0a None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:51.267443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:51.271348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594e8e4-3f5d-42d3-9798-8373e8ff4e0a None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:51.271487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e04a2e-cee7-4319-a265-0e68e94522a1 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:51.309939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c94b9-bd4b-4854-9897-72222091d97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:51.310548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c94b9-bd4b-4854-9897-72222091d97c None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:51.310828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c94b9-bd4b-4854-9897-72222091d97c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:51.311029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b307438-0a69-47e1-b42e-7d5945114f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:51.311142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c94b9-bd4b-4854-9897-72222091d97c None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:51.311662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b307438-0a69-47e1-b42e-7d5945114f2a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:51.311759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c94b9-bd4b-4854-9897-72222091d97c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:51.311926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b307438-0a69-47e1-b42e-7d5945114f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:51.312194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b307438-0a69-47e1-b42e-7d5945114f2a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:51.312772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b307438-0a69-47e1-b42e-7d5945114f2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:51.313088 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c94b9-bd4b-4854-9897-72222091d97c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:51.314168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b307438-0a69-47e1-b42e-7d5945114f2a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-4b307438-0a69-47e1-b42e-7d5945114f2a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:51.324904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:51.326003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:51.326948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 505/1012] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:51.331930 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b307438-0a69-47e1-b42e-7d5945114f2a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:51.334928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 508/1013] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:03:51 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:03:51.449550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b307438-0a69-47e1-b42e-7d5945114f2a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:51.496206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767c83a-72a7-44e8-8a90-817d3b79e3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:51.496810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767c83a-72a7-44e8-8a90-817d3b79e3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:51.497082 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767c83a-72a7-44e8-8a90-817d3b79e3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:51.497381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767c83a-72a7-44e8-8a90-817d3b79e3e8 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:51.498001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767c83a-72a7-44e8-8a90-817d3b79e3e8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:51.498295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767c83a-72a7-44e8-8a90-817d3b79e3e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:51.499715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767c83a-72a7-44e8-8a90-817d3b79e3e8 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:51.505083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 506/1014] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 31 00:03:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:51.510671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c94b9-bd4b-4854-9897-72222091d97c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:51.538603 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:51.611938 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a0bc7-590f-40e1-aeb0-1839a2bdff92 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:51.612545 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a0bc7-590f-40e1-aeb0-1839a2bdff92 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:51.612821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a0bc7-590f-40e1-aeb0-1839a2bdff92 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:51.614860 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 507/1015] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:51.618820 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c94b9-bd4b-4854-9897-72222091d97c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:51.620674 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315b90f-0c26-4570-87d3-ae36ac649418 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:51.620961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315b90f-0c26-4570-87d3-ae36ac649418 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:51.622092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315b90f-0c26-4570-87d3-ae36ac649418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:51.642095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a315b90f-0c26-4570-87d3-ae36ac649418 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:51.643319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a315b90f-0c26-4570-87d3-ae36ac649418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:51.656013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fc68a-79fe-4c14-841a-c1a28e5afb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:51.656630 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fc68a-79fe-4c14-841a-c1a28e5afb5a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:51.656906 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fc68a-79fe-4c14-841a-c1a28e5afb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:51.657177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fc68a-79fe-4c14-841a-c1a28e5afb5a None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:51.657835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fc68a-79fe-4c14-841a-c1a28e5afb5a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:51.658135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fc68a-79fe-4c14-841a-c1a28e5afb5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:51.659488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fc68a-79fe-4c14-841a-c1a28e5afb5a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:51.664118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:51.665709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 509/1016] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 31 00:03:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:51.671017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fc68a-79fe-4c14-841a-c1a28e5afb5a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:51.719872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 508/1017] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:51 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:51.769795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:51.783575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fc68a-79fe-4c14-841a-c1a28e5afb5a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:51.818795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f4177-4c63-4203-8a57-8f736573e8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:51.819783 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f4177-4c63-4203-8a57-8f736573e8f9 None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:51.820283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f4177-4c63-4203-8a57-8f736573e8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:51.820744 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f4177-4c63-4203-8a57-8f736573e8f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:51.821642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f4177-4c63-4203-8a57-8f736573e8f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:51.823225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f4177-4c63-4203-8a57-8f736573e8f9 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:51.845353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 510/1018] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:03:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:03:51.986921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315b90f-0c26-4570-87d3-ae36ac649418 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:52.095692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315b90f-0c26-4570-87d3-ae36ac649418 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:52.139115 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cf76e-d0ee-468e-84bc-0ddb1c8f6477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:52.139768 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf76e-d0ee-468e-84bc-0ddb1c8f6477 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:52.140044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf76e-d0ee-468e-84bc-0ddb1c8f6477 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:52.140319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf76e-d0ee-468e-84bc-0ddb1c8f6477 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:52.141456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cf76e-d0ee-468e-84bc-0ddb1c8f6477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:52.142883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cf76e-d0ee-468e-84bc-0ddb1c8f6477 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:52.144697 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 509/1019] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:52.150626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f4177-4c63-4203-8a57-8f736573e8f9 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:52.261282 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f4177-4c63-4203-8a57-8f736573e8f9 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:52.298224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3dd17-97bf-4093-a294-60ebfe29ccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:52.298833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3dd17-97bf-4093-a294-60ebfe29ccde None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:52.299093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3dd17-97bf-4093-a294-60ebfe29ccde None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:52.299379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3dd17-97bf-4093-a294-60ebfe29ccde None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:52.300151 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3dd17-97bf-4093-a294-60ebfe29ccde None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:52.302091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3dd17-97bf-4093-a294-60ebfe29ccde None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:52.322032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:52.341243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 511/1020] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:03:52 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:03:53.266487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de1a83-0fc3-4e8f-8cf7-e50e66f3588c None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:53.267026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de1a83-0fc3-4e8f-8cf7-e50e66f3588c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:53.267026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de1a83-0fc3-4e8f-8cf7-e50e66f3588c None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:53.268547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 510/1021] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:53.273614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2912fa-19e3-41f1-aa4e-64f5ca4e1ea0 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:53.274041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2912fa-19e3-41f1-aa4e-64f5ca4e1ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:53.274134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2912fa-19e3-41f1-aa4e-64f5ca4e1ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:53.294206 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-0c2912fa-19e3-41f1-aa4e-64f5ca4e1ea0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:53.295386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0c2912fa-19e3-41f1-aa4e-64f5ca4e1ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:53.364760 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 512/1022] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:53.626840 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de1a83-0fc3-4e8f-8cf7-e50e66f3588c None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:53.647927 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:53.737855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de1a83-0fc3-4e8f-8cf7-e50e66f3588c None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:53.774497 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28381821-e91e-4cf9-a856-f43321bf7658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:53.775124 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28381821-e91e-4cf9-a856-f43321bf7658 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:53.775472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28381821-e91e-4cf9-a856-f43321bf7658 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:53.775738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28381821-e91e-4cf9-a856-f43321bf7658 None admin] PATH_INFO: `/v3/services/image` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:53.776360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28381821-e91e-4cf9-a856-f43321bf7658 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:53.777813 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28381821-e91e-4cf9-a856-f43321bf7658 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-28381821-e91e-4cf9-a856-f43321bf7658 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:53.787381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:53.788381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:53.790321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 511/1023] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Aug 31 00:03:53 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:53.794680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2912fa-19e3-41f1-aa4e-64f5ca4e1ea0 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:53.895898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc75d6-12b2-4a9a-af33-a11c09a106de None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:53.896641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc75d6-12b2-4a9a-af33-a11c09a106de None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:53.897087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc75d6-12b2-4a9a-af33-a11c09a106de None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:53.898586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 512/1024] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:53.899254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2912fa-19e3-41f1-aa4e-64f5ca4e1ea0 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:53.904243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449d6a9-35ca-4443-8f78-ee7763737691 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:53.904511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449d6a9-35ca-4443-8f78-ee7763737691 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:53.904772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449d6a9-35ca-4443-8f78-ee7763737691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:53.924426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-b449d6a9-35ca-4443-8f78-ee7763737691 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:53.925659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b449d6a9-35ca-4443-8f78-ee7763737691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:53.929529 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:53.939675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035cd15-4fb6-4472-824d-ae948c0573ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:53.940286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035cd15-4fb6-4472-824d-ae948c0573ec None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:53.940564 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035cd15-4fb6-4472-824d-ae948c0573ec None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:53.940833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035cd15-4fb6-4472-824d-ae948c0573ec None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:53.941580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035cd15-4fb6-4472-824d-ae948c0573ec None admin] RBAC: Adding query filter params (name=image) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:53.942016 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035cd15-4fb6-4472-824d-ae948c0573ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:53.943677 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035cd15-4fb6-4472-824d-ae948c0573ec None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:53.953637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 513/1025] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:53.955190 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035cd15-4fb6-4472-824d-ae948c0573ec None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:53.999713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 513/1026] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:54.073813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035cd15-4fb6-4472-824d-ae948c0573ec None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:54.115785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986332a-b323-46a9-a275-234fb62c5ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:54.116394 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986332a-b323-46a9-a275-234fb62c5ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:54.116667 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986332a-b323-46a9-a275-234fb62c5ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:54.116936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986332a-b323-46a9-a275-234fb62c5ca0 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:54.117673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986332a-b323-46a9-a275-234fb62c5ca0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:54.117970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986332a-b323-46a9-a275-234fb62c5ca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:54.119312 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986332a-b323-46a9-a275-234fb62c5ca0 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:54.129110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 514/1027] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:54.130312 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449d6a9-35ca-4443-8f78-ee7763737691 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:54.146720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:54.238979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449d6a9-35ca-4443-8f78-ee7763737691 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:54.267095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986332a-b323-46a9-a275-234fb62c5ca0 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:54.275302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c802f9f-311d-4c99-8627-1f6b58f0b1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:54.276544 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c802f9f-311d-4c99-8627-1f6b58f0b1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:54.277039 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c802f9f-311d-4c99-8627-1f6b58f0b1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:54.277315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c802f9f-311d-4c99-8627-1f6b58f0b1e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:54.278017 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c802f9f-311d-4c99-8627-1f6b58f0b1e3 None admin] RBAC: Adding query filter params (interface=public, service_id=d0fc4c688b9c4d9cb867c0e832110135, region_id=RegionOne) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:54.278321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c802f9f-311d-4c99-8627-1f6b58f0b1e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:54.280000 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c802f9f-311d-4c99-8627-1f6b58f0b1e3 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:54.285598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 514/1028] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 31 00:03:54 2022] GET /identity/v3/endpoints?service_id=d0fc4c688b9c4d9cb867c0e832110135&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:54.291358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c802f9f-311d-4c99-8627-1f6b58f0b1e3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:54.330752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:54.375740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:54.376999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986332a-b323-46a9-a275-234fb62c5ca0 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:54.398799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c802f9f-311d-4c99-8627-1f6b58f0b1e3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:54.412607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadcca1-5415-43e4-a152-d6c87b555d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:54.413230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadcca1-5415-43e4-a152-d6c87b555d78 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:54.413507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadcca1-5415-43e4-a152-d6c87b555d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:54.413768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadcca1-5415-43e4-a152-d6c87b555d78 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:54.424389 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadcca1-5415-43e4-a152-d6c87b555d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-bdadcca1-5415-43e4-a152-d6c87b555d78 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:54.429461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:54.430393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:54.431232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:54.431232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:54.431232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:54.431232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:54.431232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:54.431232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:54.431232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:54.431232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:54.431232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:54.431232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:54.431232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:03:54.431232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:54.431232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 515/1029] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 31 00:03:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:54.432293 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99105b0b-514e-4ccf-b43c-c003e8e8ddcc None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:54.432534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99105b0b-514e-4ccf-b43c-c003e8e8ddcc None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:54.432776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99105b0b-514e-4ccf-b43c-c003e8e8ddcc None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:54.434093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 516/1030] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:54.436036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7ccb5-a804-43bb-be38-e10a29438565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:54.436434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99105b0b-514e-4ccf-b43c-c003e8e8ddcc None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:54.436847 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7ccb5-a804-43bb-be38-e10a29438565 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:54.437117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7ccb5-a804-43bb-be38-e10a29438565 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:54.437416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7ccb5-a804-43bb-be38-e10a29438565 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:54.438011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7ccb5-a804-43bb-be38-e10a29438565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:54.439597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7ccb5-a804-43bb-be38-e10a29438565 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:54.447348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 515/1031] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 31 00:03:54 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:03:54.447571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110d7d7-c2ac-4342-9828-c4d3765e0e63 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:54.447846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110d7d7-c2ac-4342-9828-c4d3765e0e63 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:54.448107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110d7d7-c2ac-4342-9828-c4d3765e0e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:54.474528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-0110d7d7-c2ac-4342-9828-c4d3765e0e63 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:54.476329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0110d7d7-c2ac-4342-9828-c4d3765e0e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:54.551325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 516/1032] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:54.553704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99105b0b-514e-4ccf-b43c-c003e8e8ddcc None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:54.574086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:54.596889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83511caf-c242-4658-b2fc-3dd908bd2310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:54.597630 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83511caf-c242-4658-b2fc-3dd908bd2310 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:54.598043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83511caf-c242-4658-b2fc-3dd908bd2310 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:54.598329 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83511caf-c242-4658-b2fc-3dd908bd2310 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:54.598995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83511caf-c242-4658-b2fc-3dd908bd2310 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:54.599288 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83511caf-c242-4658-b2fc-3dd908bd2310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:54.600660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83511caf-c242-4658-b2fc-3dd908bd2310 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:54.610368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 517/1033] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 31 00:03:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:54.616543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110d7d7-c2ac-4342-9828-c4d3765e0e63 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:54.687221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:54.719385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110d7d7-c2ac-4342-9828-c4d3765e0e63 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:54.752957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6accd74-d720-48be-bcb0-ef472cf04a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:54.753606 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6accd74-d720-48be-bcb0-ef472cf04a72 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:54.753902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6accd74-d720-48be-bcb0-ef472cf04a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:54.754167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6accd74-d720-48be-bcb0-ef472cf04a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:54.764237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6accd74-d720-48be-bcb0-ef472cf04a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:54.765703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6accd74-d720-48be-bcb0-ef472cf04a72 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-f6accd74-d720-48be-bcb0-ef472cf04a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:54.780516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:54.781543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:54.782491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:54.782491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:54.782491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:54.785327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 517/1034] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:54.787770 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83511caf-c242-4658-b2fc-3dd908bd2310 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:54.824206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6accd74-d720-48be-bcb0-ef472cf04a72 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:54.899279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83511caf-c242-4658-b2fc-3dd908bd2310 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:54.934636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446cc63-f7a8-45e2-a906-269e858acff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:54.935276 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446cc63-f7a8-45e2-a906-269e858acff8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:54.935551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446cc63-f7a8-45e2-a906-269e858acff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:54.936057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446cc63-f7a8-45e2-a906-269e858acff8 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:54.936449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446cc63-f7a8-45e2-a906-269e858acff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:54.936751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446cc63-f7a8-45e2-a906-269e858acff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:54.938193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446cc63-f7a8-45e2-a906-269e858acff8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:54.939067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6accd74-d720-48be-bcb0-ef472cf04a72 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:54.951514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 518/1035] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:54.957245 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446cc63-f7a8-45e2-a906-269e858acff8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:54.966296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:54.981102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d1e45-4870-4608-8e76-b2e957bffd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:54.981774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d1e45-4870-4608-8e76-b2e957bffd0f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:54.982059 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d1e45-4870-4608-8e76-b2e957bffd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:54.982316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d1e45-4870-4608-8e76-b2e957bffd0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:54.983418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d1e45-4870-4608-8e76-b2e957bffd0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:54.984860 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d1e45-4870-4608-8e76-b2e957bffd0f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:54.989548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 518/1036] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:54.992636 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d1e45-4870-4608-8e76-b2e957bffd0f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:54.998343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:55.065912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446cc63-f7a8-45e2-a906-269e858acff8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:55.106322 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d1e45-4870-4608-8e76-b2e957bffd0f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:55.106517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c890e-1975-406b-9682-6855bd9acd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:55.106995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c890e-1975-406b-9682-6855bd9acd4c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:55.107266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c890e-1975-406b-9682-6855bd9acd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:55.107526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c890e-1975-406b-9682-6855bd9acd4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:55.115960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c890e-1975-406b-9682-6855bd9acd4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:55.117500 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c890e-1975-406b-9682-6855bd9acd4c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-7e0c890e-1975-406b-9682-6855bd9acd4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:55.129328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:55.135107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:55.136232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:55.136232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:55.136232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:55.136232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:55.136232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:55.136232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:55.136232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:55.136232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:55.136232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:55.136232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:55.136232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 519/1037] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 31 00:03:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:55.136232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c890e-1975-406b-9682-6855bd9acd4c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:55.148592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34607ac8-e0c3-4bc3-b6e7-c28f6ca8da9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:55.150031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607ac8-e0c3-4bc3-b6e7-c28f6ca8da9a None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:55.150476 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607ac8-e0c3-4bc3-b6e7-c28f6ca8da9a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:55.150891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607ac8-e0c3-4bc3-b6e7-c28f6ca8da9a None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:55.151844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34607ac8-e0c3-4bc3-b6e7-c28f6ca8da9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:55.154396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34607ac8-e0c3-4bc3-b6e7-c28f6ca8da9a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:55.182359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 519/1038] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:03:54 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:03:55.236484 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:55.244385 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c890e-1975-406b-9682-6855bd9acd4c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:55.281185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906d2f3-8f78-4b78-98e2-cbf6fff52ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:55.281829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906d2f3-8f78-4b78-98e2-cbf6fff52ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:55.282106 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906d2f3-8f78-4b78-98e2-cbf6fff52ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:55.282374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906d2f3-8f78-4b78-98e2-cbf6fff52ae8 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:55.283110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906d2f3-8f78-4b78-98e2-cbf6fff52ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:55.283413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906d2f3-8f78-4b78-98e2-cbf6fff52ae8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:55.284843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906d2f3-8f78-4b78-98e2-cbf6fff52ae8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:55.305262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 520/1039] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 31 00:03:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:55.311118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34607ac8-e0c3-4bc3-b6e7-c28f6ca8da9a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:55.364509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:55.423084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34607ac8-e0c3-4bc3-b6e7-c28f6ca8da9a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:55.458255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d955d-f93b-491c-b22c-48a1e3413fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:55.459148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d955d-f93b-491c-b22c-48a1e3413fca None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:55.459598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d955d-f93b-491c-b22c-48a1e3413fca None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:55.460002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d955d-f93b-491c-b22c-48a1e3413fca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:55.533834 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d955d-f93b-491c-b22c-48a1e3413fca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:55.535687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d955d-f93b-491c-b22c-48a1e3413fca None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:55.583649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:55.642942 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 520/1040] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:55 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:03:55.648786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906d2f3-8f78-4b78-98e2-cbf6fff52ae8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:55.755007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906d2f3-8f78-4b78-98e2-cbf6fff52ae8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:55.791559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7277b-4635-427d-b947-2903403a4265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:55.792103 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7277b-4635-427d-b947-2903403a4265 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:55.792382 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7277b-4635-427d-b947-2903403a4265 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:55.792639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7277b-4635-427d-b947-2903403a4265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:55.803298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7277b-4635-427d-b947-2903403a4265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:55.804754 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7277b-4635-427d-b947-2903403a4265 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-a6d7277b-4635-427d-b947-2903403a4265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:55.819771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:55.820781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:55.821723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:55.821723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:55.821723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:55.821723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 521/1041] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:55.826730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d955d-f93b-491c-b22c-48a1e3413fca None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:55.930422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d955d-f93b-491c-b22c-48a1e3413fca None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:55.974862 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641f237-3bee-4724-9f5a-11d176695cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:55.975475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641f237-3bee-4724-9f5a-11d176695cfc None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:55.975747 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641f237-3bee-4724-9f5a-11d176695cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:55.976074 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641f237-3bee-4724-9f5a-11d176695cfc None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:55.976731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641f237-3bee-4724-9f5a-11d176695cfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:55.977031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641f237-3bee-4724-9f5a-11d176695cfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:55.978431 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641f237-3bee-4724-9f5a-11d176695cfc None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:55.990461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 521/1042] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:55.996074 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7277b-4635-427d-b947-2903403a4265 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:56.008814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:56.103047 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7277b-4635-427d-b947-2903403a4265 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:56.137820 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0b2bd-67cf-4728-a2d9-aa1b3564a172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:56.138443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0b2bd-67cf-4728-a2d9-aa1b3564a172 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:56.138676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0b2bd-67cf-4728-a2d9-aa1b3564a172 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:56.138969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0b2bd-67cf-4728-a2d9-aa1b3564a172 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:56.146118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0b2bd-67cf-4728-a2d9-aa1b3564a172 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:56.147542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0b2bd-67cf-4728-a2d9-aa1b3564a172 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-d5f0b2bd-67cf-4728-a2d9-aa1b3564a172 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:03:56.159024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:56.159930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:56.161118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:03:56.161118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:03:56.161118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:03:56.161118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:03:56.161118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:03:56.161118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:03:56.161118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:03:56.161118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:56.161118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 522/1043] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:03:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:56.168009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641f237-3bee-4724-9f5a-11d176695cfc None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:56.178665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:56.286070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641f237-3bee-4724-9f5a-11d176695cfc None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:56.323069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce0745-e050-4f77-8edc-5e2d79a1274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:56.323748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce0745-e050-4f77-8edc-5e2d79a1274c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:56.323981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce0745-e050-4f77-8edc-5e2d79a1274c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:56.324185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce0745-e050-4f77-8edc-5e2d79a1274c None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:56.324886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce0745-e050-4f77-8edc-5e2d79a1274c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:56.325186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce0745-e050-4f77-8edc-5e2d79a1274c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:56.326700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce0745-e050-4f77-8edc-5e2d79a1274c None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:56.339280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 522/1044] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:56.345474 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0b2bd-67cf-4728-a2d9-aa1b3564a172 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:56.353247 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1162e8b-c06a-4756-a168-b2bd4acc997e None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:56.353606 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1162e8b-c06a-4756-a168-b2bd4acc997e None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:56.353807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1162e8b-c06a-4756-a168-b2bd4acc997e None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:56.355592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 523/1045] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:03:56.361027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b423b4-75a2-4da4-99aa-8892aeda7853 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:56.361340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b423b4-75a2-4da4-99aa-8892aeda7853 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:56.361625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b423b4-75a2-4da4-99aa-8892aeda7853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:56.380503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d6b423b4-75a2-4da4-99aa-8892aeda7853 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:56.381968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d6b423b4-75a2-4da4-99aa-8892aeda7853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:56.415518 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:56.450411 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:56.455025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0b2bd-67cf-4728-a2d9-aa1b3564a172 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:56.459486 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 524/1046] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:03:56.491460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e30ab4-fb64-4f7f-9189-d6702aac9773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:56.492066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e30ab4-fb64-4f7f-9189-d6702aac9773 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:56.492341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e30ab4-fb64-4f7f-9189-d6702aac9773 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:56.492609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e30ab4-fb64-4f7f-9189-d6702aac9773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:56.493360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e30ab4-fb64-4f7f-9189-d6702aac9773 None admin] RBAC: Adding query filter params (role.id=f11bf727fddc4d8ea38916144f32515d, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=2016ed84211d412481d512eae23d2ab6) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:56.493673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e30ab4-fb64-4f7f-9189-d6702aac9773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:56.495084 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e30ab4-fb64-4f7f-9189-d6702aac9773 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:56.500808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 523/1047] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:56 2022] GET /identity/v3/role_assignments?user.id=2016ed84211d412481d512eae23d2ab6&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=f11bf727fddc4d8ea38916144f32515d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:56.725150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b423b4-75a2-4da4-99aa-8892aeda7853 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:56.832158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b423b4-75a2-4da4-99aa-8892aeda7853 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:56.868672 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342262d-5288-46d3-83c3-c2c2856aede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:56.869335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342262d-5288-46d3-83c3-c2c2856aede0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:56.869600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342262d-5288-46d3-83c3-c2c2856aede0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:56.869857 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342262d-5288-46d3-83c3-c2c2856aede0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:56.870446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342262d-5288-46d3-83c3-c2c2856aede0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:56.871806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342262d-5288-46d3-83c3-c2c2856aede0 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-7342262d-5288-46d3-83c3-c2c2856aede0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:56.881380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:56.882450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:03:56.883299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 525/1048] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Aug 31 00:03:56 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:56.890194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e30ab4-fb64-4f7f-9189-d6702aac9773 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:56.996305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e30ab4-fb64-4f7f-9189-d6702aac9773 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:57.024657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:57.031930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd885e47-7583-4278-a05b-70bcc39951f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:57.032539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd885e47-7583-4278-a05b-70bcc39951f1 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:57.032811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd885e47-7583-4278-a05b-70bcc39951f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:57.033076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd885e47-7583-4278-a05b-70bcc39951f1 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:57.033729 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd885e47-7583-4278-a05b-70bcc39951f1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:57.034020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd885e47-7583-4278-a05b-70bcc39951f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:57.035523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd885e47-7583-4278-a05b-70bcc39951f1 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:57.040707 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 524/1049] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:57.046551 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342262d-5288-46d3-83c3-c2c2856aede0 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:57.118580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:57.163293 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342262d-5288-46d3-83c3-c2c2856aede0 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:57.186127 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e222564-82d6-4b0f-925c-47c1bce5f39d None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:57.186418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e222564-82d6-4b0f-925c-47c1bce5f39d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:57.186679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e222564-82d6-4b0f-925c-47c1bce5f39d None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:57.188199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 525/1050] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:57.193611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef58373-d859-412e-b544-68eace1d92b1 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:57.193875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef58373-d859-412e-b544-68eace1d92b1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:57.194156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef58373-d859-412e-b544-68eace1d92b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:57.199839 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1902ecb-6dda-43c5-97a2-c21fdc27361a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:57.200444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1902ecb-6dda-43c5-97a2-c21fdc27361a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:57.200690 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1902ecb-6dda-43c5-97a2-c21fdc27361a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:57.200956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1902ecb-6dda-43c5-97a2-c21fdc27361a None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:57.201617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1902ecb-6dda-43c5-97a2-c21fdc27361a None admin] RBAC: Adding query filter params (type=image) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:57.201917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1902ecb-6dda-43c5-97a2-c21fdc27361a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:57.203271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1902ecb-6dda-43c5-97a2-c21fdc27361a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:57.209250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 526/1051] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:57.214083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1902ecb-6dda-43c5-97a2-c21fdc27361a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:57.214201 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-4ef58373-d859-412e-b544-68eace1d92b1 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:57.215279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-4ef58373-d859-412e-b544-68eace1d92b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:57.285794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 526/1052] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:57.322122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1902ecb-6dda-43c5-97a2-c21fdc27361a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:57.345296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:57.357766 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d28a0-ceac-4931-bf46-5825b01c717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:57.358361 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d28a0-ceac-4931-bf46-5825b01c717a None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:57.358631 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d28a0-ceac-4931-bf46-5825b01c717a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:57.358903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d28a0-ceac-4931-bf46-5825b01c717a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:57.359563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d28a0-ceac-4931-bf46-5825b01c717a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:57.360950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d28a0-ceac-4931-bf46-5825b01c717a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:57.383960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 527/1053] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:03:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:03:57.552065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef58373-d859-412e-b544-68eace1d92b1 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:57.655303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef58373-d859-412e-b544-68eace1d92b1 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:57.680424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:57.697723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf072a7-3bf1-4de4-a23f-1399bfaf4be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:57.698350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf072a7-3bf1-4de4-a23f-1399bfaf4be0 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:57.698616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf072a7-3bf1-4de4-a23f-1399bfaf4be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:57.698874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf072a7-3bf1-4de4-a23f-1399bfaf4be0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:57.709585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf072a7-3bf1-4de4-a23f-1399bfaf4be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-7bf072a7-3bf1-4de4-a23f-1399bfaf4be0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:57.714368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:57.715456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:57.716331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:57.716331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:57.716331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:57.716331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:57.716331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:57.716331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:57.716331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:57.716331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:57.716331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:57.716331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:57.716331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:03:57.716331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:57.716331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 527/1054] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:57.721619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d28a0-ceac-4931-bf46-5825b01c717a None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:57.826046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d28a0-ceac-4931-bf46-5825b01c717a None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:57.860528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996323c2-317e-4972-8e93-8917bda18401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:57.861131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996323c2-317e-4972-8e93-8917bda18401 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:57.861426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996323c2-317e-4972-8e93-8917bda18401 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:57.861687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996323c2-317e-4972-8e93-8917bda18401 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:57.862419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996323c2-317e-4972-8e93-8917bda18401 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:57.862746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996323c2-317e-4972-8e93-8917bda18401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:57.864229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996323c2-317e-4972-8e93-8917bda18401 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:57.876524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 528/1055] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:57.882784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf072a7-3bf1-4de4-a23f-1399bfaf4be0 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:57.988243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf072a7-3bf1-4de4-a23f-1399bfaf4be0 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:58.022527 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e183b88-34e8-4e4f-8583-3c2c9a93e892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:58.023154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e183b88-34e8-4e4f-8583-3c2c9a93e892 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:58.023421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e183b88-34e8-4e4f-8583-3c2c9a93e892 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:58.023685 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e183b88-34e8-4e4f-8583-3c2c9a93e892 None admin] PATH_INFO: `/v3/users/487503b7dbac4a96ad6d40e4cc8d9570` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:58.038085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e183b88-34e8-4e4f-8583-3c2c9a93e892 None admin] RBAC: Authorizing `identity:get_user(user_id=487503b7dbac4a96ad6d40e4cc8d9570)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:58.039511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e183b88-34e8-4e4f-8583-3c2c9a93e892 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:58.041345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 528/1056] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:03:57 2022] GET /identity/v3/users/487503b7dbac4a96ad6d40e4cc8d9570 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:58.047127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996323c2-317e-4972-8e93-8917bda18401 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:58.093029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:58.153917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996323c2-317e-4972-8e93-8917bda18401 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:58.187224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478345e-7dca-4e50-9b58-1756edb93e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:58.187821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478345e-7dca-4e50-9b58-1756edb93e8a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:58.188085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478345e-7dca-4e50-9b58-1756edb93e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:58.188347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478345e-7dca-4e50-9b58-1756edb93e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:58.256693 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478345e-7dca-4e50-9b58-1756edb93e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:58.258223 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478345e-7dca-4e50-9b58-1756edb93e8a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:58.310380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:58.371713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 529/1057] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:03:58.377182 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e183b88-34e8-4e4f-8583-3c2c9a93e892 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:58.382715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2526ae2-e003-4afd-8887-0a36dfed9f8b None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:58.383011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2526ae2-e003-4afd-8887-0a36dfed9f8b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:58.383288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2526ae2-e003-4afd-8887-0a36dfed9f8b None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:58.384771 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 530/1058] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:58.389639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af7233-9897-42f3-b8a2-a1ede0c05fbc None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:58.389911 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af7233-9897-42f3-b8a2-a1ede0c05fbc None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:58.390174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af7233-9897-42f3-b8a2-a1ede0c05fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:58.408704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d5af7233-9897-42f3-b8a2-a1ede0c05fbc None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:58.410034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d5af7233-9897-42f3-b8a2-a1ede0c05fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:58.423674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:58.480748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 531/1059] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:58.494987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e183b88-34e8-4e4f-8583-3c2c9a93e892 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:58.532592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150dd42-5847-469b-b0e5-8a2a6bbb6899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:58.533238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150dd42-5847-469b-b0e5-8a2a6bbb6899 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:58.533530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150dd42-5847-469b-b0e5-8a2a6bbb6899 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:58.533798 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150dd42-5847-469b-b0e5-8a2a6bbb6899 None admin] PATH_INFO: `/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:58.535022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150dd42-5847-469b-b0e5-8a2a6bbb6899 None admin] RBAC: Authorizing `identity:get_project(project_id=8efcb200d7b74faea2fb18fdcb4c855f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:58.536504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150dd42-5847-469b-b0e5-8a2a6bbb6899 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:58.538357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 529/1060] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:03:58 2022] GET /identity/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:58.544343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af7233-9897-42f3-b8a2-a1ede0c05fbc None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:58.618528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:58.648434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af7233-9897-42f3-b8a2-a1ede0c05fbc None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:58.683236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e00e87-ec5c-4f56-824c-d53028812209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:58.683836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e00e87-ec5c-4f56-824c-d53028812209 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:58.684108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e00e87-ec5c-4f56-824c-d53028812209 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:58.684377 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e00e87-ec5c-4f56-824c-d53028812209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:58.685095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e00e87-ec5c-4f56-824c-d53028812209 None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=8efcb200d7b74faea2fb18fdcb4c855f, user.id=487503b7dbac4a96ad6d40e4cc8d9570) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:58.685426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e00e87-ec5c-4f56-824c-d53028812209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:58.686863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e00e87-ec5c-4f56-824c-d53028812209 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:58.692649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 532/1061] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:03:58 2022] GET /identity/v3/role_assignments?user.id=487503b7dbac4a96ad6d40e4cc8d9570&scope.project.id=8efcb200d7b74faea2fb18fdcb4c855f&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:58.750610 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150dd42-5847-469b-b0e5-8a2a6bbb6899 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:58.860571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150dd42-5847-469b-b0e5-8a2a6bbb6899 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:58.868758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:58.898305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93215ed5-45e4-406c-8b3d-f4c518d687bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:58.899030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93215ed5-45e4-406c-8b3d-f4c518d687bb None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:58.899249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93215ed5-45e4-406c-8b3d-f4c518d687bb None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:58.899507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93215ed5-45e4-406c-8b3d-f4c518d687bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:58.911428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93215ed5-45e4-406c-8b3d-f4c518d687bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-93215ed5-45e4-406c-8b3d-f4c518d687bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:03:58.916283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:58.917266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:58.918138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:58.918138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:58.918138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:58.918138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:58.918138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:03:58.918138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:03:58.918138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:03:58.918138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:03:58.918138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:03:58.918138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:03:58.918138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:03:58.918138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:58.918138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 530/1062] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 31 00:03:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:58.924876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e00e87-ec5c-4f56-824c-d53028812209 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:59.040073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e00e87-ec5c-4f56-824c-d53028812209 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:59.076489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fa41c-3264-417e-9970-d6cad1ef00c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:59.077622 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fa41c-3264-417e-9970-d6cad1ef00c3 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:59.078115 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fa41c-3264-417e-9970-d6cad1ef00c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:59.078602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fa41c-3264-417e-9970-d6cad1ef00c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:59.079456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fa41c-3264-417e-9970-d6cad1ef00c3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:59.079949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fa41c-3264-417e-9970-d6cad1ef00c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:59.081670 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fa41c-3264-417e-9970-d6cad1ef00c3 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:59.085583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:59.099835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 533/1063] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 31 00:03:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:03:59.106497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93215ed5-45e4-406c-8b3d-f4c518d687bb None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:59.217608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93215ed5-45e4-406c-8b3d-f4c518d687bb None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:59.253390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f01621-0807-4d1c-a5b8-37f63e977206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:59.254469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f01621-0807-4d1c-a5b8-37f63e977206 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:59.254961 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f01621-0807-4d1c-a5b8-37f63e977206 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:59.255438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f01621-0807-4d1c-a5b8-37f63e977206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:59.266041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f01621-0807-4d1c-a5b8-37f63e977206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:59.267815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f01621-0807-4d1c-a5b8-37f63e977206 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-52f01621-0807-4d1c-a5b8-37f63e977206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:03:59.284542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:59.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:03:59.286749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:03:59.286749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:03:59.286749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:59.288843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 531/1064] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:03:59.294948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fa41c-3264-417e-9970-d6cad1ef00c3 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:59.330722 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf246cac-b462-44ff-8d80-0bfd4d1b808c None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:59.331078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf246cac-b462-44ff-8d80-0bfd4d1b808c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:59.331384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf246cac-b462-44ff-8d80-0bfd4d1b808c None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:59.332803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 532/1065] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:03:59.338111 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65762fa2-aa9e-40db-9c98-09adefeb7001 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:59.338388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65762fa2-aa9e-40db-9c98-09adefeb7001 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:59.338656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65762fa2-aa9e-40db-9c98-09adefeb7001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:59.360857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-65762fa2-aa9e-40db-9c98-09adefeb7001 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:03:59.362246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-65762fa2-aa9e-40db-9c98-09adefeb7001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:03:59.381675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:59.419880 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fa41c-3264-417e-9970-d6cad1ef00c3 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:59.446314 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 533/1066] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:03:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:03:59.456806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128123d-dfd0-4999-9912-f7d0130a4efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:59.457511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128123d-dfd0-4999-9912-f7d0130a4efe None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:59.457787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128123d-dfd0-4999-9912-f7d0130a4efe None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:59.458053 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128123d-dfd0-4999-9912-f7d0130a4efe None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:59.458696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128123d-dfd0-4999-9912-f7d0130a4efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:59.458995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128123d-dfd0-4999-9912-f7d0130a4efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:59.460355 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128123d-dfd0-4999-9912-f7d0130a4efe None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:59.476658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 534/1067] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:59.477930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65762fa2-aa9e-40db-9c98-09adefeb7001 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:59.580142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65762fa2-aa9e-40db-9c98-09adefeb7001 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:59.614973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6640c58-b7c1-418d-8304-3969af795643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:59.615609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6640c58-b7c1-418d-8304-3969af795643 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:59.615884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6640c58-b7c1-418d-8304-3969af795643 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:59.616145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6640c58-b7c1-418d-8304-3969af795643 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:59.623305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6640c58-b7c1-418d-8304-3969af795643 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:59.624727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6640c58-b7c1-418d-8304-3969af795643 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-e6640c58-b7c1-418d-8304-3969af795643 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:03:59.636646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:03:59.637882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:03:59.638826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:03:59.638826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:03:59.638826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:03:59.638826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:03:59.638826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:03:59.638826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:03:59.638826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:03:59.638826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:03:59.638826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:03:59.638826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:03:59.638826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 534/1068] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 31 00:03:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:03:59.643501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128123d-dfd0-4999-9912-f7d0130a4efe None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:59.705073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:59.723485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6640c58-b7c1-418d-8304-3969af795643 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:59.735024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:59.752832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128123d-dfd0-4999-9912-f7d0130a4efe None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:59.792526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca9a8b-da86-40bc-a533-6f20abca99d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:59.793139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca9a8b-da86-40bc-a533-6f20abca99d6 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:59.793464 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca9a8b-da86-40bc-a533-6f20abca99d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:59.793742 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca9a8b-da86-40bc-a533-6f20abca99d6 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:59.794481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca9a8b-da86-40bc-a533-6f20abca99d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:03:59.794785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca9a8b-da86-40bc-a533-6f20abca99d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:59.796224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca9a8b-da86-40bc-a533-6f20abca99d6 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:59.817038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 535/1069] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 31 00:03:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:03:59.822432 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca9a8b-da86-40bc-a533-6f20abca99d6 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:03:59.831143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6640c58-b7c1-418d-8304-3969af795643 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:59.867705 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f550cb-9d92-47cc-87d1-2f632f3e9c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:59.868459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f550cb-9d92-47cc-87d1-2f632f3e9c71 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:59.868737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f550cb-9d92-47cc-87d1-2f632f3e9c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:59.869000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f550cb-9d92-47cc-87d1-2f632f3e9c71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:59.927299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca9a8b-da86-40bc-a533-6f20abca99d6 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:03:59.939339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f550cb-9d92-47cc-87d1-2f632f3e9c71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:59.940765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f550cb-9d92-47cc-87d1-2f632f3e9c71 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:03:59.944141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:59.951892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:03:59.964445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e877c-dd8b-4713-af52-4af7b0b789df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:03:59.965074 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e877c-dd8b-4713-af52-4af7b0b789df None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:03:59.965375 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e877c-dd8b-4713-af52-4af7b0b789df None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:03:59.965644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e877c-dd8b-4713-af52-4af7b0b789df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:03:59.980361 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e877c-dd8b-4713-af52-4af7b0b789df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:03:59.981842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e877c-dd8b-4713-af52-4af7b0b789df None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-251e877c-dd8b-4713-af52-4af7b0b789df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:04:00.000767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:00.001945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:04:00.008044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:04:00.008044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:04:00.008044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:04:00.008044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 536/1070] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:04:00.008044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e877c-dd8b-4713-af52-4af7b0b789df None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:00.043991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 535/1071] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:03:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:04:00.049747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f550cb-9d92-47cc-87d1-2f632f3e9c71 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:00.120133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e877c-dd8b-4713-af52-4af7b0b789df None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:00.157504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d75ee-714d-4bae-9690-1044605847ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:00.158469 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d75ee-714d-4bae-9690-1044605847ad None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:00.158953 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d75ee-714d-4bae-9690-1044605847ad None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:00.159404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d75ee-714d-4bae-9690-1044605847ad None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:00.160525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d75ee-714d-4bae-9690-1044605847ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:00.161163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d75ee-714d-4bae-9690-1044605847ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:00.162718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d75ee-714d-4bae-9690-1044605847ad None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:00.163653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f550cb-9d92-47cc-87d1-2f632f3e9c71 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:00.174187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:00.178471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 537/1072] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:04:00.184221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d75ee-714d-4bae-9690-1044605847ad None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:00.203747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea0b4a-1640-404a-a638-89e9a1197f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:00.204381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea0b4a-1640-404a-a638-89e9a1197f76 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:00.204673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea0b4a-1640-404a-a638-89e9a1197f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:00.204935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea0b4a-1640-404a-a638-89e9a1197f76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:00.215748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea0b4a-1640-404a-a638-89e9a1197f76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:00.216440 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:00.217189 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea0b4a-1640-404a-a638-89e9a1197f76 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-10ea0b4a-1640-404a-a638-89e9a1197f76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:04:00.233874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:00.235069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:04:00.236198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:04:00.236198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:04:00.236198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:04:00.237605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 536/1073] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:04:00.243628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea0b4a-1640-404a-a638-89e9a1197f76 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:00.300770 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d75ee-714d-4bae-9690-1044605847ad None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:00.336886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c99ecb-e189-4161-83d5-1d2f003301f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:00.337551 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c99ecb-e189-4161-83d5-1d2f003301f2 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:00.337820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c99ecb-e189-4161-83d5-1d2f003301f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:00.338113 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c99ecb-e189-4161-83d5-1d2f003301f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:00.344836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c99ecb-e189-4161-83d5-1d2f003301f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:00.346297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c99ecb-e189-4161-83d5-1d2f003301f2 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-71c99ecb-e189-4161-83d5-1d2f003301f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:04:00.357739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:00.358725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:00.359619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:04:00.359619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:04:00.359619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:04:00.359619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:04:00.359619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:04:00.359619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:04:00.359619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:04:00.359619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:04:00.359619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 538/1074] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:04:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:04:00.364539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea0b4a-1640-404a-a638-89e9a1197f76 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:00.364670 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c99ecb-e189-4161-83d5-1d2f003301f2 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:00.400114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1dd27-206d-4bad-8fdd-173d8b1994ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:00.400725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1dd27-206d-4bad-8fdd-173d8b1994ec None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:00.401002 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1dd27-206d-4bad-8fdd-173d8b1994ec None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:00.401302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1dd27-206d-4bad-8fdd-173d8b1994ec None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:00.401941 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1dd27-206d-4bad-8fdd-173d8b1994ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:00.402241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1dd27-206d-4bad-8fdd-173d8b1994ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:00.403913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1dd27-206d-4bad-8fdd-173d8b1994ec None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:00.421247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 537/1075] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:00.470814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:00.489286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c99ecb-e189-4161-83d5-1d2f003301f2 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:00.527099 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe8fcf-2daf-4196-851c-41174af06646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:00.527727 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe8fcf-2daf-4196-851c-41174af06646 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:00.527999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe8fcf-2daf-4196-851c-41174af06646 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:00.528268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe8fcf-2daf-4196-851c-41174af06646 None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:00.529315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe8fcf-2daf-4196-851c-41174af06646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:00.529619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe8fcf-2daf-4196-851c-41174af06646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:00.531057 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe8fcf-2daf-4196-851c-41174af06646 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:00.544619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 539/1076] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:04:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:00.551320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1dd27-206d-4bad-8fdd-173d8b1994ec None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:00.574047 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:00.614691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aef047-d42d-4ef8-92de-3a4df08fd2b7 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:00.615006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aef047-d42d-4ef8-92de-3a4df08fd2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:00.615240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aef047-d42d-4ef8-92de-3a4df08fd2b7 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:00.616584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 540/1077] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:04:00.621804 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd7cbd-6664-4ab1-9d5b-83cbfb9782a8 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:00.622084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd7cbd-6664-4ab1-9d5b-83cbfb9782a8 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:00.622356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd7cbd-6664-4ab1-9d5b-83cbfb9782a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:00.642159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ddbd7cbd-6664-4ab1-9d5b-83cbfb9782a8 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:00.643340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ddbd7cbd-6664-4ab1-9d5b-83cbfb9782a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:00.669343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1dd27-206d-4bad-8fdd-173d8b1994ec None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:00.712406 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d4193-6f0b-4832-89a7-1d70a486a47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:00.716143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d4193-6f0b-4832-89a7-1d70a486a47f None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:00.716143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d4193-6f0b-4832-89a7-1d70a486a47f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:00.716143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d4193-6f0b-4832-89a7-1d70a486a47f None admin] PATH_INFO: `/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/2016ed84211d412481d512eae23d2ab6/roles/f11bf727fddc4d8ea38916144f32515d` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:00.719704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d4193-6f0b-4832-89a7-1d70a486a47f None admin] RBAC: Authorizing `identity:create_grant(project_id=204574e6a3c34ca4a7c266b5549bfdfa, user_id=2016ed84211d412481d512eae23d2ab6, role_id=f11bf727fddc4d8ea38916144f32515d)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:00.719844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 541/1078] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:04:00.719948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d4193-6f0b-4832-89a7-1d70a486a47f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:00.734154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 538/1079] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:04:00 2022] PUT /identity/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/2016ed84211d412481d512eae23d2ab6/roles/f11bf727fddc4d8ea38916144f32515d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:04:00.985818 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd7cbd-6664-4ab1-9d5b-83cbfb9782a8 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:01.065749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:01.087769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd7cbd-6664-4ab1-9d5b-83cbfb9782a8 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:01.125815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b26d2d-e734-45b0-89fa-bb29e051525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:01.126495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b26d2d-e734-45b0-89fa-bb29e051525c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:01.126766 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b26d2d-e734-45b0-89fa-bb29e051525c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:01.127026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b26d2d-e734-45b0-89fa-bb29e051525c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:01.137291 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b26d2d-e734-45b0-89fa-bb29e051525c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-92b26d2d-e734-45b0-89fa-bb29e051525c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:04:01.142007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:01.142957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:01.144025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:01.144025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:01.144025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:01.144025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:01.144025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:04:01.144025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:04:01.144025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:04:01.144025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:04:01.144025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:04:01.144025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:04:01.144025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:01.144025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:04:01.144025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 542/1080] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:04:01.149513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d4193-6f0b-4832-89a7-1d70a486a47f None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:01.236987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:01.259115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d4193-6f0b-4832-89a7-1d70a486a47f None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:01.293754 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de540433-6693-4fa7-a611-e1c845cf0090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:01.294360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de540433-6693-4fa7-a611-e1c845cf0090 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:01.294634 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de540433-6693-4fa7-a611-e1c845cf0090 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:01.294903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de540433-6693-4fa7-a611-e1c845cf0090 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:01.295557 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de540433-6693-4fa7-a611-e1c845cf0090 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:01.295854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de540433-6693-4fa7-a611-e1c845cf0090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:01.297243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de540433-6693-4fa7-a611-e1c845cf0090 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:01.305327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 539/1081] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:01.311918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b26d2d-e734-45b0-89fa-bb29e051525c None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:01.414675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b26d2d-e734-45b0-89fa-bb29e051525c None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:01.450513 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc26988-4ddf-456f-9a12-79a711489e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:01.451221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc26988-4ddf-456f-9a12-79a711489e1d None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:01.451448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc26988-4ddf-456f-9a12-79a711489e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:01.451715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc26988-4ddf-456f-9a12-79a711489e1d None admin] PATH_INFO: `/v3/users/487503b7dbac4a96ad6d40e4cc8d9570` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:01.452891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc26988-4ddf-456f-9a12-79a711489e1d None admin] RBAC: Authorizing `identity:get_user(user_id=487503b7dbac4a96ad6d40e4cc8d9570)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:01.454396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc26988-4ddf-456f-9a12-79a711489e1d None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:01.455999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 543/1082] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:01 2022] GET /identity/v3/users/487503b7dbac4a96ad6d40e4cc8d9570 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:01.462262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de540433-6693-4fa7-a611-e1c845cf0090 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:01.572454 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de540433-6693-4fa7-a611-e1c845cf0090 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:01.607162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62489c2d-affe-476d-b5f7-c9a2f27acee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:01.607790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62489c2d-affe-476d-b5f7-c9a2f27acee7 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:01.608062 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62489c2d-affe-476d-b5f7-c9a2f27acee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:01.608328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62489c2d-affe-476d-b5f7-c9a2f27acee7 None admin] PATH_INFO: `/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:01.609487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62489c2d-affe-476d-b5f7-c9a2f27acee7 None admin] RBAC: Authorizing `identity:get_project(project_id=8efcb200d7b74faea2fb18fdcb4c855f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:01.610903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62489c2d-affe-476d-b5f7-c9a2f27acee7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:01.612594 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 540/1083] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:04:01 2022] GET /identity/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:01.618880 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc26988-4ddf-456f-9a12-79a711489e1d None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:01.628002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:01.722680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc26988-4ddf-456f-9a12-79a711489e1d None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:01.758477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07240f-7118-4297-92ea-882a1efa13cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:01.759132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07240f-7118-4297-92ea-882a1efa13cf None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:01.759402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07240f-7118-4297-92ea-882a1efa13cf None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:01.759665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07240f-7118-4297-92ea-882a1efa13cf None admin] PATH_INFO: `/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f/users/487503b7dbac4a96ad6d40e4cc8d9570/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:01.761605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07240f-7118-4297-92ea-882a1efa13cf None admin] RBAC: Authorizing `identity:create_grant(project_id=8efcb200d7b74faea2fb18fdcb4c855f, user_id=487503b7dbac4a96ad6d40e4cc8d9570, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:01.763029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07240f-7118-4297-92ea-882a1efa13cf None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:01.777958 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 544/1084] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:04:01 2022] PUT /identity/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f/users/487503b7dbac4a96ad6d40e4cc8d9570/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:04:02.596014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b2258-c03b-40de-b6a3-529a3bfee004 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:02.596593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b2258-c03b-40de-b6a3-529a3bfee004 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:02.596593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b2258-c03b-40de-b6a3-529a3bfee004 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:02.597972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 541/1085] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:02.603584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e48c4a-2dc9-4c13-b0b0-d894582aedc6 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:02.603930 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e48c4a-2dc9-4c13-b0b0-d894582aedc6 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:02.604270 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e48c4a-2dc9-4c13-b0b0-d894582aedc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:02.623156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-06e48c4a-2dc9-4c13-b0b0-d894582aedc6 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:02.624321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-06e48c4a-2dc9-4c13-b0b0-d894582aedc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:02.685247 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:02.694482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 545/1086] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:04:02.958763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b2258-c03b-40de-b6a3-529a3bfee004 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:02.972010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:03.065015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b2258-c03b-40de-b6a3-529a3bfee004 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:03.107125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0931f9-fd7f-4d9a-8e5f-b73208b6983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:03.107766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0931f9-fd7f-4d9a-8e5f-b73208b6983d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:03.108037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0931f9-fd7f-4d9a-8e5f-b73208b6983d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:03.108300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0931f9-fd7f-4d9a-8e5f-b73208b6983d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:03.119942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0931f9-fd7f-4d9a-8e5f-b73208b6983d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-4d0931f9-fd7f-4d9a-8e5f-b73208b6983d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:04:03.124674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:03.125643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:03.126804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:03.126804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:03.126804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:03.126804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:03.126804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:04:03.126804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:04:03.126804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:04:03.126804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:04:03.126804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:04:03.126804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:04:03.126804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:04:03.126804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:04:03.126804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 542/1087] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 31 00:04:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:04:03.131997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e48c4a-2dc9-4c13-b0b0-d894582aedc6 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:03.236120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e48c4a-2dc9-4c13-b0b0-d894582aedc6 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:03.271359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc629e1-cdcf-4d7b-b190-70a91b9689fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:03.271981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc629e1-cdcf-4d7b-b190-70a91b9689fc None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:03.272254 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc629e1-cdcf-4d7b-b190-70a91b9689fc None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:03.272521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc629e1-cdcf-4d7b-b190-70a91b9689fc None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:03.273182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc629e1-cdcf-4d7b-b190-70a91b9689fc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:03.273504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc629e1-cdcf-4d7b-b190-70a91b9689fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:03.274869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc629e1-cdcf-4d7b-b190-70a91b9689fc None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:03.283560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 546/1088] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 31 00:04:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:03.289425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0931f9-fd7f-4d9a-8e5f-b73208b6983d None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:03.359009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:03.392617 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0931f9-fd7f-4d9a-8e5f-b73208b6983d None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:03.427313 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80231c7f-df8c-4a64-9d1e-941cfe875f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:03.427942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80231c7f-df8c-4a64-9d1e-941cfe875f3b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:03.428217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80231c7f-df8c-4a64-9d1e-941cfe875f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:03.428488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80231c7f-df8c-4a64-9d1e-941cfe875f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:03.439114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80231c7f-df8c-4a64-9d1e-941cfe875f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:03.440550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80231c7f-df8c-4a64-9d1e-941cfe875f3b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-80231c7f-df8c-4a64-9d1e-941cfe875f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:04:03.455052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:03.456017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:04:03.457369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:04:03.457369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:04:03.457369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:04:03.457369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 543/1089] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:04:03.462560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc629e1-cdcf-4d7b-b190-70a91b9689fc None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:03.528007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:03.570660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc629e1-cdcf-4d7b-b190-70a91b9689fc None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:03.604464 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e9f69-397a-4e70-b696-a994da15c8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:03.605052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e9f69-397a-4e70-b696-a994da15c8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:03.605368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e9f69-397a-4e70-b696-a994da15c8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:03.605630 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e9f69-397a-4e70-b696-a994da15c8f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:03.606263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e9f69-397a-4e70-b696-a994da15c8f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:03.606557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e9f69-397a-4e70-b696-a994da15c8f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:03.607905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e9f69-397a-4e70-b696-a994da15c8f8 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:03.619587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 547/1090] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:03.625465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80231c7f-df8c-4a64-9d1e-941cfe875f3b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:03.647730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede71e0-2c4c-42b4-8e86-7faf543dcecb None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:03.648265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede71e0-2c4c-42b4-8e86-7faf543dcecb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:03.648265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede71e0-2c4c-42b4-8e86-7faf543dcecb None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:03.649607 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 548/1091] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:04:03.654907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063bb93-7319-4a9a-878f-28914e80e278 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:03.655174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063bb93-7319-4a9a-878f-28914e80e278 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:03.655440 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063bb93-7319-4a9a-878f-28914e80e278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:03.673363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-7063bb93-7319-4a9a-878f-28914e80e278 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:03.674555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7063bb93-7319-4a9a-878f-28914e80e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:03.727849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80231c7f-df8c-4a64-9d1e-941cfe875f3b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:03.743573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 549/1092] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:04:03.750459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:03.762901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ca97c-69c9-4b40-88f3-6383b0fa62c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:03.763535 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ca97c-69c9-4b40-88f3-6383b0fa62c4 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:03.763809 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ca97c-69c9-4b40-88f3-6383b0fa62c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:03.764077 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ca97c-69c9-4b40-88f3-6383b0fa62c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:03.771826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ca97c-69c9-4b40-88f3-6383b0fa62c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:03.773273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ca97c-69c9-4b40-88f3-6383b0fa62c4 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-e98ca97c-69c9-4b40-88f3-6383b0fa62c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:04:03.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:03.785882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:03.786853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:03.786853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:03.786853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:04:03.786853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:04:03.786853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:04:03.786853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:04:03.786853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:04:03.786853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:04:03.786853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:04:03.786853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:04:03.786853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 544/1093] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 31 00:04:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:04:03.792091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063bb93-7319-4a9a-878f-28914e80e278 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:03.842037 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:03.894395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063bb93-7319-4a9a-878f-28914e80e278 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:03.929386 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a22d3e-daa4-407b-a712-088c2cf6e234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:03.929980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a22d3e-daa4-407b-a712-088c2cf6e234 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:03.930251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a22d3e-daa4-407b-a712-088c2cf6e234 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:03.930516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a22d3e-daa4-407b-a712-088c2cf6e234 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:03.931231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a22d3e-daa4-407b-a712-088c2cf6e234 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:03.931570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a22d3e-daa4-407b-a712-088c2cf6e234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:03.932985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a22d3e-daa4-407b-a712-088c2cf6e234 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:03.949928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 550/1094] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 31 00:04:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:03.955934 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ca97c-69c9-4b40-88f3-6383b0fa62c4 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:04.007881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a22d3e-daa4-407b-a712-088c2cf6e234 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:04.063167 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ca97c-69c9-4b40-88f3-6383b0fa62c4 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:04.099854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1c5db-3400-496a-937a-84509f4c13f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:04.100469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c5db-3400-496a-937a-84509f4c13f9 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:04.100749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c5db-3400-496a-937a-84509f4c13f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:04.101018 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c5db-3400-496a-937a-84509f4c13f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:04.109049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a22d3e-daa4-407b-a712-088c2cf6e234 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:04.116795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:04.145854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af259c-9c9c-457b-9210-74c212e2228f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:04.146481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af259c-9c9c-457b-9210-74c212e2228f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:04.146751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af259c-9c9c-457b-9210-74c212e2228f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:04.147012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af259c-9c9c-457b-9210-74c212e2228f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:04.152303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:04.159963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af259c-9c9c-457b-9210-74c212e2228f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-54af259c-9c9c-457b-9210-74c212e2228f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:04:04.164744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:04.165906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:04.166838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:04.166838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:04.166838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:04.166838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:04.166838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:04:04.166838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:04:04.166838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:04:04.166838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:04:04.166838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:04:04.166838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:04:04.166838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:04.166838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:04:04.166838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 551/1095] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:04:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:04:04.171893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af259c-9c9c-457b-9210-74c212e2228f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:04.175323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1c5db-3400-496a-937a-84509f4c13f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:04.176804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1c5db-3400-496a-937a-84509f4c13f9 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:04.273350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af259c-9c9c-457b-9210-74c212e2228f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:04.274829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 545/1096] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:04:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:04:04.280670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1c5db-3400-496a-937a-84509f4c13f9 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:04.308942 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b189d71-91e7-41c1-b747-a5dc425c3acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:04.310150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b189d71-91e7-41c1-b747-a5dc425c3acc None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:04.310544 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b189d71-91e7-41c1-b747-a5dc425c3acc None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:04.310920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b189d71-91e7-41c1-b747-a5dc425c3acc None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:04.311685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b189d71-91e7-41c1-b747-a5dc425c3acc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:04.312089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b189d71-91e7-41c1-b747-a5dc425c3acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:04.313835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b189d71-91e7-41c1-b747-a5dc425c3acc None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:04.322274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 552/1097] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:04:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:04.328187 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b189d71-91e7-41c1-b747-a5dc425c3acc None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:04.360356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:04.362114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:04.380613 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1c5db-3400-496a-937a-84509f4c13f9 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:04.416583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714d450-e90f-4908-bfdf-a6a9753ca919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:04.417188 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714d450-e90f-4908-bfdf-a6a9753ca919 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:04.417491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714d450-e90f-4908-bfdf-a6a9753ca919 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:04.417756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714d450-e90f-4908-bfdf-a6a9753ca919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:04.428767 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714d450-e90f-4908-bfdf-a6a9753ca919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:04.430325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714d450-e90f-4908-bfdf-a6a9753ca919 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:04.436194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b189d71-91e7-41c1-b747-a5dc425c3acc None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-c714d450-e90f-4908-bfdf-a6a9753ca919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:04:04.444962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:04.445951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:04:04.446935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:04:04.446935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:04:04.446935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:04:04.446935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 546/1098] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:04:04.451856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714d450-e90f-4908-bfdf-a6a9753ca919 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:04.471181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e575de-5aa2-415d-b72c-091ec9a223dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:04.471806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e575de-5aa2-415d-b72c-091ec9a223dd None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:04.472079 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e575de-5aa2-415d-b72c-091ec9a223dd None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:04.472537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e575de-5aa2-415d-b72c-091ec9a223dd None admin] PATH_INFO: `/v3/users/487503b7dbac4a96ad6d40e4cc8d9570` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:04.474070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e575de-5aa2-415d-b72c-091ec9a223dd None admin] RBAC: Authorizing `identity:get_user(user_id=487503b7dbac4a96ad6d40e4cc8d9570)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:04.475489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e575de-5aa2-415d-b72c-091ec9a223dd None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:04.481954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 553/1099] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:04 2022] GET /identity/v3/users/487503b7dbac4a96ad6d40e4cc8d9570 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:04.483091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e575de-5aa2-415d-b72c-091ec9a223dd None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:04.554091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714d450-e90f-4908-bfdf-a6a9753ca919 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:04.582596 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:04.587808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c75c6-ed98-45a8-8251-e0e604062d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:04.588413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c75c6-ed98-45a8-8251-e0e604062d9e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:04.588686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c75c6-ed98-45a8-8251-e0e604062d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:04.589031 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c75c6-ed98-45a8-8251-e0e604062d9e None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:04.589152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e575de-5aa2-415d-b72c-091ec9a223dd None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:04.589626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c75c6-ed98-45a8-8251-e0e604062d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:04.589922 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c75c6-ed98-45a8-8251-e0e604062d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:04.591269 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c75c6-ed98-45a8-8251-e0e604062d9e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:04.592726 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:04.604387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 547/1100] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:04:04.610159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c75c6-ed98-45a8-8251-e0e604062d9e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:04.624659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c053c-94c0-4783-b335-f5f7a9ff1775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:04.625301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c053c-94c0-4783-b335-f5f7a9ff1775 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:04.625577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c053c-94c0-4783-b335-f5f7a9ff1775 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:04.625847 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c053c-94c0-4783-b335-f5f7a9ff1775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:04.699348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c053c-94c0-4783-b335-f5f7a9ff1775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:04.700787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c053c-94c0-4783-b335-f5f7a9ff1775 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:04.722307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c75c6-ed98-45a8-8251-e0e604062d9e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:04.758755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348c047-b22a-4139-9454-29c29419f536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:04.759388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348c047-b22a-4139-9454-29c29419f536 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:04.759665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348c047-b22a-4139-9454-29c29419f536 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:04.759933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348c047-b22a-4139-9454-29c29419f536 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:04.766614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348c047-b22a-4139-9454-29c29419f536 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:04.768037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348c047-b22a-4139-9454-29c29419f536 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-3348c047-b22a-4139-9454-29c29419f536 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:04:04.779676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:04.780776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:04.781876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:04:04.781876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:04:04.781876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:04:04.781876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:04:04.781876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:04:04.781876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:04:04.781876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:04:04.781876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:04:04.781876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 548/1101] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:04:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:04:04.787021 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348c047-b22a-4139-9454-29c29419f536 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:04.804295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:04.813274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 554/1102] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:04:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:04:04.819604 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c053c-94c0-4783-b335-f5f7a9ff1775 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:04.850667 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:04.895705 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348c047-b22a-4139-9454-29c29419f536 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:04.916654 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c053c-94c0-4783-b335-f5f7a9ff1775 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:04.930272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e768cd-93cb-471c-b862-7fb6d4de46b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:04.931225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e768cd-93cb-471c-b862-7fb6d4de46b2 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:04.931645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e768cd-93cb-471c-b862-7fb6d4de46b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:04.931961 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e768cd-93cb-471c-b862-7fb6d4de46b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:04.932639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e768cd-93cb-471c-b862-7fb6d4de46b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:04.932940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e768cd-93cb-471c-b862-7fb6d4de46b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:04.934403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e768cd-93cb-471c-b862-7fb6d4de46b2 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:04.947642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 549/1103] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:04:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:04:04.950252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abc1c4-7d24-4763-9e8f-f26cd70310c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:04.951251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abc1c4-7d24-4763-9e8f-f26cd70310c9 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:04.951724 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abc1c4-7d24-4763-9e8f-f26cd70310c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:04.952191 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abc1c4-7d24-4763-9e8f-f26cd70310c9 None admin] PATH_INFO: `/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:04.954081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e768cd-93cb-471c-b862-7fb6d4de46b2 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:04.954186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abc1c4-7d24-4763-9e8f-f26cd70310c9 None admin] RBAC: Authorizing `identity:get_project(project_id=8efcb200d7b74faea2fb18fdcb4c855f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:04.956846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abc1c4-7d24-4763-9e8f-f26cd70310c9 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:04.964920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 555/1104] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:04:04 2022] GET /identity/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:04:04.966233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abc1c4-7d24-4763-9e8f-f26cd70310c9 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:05.029602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:05.056691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e768cd-93cb-471c-b862-7fb6d4de46b2 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:05.068772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abc1c4-7d24-4763-9e8f-f26cd70310c9 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:05.071110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:05.094435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6795d50-94c8-4025-9bba-334463737ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:05.095069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6795d50-94c8-4025-9bba-334463737ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:05.095353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6795d50-94c8-4025-9bba-334463737ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:05.095621 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6795d50-94c8-4025-9bba-334463737ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:05.096373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6795d50-94c8-4025-9bba-334463737ac3 None admin] RBAC: Adding query filter params (role.id=f11bf727fddc4d8ea38916144f32515d, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=2016ed84211d412481d512eae23d2ab6) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:05.096656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6795d50-94c8-4025-9bba-334463737ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:05.098254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6795d50-94c8-4025-9bba-334463737ac3 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:05.104419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 550/1105] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:04:04 2022] GET /identity/v3/role_assignments?user.id=2016ed84211d412481d512eae23d2ab6&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=f11bf727fddc4d8ea38916144f32515d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:04:05.111346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcb681-5aee-4ead-b62b-3e34ce965785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:05.111975 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcb681-5aee-4ead-b62b-3e34ce965785 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:05.112244 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcb681-5aee-4ead-b62b-3e34ce965785 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:05.112511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcb681-5aee-4ead-b62b-3e34ce965785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:05.113495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcb681-5aee-4ead-b62b-3e34ce965785 None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=8efcb200d7b74faea2fb18fdcb4c855f, user.id=487503b7dbac4a96ad6d40e4cc8d9570) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:05.113801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcb681-5aee-4ead-b62b-3e34ce965785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:05.115371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcb681-5aee-4ead-b62b-3e34ce965785 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:05.122203 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 556/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:04:04 2022] GET /identity/v3/role_assignments?user.id=487503b7dbac4a96ad6d40e4cc8d9570&scope.project.id=8efcb200d7b74faea2fb18fdcb4c855f&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:07.111341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c7734-7092-470e-9717-7f9ed5149250 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:07.112011 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c7734-7092-470e-9717-7f9ed5149250 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:07.112011 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c7734-7092-470e-9717-7f9ed5149250 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:07.113442 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 551/1107] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:07.118983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d393f-d1e8-4f20-8f57-2fc9924b0f69 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:07.119457 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d393f-d1e8-4f20-8f57-2fc9924b0f69 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:07.119557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d393f-d1e8-4f20-8f57-2fc9924b0f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:07.138874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-841d393f-d1e8-4f20-8f57-2fc9924b0f69 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:07.140057 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-841d393f-d1e8-4f20-8f57-2fc9924b0f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:07.221504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 557/1108] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:07.562389 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c7734-7092-470e-9717-7f9ed5149250 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:07.686724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c7734-7092-470e-9717-7f9ed5149250 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:07.723380 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad35a5-fcbd-42a5-9047-58a7f0bad9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:07.724407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad35a5-fcbd-42a5-9047-58a7f0bad9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:07.724866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad35a5-fcbd-42a5-9047-58a7f0bad9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:07.724866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad35a5-fcbd-42a5-9047-58a7f0bad9a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:07.726403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad35a5-fcbd-42a5-9047-58a7f0bad9a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:07.727824 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad35a5-fcbd-42a5-9047-58a7f0bad9a2 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:07.729425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 552/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:04:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:07.735480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d393f-d1e8-4f20-8f57-2fc9924b0f69 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:07.805924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:07.869148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d393f-d1e8-4f20-8f57-2fc9924b0f69 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:07.918833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f41fb-012c-4717-8157-0cff7bfef065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:07.919704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f41fb-012c-4717-8157-0cff7bfef065 None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:07.920111 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f41fb-012c-4717-8157-0cff7bfef065 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:07.920503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f41fb-012c-4717-8157-0cff7bfef065 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:07.921539 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f41fb-012c-4717-8157-0cff7bfef065 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:07.923773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f41fb-012c-4717-8157-0cff7bfef065 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:07.948925 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 558/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:04:07 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:04:10.056050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcabbf-d5f4-4b96-9ec7-f6302a34b07c None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:10.056941 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcabbf-d5f4-4b96-9ec7-f6302a34b07c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:10.056941 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcabbf-d5f4-4b96-9ec7-f6302a34b07c None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:10.059080 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 553/1111] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:10.064654 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947a46-dd15-4e36-b324-b428c4df4dd5 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:10.065119 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947a46-dd15-4e36-b324-b428c4df4dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:10.065309 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947a46-dd15-4e36-b324-b428c4df4dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:10.084270 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-20947a46-dd15-4e36-b324-b428c4df4dd5 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:10.085493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-20947a46-dd15-4e36-b324-b428c4df4dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:10.164555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 559/1112] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:04:10.448336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcabbf-d5f4-4b96-9ec7-f6302a34b07c None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:10.510068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:10.577558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcabbf-d5f4-4b96-9ec7-f6302a34b07c None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:10.626130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8acef-9909-4eb2-b0af-6e2440f28ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:10.626770 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8acef-9909-4eb2-b0af-6e2440f28ced None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:10.627050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8acef-9909-4eb2-b0af-6e2440f28ced None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:10.627317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8acef-9909-4eb2-b0af-6e2440f28ced None admin] PATH_INFO: `/v3/roles/b3796e568aa342a1b3318b04d23a9cc0` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:10.628869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8acef-9909-4eb2-b0af-6e2440f28ced None admin] RBAC: Authorizing `identity:get_role(role_id=b3796e568aa342a1b3318b04d23a9cc0)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:10.630271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8acef-9909-4eb2-b0af-6e2440f28ced None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:10.631624 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 554/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:10 2022] GET /identity/v3/roles/b3796e568aa342a1b3318b04d23a9cc0 => generated 223 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:10.638485 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20947a46-dd15-4e36-b324-b428c4df4dd5 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:10.704832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:10.766256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20947a46-dd15-4e36-b324-b428c4df4dd5 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:10.813392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb8185-fb8a-40c2-825b-5fa94dd263f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:10.814016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb8185-fb8a-40c2-825b-5fa94dd263f2 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:10.814288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb8185-fb8a-40c2-825b-5fa94dd263f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:10.814554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb8185-fb8a-40c2-825b-5fa94dd263f2 None admin] PATH_INFO: `/v3/users/a37e9f49a4b14138b0ac90a14bf143c6` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:10.829067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb8185-fb8a-40c2-825b-5fa94dd263f2 None admin] RBAC: Authorizing `identity:get_user(user_id=a37e9f49a4b14138b0ac90a14bf143c6)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:10.830547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb8185-fb8a-40c2-825b-5fa94dd263f2 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:10.832597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 560/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:10 2022] GET /identity/v3/users/a37e9f49a4b14138b0ac90a14bf143c6 => generated 286 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:10.839026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8acef-9909-4eb2-b0af-6e2440f28ced None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:10.957668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8acef-9909-4eb2-b0af-6e2440f28ced None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:10.975992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:11.001482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f2f93-f836-438c-899e-f6c61f8000c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:11.002075 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f2f93-f836-438c-899e-f6c61f8000c3 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:11.002350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f2f93-f836-438c-899e-f6c61f8000c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:11.002615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f2f93-f836-438c-899e-f6c61f8000c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:11.073048 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f2f93-f836-438c-899e-f6c61f8000c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:11.074517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f2f93-f836-438c-899e-f6c61f8000c3 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:11.186773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 555/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:04:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:04:11.193418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb8185-fb8a-40c2-825b-5fa94dd263f2 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:11.306129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb8185-fb8a-40c2-825b-5fa94dd263f2 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:11.307660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:11.344717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6178f-03d9-4caa-92c3-f7a488f51f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:11.345369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6178f-03d9-4caa-92c3-f7a488f51f0a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:11.345642 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6178f-03d9-4caa-92c3-f7a488f51f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:11.345913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6178f-03d9-4caa-92c3-f7a488f51f0a None admin] PATH_INFO: `/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:11.347134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6178f-03d9-4caa-92c3-f7a488f51f0a None admin] RBAC: Authorizing `identity:get_project(project_id=8efcb200d7b74faea2fb18fdcb4c855f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:11.348565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6178f-03d9-4caa-92c3-f7a488f51f0a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:11.350229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 561/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:04:11 2022] GET /identity/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:11.360615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f2f93-f836-438c-899e-f6c61f8000c3 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:11.379225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:11.480875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f2f93-f836-438c-899e-f6c61f8000c3 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:11.522436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50f62a-6720-4384-8ea6-a289162174e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:11.523031 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50f62a-6720-4384-8ea6-a289162174e2 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:11.523305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50f62a-6720-4384-8ea6-a289162174e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:11.523570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50f62a-6720-4384-8ea6-a289162174e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:11.524281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50f62a-6720-4384-8ea6-a289162174e2 None admin] RBAC: Adding query filter params (role.id=b3796e568aa342a1b3318b04d23a9cc0, scope.project.id=8efcb200d7b74faea2fb18fdcb4c855f, user.id=a37e9f49a4b14138b0ac90a14bf143c6) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:11.524583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50f62a-6720-4384-8ea6-a289162174e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:11.526024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50f62a-6720-4384-8ea6-a289162174e2 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:11.532976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 556/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:04:11 2022] GET /identity/v3/role_assignments?user.id=a37e9f49a4b14138b0ac90a14bf143c6&scope.project.id=8efcb200d7b74faea2fb18fdcb4c855f&role.id=b3796e568aa342a1b3318b04d23a9cc0 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:13.479081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade0ea5-3770-4a98-8f9b-79d2832b4063 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:13.480019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade0ea5-3770-4a98-8f9b-79d2832b4063 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:13.480019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade0ea5-3770-4a98-8f9b-79d2832b4063 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:13.482055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 562/1118] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:13.487770 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cda6e-1329-45fa-adbd-57abd28f81ce None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:13.488262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cda6e-1329-45fa-adbd-57abd28f81ce None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:13.488368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cda6e-1329-45fa-adbd-57abd28f81ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:13.508875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-1d8cda6e-1329-45fa-adbd-57abd28f81ce None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:13.510065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1d8cda6e-1329-45fa-adbd-57abd28f81ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:13.579537 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 557/1119] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:13.865513 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade0ea5-3770-4a98-8f9b-79d2832b4063 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:13.990137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade0ea5-3770-4a98-8f9b-79d2832b4063 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:14.032850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e743f-d313-4613-a080-46cb3467dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:14.033494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e743f-d313-4613-a080-46cb3467dd48 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:14.033764 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e743f-d313-4613-a080-46cb3467dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:14.034026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e743f-d313-4613-a080-46cb3467dd48 None admin] PATH_INFO: `/v3/roles/b3796e568aa342a1b3318b04d23a9cc0` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:14.035537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e743f-d313-4613-a080-46cb3467dd48 None admin] RBAC: Authorizing `identity:get_role(role_id=b3796e568aa342a1b3318b04d23a9cc0)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:14.036914 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e743f-d313-4613-a080-46cb3467dd48 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:14.038291 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 563/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:13 2022] GET /identity/v3/roles/b3796e568aa342a1b3318b04d23a9cc0 => generated 223 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:14.047572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cda6e-1329-45fa-adbd-57abd28f81ce None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:14.059610 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:14.167793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cda6e-1329-45fa-adbd-57abd28f81ce None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:14.203977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c26205-eedf-4f21-873e-c3a088bf4feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:14.204601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c26205-eedf-4f21-873e-c3a088bf4feb None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:14.204872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c26205-eedf-4f21-873e-c3a088bf4feb None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:14.205142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c26205-eedf-4f21-873e-c3a088bf4feb None admin] PATH_INFO: `/v3/users/a37e9f49a4b14138b0ac90a14bf143c6` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:14.206603 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c26205-eedf-4f21-873e-c3a088bf4feb None admin] RBAC: Authorizing `identity:get_user(user_id=a37e9f49a4b14138b0ac90a14bf143c6)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:14.208212 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c26205-eedf-4f21-873e-c3a088bf4feb None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:14.209864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 558/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:14 2022] GET /identity/v3/users/a37e9f49a4b14138b0ac90a14bf143c6 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:14.216601 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e743f-d313-4613-a080-46cb3467dd48 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:14.272210 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:14.336112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e743f-d313-4613-a080-46cb3467dd48 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:14.385914 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9958a4-fa86-4dbd-b344-e9a865fabd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:14.386542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9958a4-fa86-4dbd-b344-e9a865fabd42 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:14.386809 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9958a4-fa86-4dbd-b344-e9a865fabd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:14.387073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9958a4-fa86-4dbd-b344-e9a865fabd42 None admin] PATH_INFO: `/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:14.388221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9958a4-fa86-4dbd-b344-e9a865fabd42 None admin] RBAC: Authorizing `identity:get_project(project_id=8efcb200d7b74faea2fb18fdcb4c855f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:14.389700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9958a4-fa86-4dbd-b344-e9a865fabd42 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:14.391371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 564/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:04:14 2022] GET /identity/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:14.400904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c26205-eedf-4f21-873e-c3a088bf4feb None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:14.487415 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:14.513185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c26205-eedf-4f21-873e-c3a088bf4feb None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:14.550185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccec0e5-10ab-4f09-834c-aeae1abb0814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:14.551000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccec0e5-10ab-4f09-834c-aeae1abb0814 None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:14.551270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccec0e5-10ab-4f09-834c-aeae1abb0814 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:14.551585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccec0e5-10ab-4f09-834c-aeae1abb0814 None admin] PATH_INFO: `/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f/users/a37e9f49a4b14138b0ac90a14bf143c6/roles/b3796e568aa342a1b3318b04d23a9cc0` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:14.553878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccec0e5-10ab-4f09-834c-aeae1abb0814 None admin] RBAC: Authorizing `identity:create_grant(project_id=8efcb200d7b74faea2fb18fdcb4c855f, user_id=a37e9f49a4b14138b0ac90a14bf143c6, role_id=b3796e568aa342a1b3318b04d23a9cc0)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:14.555284 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccec0e5-10ab-4f09-834c-aeae1abb0814 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:14.570833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 559/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:04:14 2022] PUT /identity/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f/users/a37e9f49a4b14138b0ac90a14bf143c6/roles/b3796e568aa342a1b3318b04d23a9cc0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:04:16.456028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9f49-731d-4290-a6c5-454e441c60d7 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:16.457125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9f49-731d-4290-a6c5-454e441c60d7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:16.457391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9f49-731d-4290-a6c5-454e441c60d7 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:16.459266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 565/1124] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:16.466602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbad21-eeb8-4c60-a662-fafaa8c5a71b None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:16.467325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbad21-eeb8-4c60-a662-fafaa8c5a71b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:16.467489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbad21-eeb8-4c60-a662-fafaa8c5a71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:16.494677 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-30fbad21-eeb8-4c60-a662-fafaa8c5a71b None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:16.495886 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-30fbad21-eeb8-4c60-a662-fafaa8c5a71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:16.570876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 560/1125] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:16.833637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9f49-731d-4290-a6c5-454e441c60d7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:16.950999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9f49-731d-4290-a6c5-454e441c60d7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:16.958236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:16.992006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510e3ea-64d3-4e11-9710-de2ab766b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:16.992629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510e3ea-64d3-4e11-9710-de2ab766b276 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:16.992903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510e3ea-64d3-4e11-9710-de2ab766b276 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:16.993171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510e3ea-64d3-4e11-9710-de2ab766b276 None admin] PATH_INFO: `/v3/roles/b3796e568aa342a1b3318b04d23a9cc0` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:16.994752 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510e3ea-64d3-4e11-9710-de2ab766b276 None admin] RBAC: Authorizing `identity:get_role(role_id=b3796e568aa342a1b3318b04d23a9cc0)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:16.996144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510e3ea-64d3-4e11-9710-de2ab766b276 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:16.997560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 566/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:16 2022] GET /identity/v3/roles/b3796e568aa342a1b3318b04d23a9cc0 => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:17.003958 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbad21-eeb8-4c60-a662-fafaa8c5a71b None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:17.077992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:17.113769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbad21-eeb8-4c60-a662-fafaa8c5a71b None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:17.146880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18982b61-1588-4d5d-88c4-b69d7262efa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:17.147496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18982b61-1588-4d5d-88c4-b69d7262efa8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:17.147766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18982b61-1588-4d5d-88c4-b69d7262efa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:17.148029 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18982b61-1588-4d5d-88c4-b69d7262efa8 None admin] PATH_INFO: `/v3/users/a37e9f49a4b14138b0ac90a14bf143c6` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:17.149244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18982b61-1588-4d5d-88c4-b69d7262efa8 None admin] RBAC: Authorizing `identity:get_user(user_id=a37e9f49a4b14138b0ac90a14bf143c6)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:17.150670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18982b61-1588-4d5d-88c4-b69d7262efa8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:17.152224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 561/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:17 2022] GET /identity/v3/users/a37e9f49a4b14138b0ac90a14bf143c6 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:17.161849 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510e3ea-64d3-4e11-9710-de2ab766b276 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:17.277143 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510e3ea-64d3-4e11-9710-de2ab766b276 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:17.318361 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a323d09-d436-4f4f-acf1-9499b17218c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:17.319190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a323d09-d436-4f4f-acf1-9499b17218c5 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:17.319538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a323d09-d436-4f4f-acf1-9499b17218c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:17.319875 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a323d09-d436-4f4f-acf1-9499b17218c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:17.366823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:17.398415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a323d09-d436-4f4f-acf1-9499b17218c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:17.399852 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a323d09-d436-4f4f-acf1-9499b17218c5 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:17.511730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 567/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:04:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:04:17.520369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18982b61-1588-4d5d-88c4-b69d7262efa8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:17.635322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18982b61-1588-4d5d-88c4-b69d7262efa8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:17.673072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7b788-68b0-420b-b72f-62e7736f61f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:17.673712 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7b788-68b0-420b-b72f-62e7736f61f9 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:17.673990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7b788-68b0-420b-b72f-62e7736f61f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:17.674252 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7b788-68b0-420b-b72f-62e7736f61f9 None admin] PATH_INFO: `/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:17.675518 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7b788-68b0-420b-b72f-62e7736f61f9 None admin] RBAC: Authorizing `identity:get_project(project_id=8efcb200d7b74faea2fb18fdcb4c855f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:17.676925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7b788-68b0-420b-b72f-62e7736f61f9 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:17.678586 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 562/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:04:17 2022] GET /identity/v3/projects/8efcb200d7b74faea2fb18fdcb4c855f => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:17.686281 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a323d09-d436-4f4f-acf1-9499b17218c5 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:17.762693 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:17.793394 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a323d09-d436-4f4f-acf1-9499b17218c5 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:17.842730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4a77c-dc1d-4967-affc-4323a6eaaad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:17.843728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4a77c-dc1d-4967-affc-4323a6eaaad6 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:17.844193 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4a77c-dc1d-4967-affc-4323a6eaaad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:17.844633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4a77c-dc1d-4967-affc-4323a6eaaad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:17.845960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4a77c-dc1d-4967-affc-4323a6eaaad6 None admin] RBAC: Adding query filter params (role.id=b3796e568aa342a1b3318b04d23a9cc0, scope.project.id=8efcb200d7b74faea2fb18fdcb4c855f, user.id=a37e9f49a4b14138b0ac90a14bf143c6) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:17.846457 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4a77c-dc1d-4967-affc-4323a6eaaad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:17.848963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4a77c-dc1d-4967-affc-4323a6eaaad6 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:17.856914 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 568/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:04:17 2022] GET /identity/v3/role_assignments?user.id=a37e9f49a4b14138b0ac90a14bf143c6&scope.project.id=8efcb200d7b74faea2fb18fdcb4c855f&role.id=b3796e568aa342a1b3318b04d23a9cc0 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:19.765860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7766-ca0e-4987-88f9-ec4b8fb677d1 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:19.766465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7766-ca0e-4987-88f9-ec4b8fb677d1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:19.766465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7766-ca0e-4987-88f9-ec4b8fb677d1 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:19.767774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 563/1131] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:19.774509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f9295-7423-4538-ab4a-ab606ff0cd78 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:19.775222 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f9295-7423-4538-ab4a-ab606ff0cd78 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:19.775368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f9295-7423-4538-ab4a-ab606ff0cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:19.798336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-701f9295-7423-4538-ab4a-ab606ff0cd78 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:19.799526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-701f9295-7423-4538-ab4a-ab606ff0cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:19.871201 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 569/1132] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:20.138216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb7766-ca0e-4987-88f9-ec4b8fb677d1 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:20.141250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:20.257644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb7766-ca0e-4987-88f9-ec4b8fb677d1 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:20.295062 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1419690-611b-4fb9-96cd-9a761bfc1419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:20.295674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1419690-611b-4fb9-96cd-9a761bfc1419 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:20.295944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1419690-611b-4fb9-96cd-9a761bfc1419 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:20.296211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1419690-611b-4fb9-96cd-9a761bfc1419 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:20.297453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1419690-611b-4fb9-96cd-9a761bfc1419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:20.298877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1419690-611b-4fb9-96cd-9a761bfc1419 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:20.300969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 564/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:04:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:20.310256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f9295-7423-4538-ab4a-ab606ff0cd78 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:20.386034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:20.421452 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f9295-7423-4538-ab4a-ab606ff0cd78 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:20.456304 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2550d1-7367-48a7-b8eb-e842afe3755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:20.456790 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2550d1-7367-48a7-b8eb-e842afe3755b None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:20.457057 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2550d1-7367-48a7-b8eb-e842afe3755b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:20.457352 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2550d1-7367-48a7-b8eb-e842afe3755b None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:20.457984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2550d1-7367-48a7-b8eb-e842afe3755b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:20.459393 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2550d1-7367-48a7-b8eb-e842afe3755b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:20.495705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 570/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:04:20 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:04:22.430094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714879b0-34c2-472f-b2bf-128d9c8ebf39 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:22.430891 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714879b0-34c2-472f-b2bf-128d9c8ebf39 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:22.430891 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714879b0-34c2-472f-b2bf-128d9c8ebf39 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:22.433117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 565/1135] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:22.439275 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ae6bd-b8f2-4475-a3d3-7ce59d66476e None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:22.439724 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ae6bd-b8f2-4475-a3d3-7ce59d66476e None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:22.439815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ae6bd-b8f2-4475-a3d3-7ce59d66476e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:22.470710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-401ae6bd-b8f2-4475-a3d3-7ce59d66476e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:22.472667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-401ae6bd-b8f2-4475-a3d3-7ce59d66476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:22.553584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 571/1136] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:22.815094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714879b0-34c2-472f-b2bf-128d9c8ebf39 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:22.911812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:22.943937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714879b0-34c2-472f-b2bf-128d9c8ebf39 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:22.979100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d502504-8386-438b-b7c8-b02913d880e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:22.979732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502504-8386-438b-b7c8-b02913d880e1 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:22.980001 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502504-8386-438b-b7c8-b02913d880e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:22.980262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502504-8386-438b-b7c8-b02913d880e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:22.981439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d502504-8386-438b-b7c8-b02913d880e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:22.982850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d502504-8386-438b-b7c8-b02913d880e1 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:22.984396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 566/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:04:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:22.990700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ae6bd-b8f2-4475-a3d3-7ce59d66476e None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:23.046497 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:23.105822 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ae6bd-b8f2-4475-a3d3-7ce59d66476e None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:23.142259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abfbac-1033-4fa1-898c-f558af09d352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:23.142864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abfbac-1033-4fa1-898c-f558af09d352 None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:23.143138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abfbac-1033-4fa1-898c-f558af09d352 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:23.143555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abfbac-1033-4fa1-898c-f558af09d352 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:23.144223 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abfbac-1033-4fa1-898c-f558af09d352 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:23.145728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abfbac-1033-4fa1-898c-f558af09d352 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:23.175061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 572/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:04:22 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:04:25.117901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807e9b1-c39b-441d-80bf-c9ecd548bb86 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:25.118717 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807e9b1-c39b-441d-80bf-c9ecd548bb86 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:25.118717 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807e9b1-c39b-441d-80bf-c9ecd548bb86 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:25.120866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 567/1139] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:25.126130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b35805-ce97-49c2-9e11-b12f5ab72b5a None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:25.126568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b35805-ce97-49c2-9e11-b12f5ab72b5a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:25.126677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b35805-ce97-49c2-9e11-b12f5ab72b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:25.152311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-b2b35805-ce97-49c2-9e11-b12f5ab72b5a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:25.154457 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b2b35805-ce97-49c2-9e11-b12f5ab72b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:25.230939 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 573/1140] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:25.498628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807e9b1-c39b-441d-80bf-c9ecd548bb86 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:25.629227 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807e9b1-c39b-441d-80bf-c9ecd548bb86 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:25.667794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b1f10-bcfb-4eca-957b-e2d802291757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:25.668408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b1f10-bcfb-4eca-957b-e2d802291757 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:25.668683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b1f10-bcfb-4eca-957b-e2d802291757 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:25.668949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b1f10-bcfb-4eca-957b-e2d802291757 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:25.676413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:25.680911 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b1f10-bcfb-4eca-957b-e2d802291757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-6b8b1f10-bcfb-4eca-957b-e2d802291757 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:04:25.686230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:25.687275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:25.688197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:25.688197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:25.688197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:25.688197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:25.688197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:04:25.688197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:04:25.688197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:04:25.688197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:04:25.688197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:04:25.688197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:04:25.688197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:25.688197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:04:25.688197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 568/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:04:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:04:25.693810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b35805-ce97-49c2-9e11-b12f5ab72b5a None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:25.729468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:25.804578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b35805-ce97-49c2-9e11-b12f5ab72b5a None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:25.839770 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18a519-a337-4ec7-9093-cf79086a96ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:25.840365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a519-a337-4ec7-9093-cf79086a96ab None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:25.840630 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a519-a337-4ec7-9093-cf79086a96ab None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:25.840894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a519-a337-4ec7-9093-cf79086a96ab None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:25.841575 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18a519-a337-4ec7-9093-cf79086a96ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:25.841876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18a519-a337-4ec7-9093-cf79086a96ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:25.843219 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18a519-a337-4ec7-9093-cf79086a96ab None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:25.851580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 574/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:04:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:25.857922 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b1f10-bcfb-4eca-957b-e2d802291757 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:25.967263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b1f10-bcfb-4eca-957b-e2d802291757 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:26.005032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56e032-1506-425b-a1b2-e6ffb287eb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:26.005677 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56e032-1506-425b-a1b2-e6ffb287eb6a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:26.005951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56e032-1506-425b-a1b2-e6ffb287eb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:26.006216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56e032-1506-425b-a1b2-e6ffb287eb6a None admin] PATH_INFO: `/v3/users/43e892783970461299ac58cba33bacea` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:26.020902 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56e032-1506-425b-a1b2-e6ffb287eb6a None admin] RBAC: Authorizing `identity:get_user(user_id=43e892783970461299ac58cba33bacea)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:26.022365 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56e032-1506-425b-a1b2-e6ffb287eb6a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:26.023966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 569/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:25 2022] GET /identity/v3/users/43e892783970461299ac58cba33bacea => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:26.030451 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18a519-a337-4ec7-9093-cf79086a96ab None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:26.140398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:26.144778 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18a519-a337-4ec7-9093-cf79086a96ab None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:26.182528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746c7f9-1988-4739-b925-9a7991f09b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:26.183120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c7f9-1988-4739-b925-9a7991f09b6b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:26.183392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c7f9-1988-4739-b925-9a7991f09b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:26.183658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c7f9-1988-4739-b925-9a7991f09b6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:26.259986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746c7f9-1988-4739-b925-9a7991f09b6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:26.262284 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746c7f9-1988-4739-b925-9a7991f09b6b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:26.372804 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:26.377663 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 575/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:04:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:04:26.383793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56e032-1506-425b-a1b2-e6ffb287eb6a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:26.445796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:26.496172 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56e032-1506-425b-a1b2-e6ffb287eb6a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:26.532449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a192b63-473c-4379-b482-d3694824d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:26.533062 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a192b63-473c-4379-b482-d3694824d3df None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:26.533369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a192b63-473c-4379-b482-d3694824d3df None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:26.533638 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a192b63-473c-4379-b482-d3694824d3df None admin] PATH_INFO: `/v3/projects/a60cf5a7e8bc4e6d9cab8aea126da181` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:26.535021 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a192b63-473c-4379-b482-d3694824d3df None admin] RBAC: Authorizing `identity:get_project(project_id=a60cf5a7e8bc4e6d9cab8aea126da181)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:26.536434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a192b63-473c-4379-b482-d3694824d3df None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:26.538113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 570/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:04:26 2022] GET /identity/v3/projects/a60cf5a7e8bc4e6d9cab8aea126da181 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:26.544382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746c7f9-1988-4739-b925-9a7991f09b6b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:26.650543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746c7f9-1988-4739-b925-9a7991f09b6b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:26.686761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f438e-7391-4bdb-9013-bad0a0bfe786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:26.687355 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f438e-7391-4bdb-9013-bad0a0bfe786 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:26.687625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f438e-7391-4bdb-9013-bad0a0bfe786 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:26.687885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f438e-7391-4bdb-9013-bad0a0bfe786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:26.688597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f438e-7391-4bdb-9013-bad0a0bfe786 None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=a60cf5a7e8bc4e6d9cab8aea126da181, user.id=43e892783970461299ac58cba33bacea) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:26.688888 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f438e-7391-4bdb-9013-bad0a0bfe786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:26.690923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f438e-7391-4bdb-9013-bad0a0bfe786 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:26.696433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 576/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:04:26 2022] GET /identity/v3/role_assignments?user.id=43e892783970461299ac58cba33bacea&scope.project.id=a60cf5a7e8bc4e6d9cab8aea126da181&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:28.569060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd429b50-a15d-4b1d-bec8-38f03bbda923 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:28.569692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd429b50-a15d-4b1d-bec8-38f03bbda923 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:28.569692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd429b50-a15d-4b1d-bec8-38f03bbda923 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:28.570976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 571/1147] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:28.577261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e9d8e-b519-485d-a007-a174c47fa4b7 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:28.577976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e9d8e-b519-485d-a007-a174c47fa4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:28.578146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e9d8e-b519-485d-a007-a174c47fa4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:28.600109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-001e9d8e-b519-485d-a007-a174c47fa4b7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:28.601328 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-001e9d8e-b519-485d-a007-a174c47fa4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:28.662374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:28.673722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 577/1148] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:28.943032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd429b50-a15d-4b1d-bec8-38f03bbda923 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:29.050343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd429b50-a15d-4b1d-bec8-38f03bbda923 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:29.074504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:29.088750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7def32-ba13-43ef-b8cd-21fb6c2a03c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:29.089518 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7def32-ba13-43ef-b8cd-21fb6c2a03c8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:29.089794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7def32-ba13-43ef-b8cd-21fb6c2a03c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:29.090060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7def32-ba13-43ef-b8cd-21fb6c2a03c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:29.104467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7def32-ba13-43ef-b8cd-21fb6c2a03c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-5b7def32-ba13-43ef-b8cd-21fb6c2a03c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:04:29.112797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:29.113903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:29.118289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:29.118289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:29.118289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:29.118289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:29.118289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:04:29.118289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:04:29.118289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:04:29.118289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:04:29.118289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:04:29.118289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:04:29.118289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:29.118289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:04:29.118289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 572/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:04:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:04:29.121426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e9d8e-b519-485d-a007-a174c47fa4b7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:29.225098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e9d8e-b519-485d-a007-a174c47fa4b7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:29.271326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d7097-f0ce-4433-973b-17d64b67f0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:29.271927 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d7097-f0ce-4433-973b-17d64b67f0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:29.272197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d7097-f0ce-4433-973b-17d64b67f0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:29.272468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d7097-f0ce-4433-973b-17d64b67f0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:29.273132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d7097-f0ce-4433-973b-17d64b67f0f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:29.273464 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d7097-f0ce-4433-973b-17d64b67f0f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:29.274839 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d7097-f0ce-4433-973b-17d64b67f0f4 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:29.283418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 578/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:04:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:29.289885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7def32-ba13-43ef-b8cd-21fb6c2a03c8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:29.391874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7def32-ba13-43ef-b8cd-21fb6c2a03c8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:29.432251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4fdea-b586-4d4e-b6dc-b0e54ec15dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:29.433146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4fdea-b586-4d4e-b6dc-b0e54ec15dff None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:29.433524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4fdea-b586-4d4e-b6dc-b0e54ec15dff None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:29.433864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4fdea-b586-4d4e-b6dc-b0e54ec15dff None admin] PATH_INFO: `/v3/users/43e892783970461299ac58cba33bacea` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:29.435825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4fdea-b586-4d4e-b6dc-b0e54ec15dff None admin] RBAC: Authorizing `identity:get_user(user_id=43e892783970461299ac58cba33bacea)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:29.438124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4fdea-b586-4d4e-b6dc-b0e54ec15dff None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:29.440508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 573/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:29 2022] GET /identity/v3/users/43e892783970461299ac58cba33bacea => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:29.447127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d7097-f0ce-4433-973b-17d64b67f0f4 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:29.512567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:29.570760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d7097-f0ce-4433-973b-17d64b67f0f4 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:29.608359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3455b-2bb2-45c6-82ec-30bf767046d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:29.608952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3455b-2bb2-45c6-82ec-30bf767046d1 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:29.609251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3455b-2bb2-45c6-82ec-30bf767046d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:29.609526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3455b-2bb2-45c6-82ec-30bf767046d1 None admin] PATH_INFO: `/v3/projects/a60cf5a7e8bc4e6d9cab8aea126da181` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:29.610765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3455b-2bb2-45c6-82ec-30bf767046d1 None admin] RBAC: Authorizing `identity:get_project(project_id=a60cf5a7e8bc4e6d9cab8aea126da181)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:29.612402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3455b-2bb2-45c6-82ec-30bf767046d1 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:29.614143 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 579/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:04:29 2022] GET /identity/v3/projects/a60cf5a7e8bc4e6d9cab8aea126da181 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:29.620544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4fdea-b586-4d4e-b6dc-b0e54ec15dff None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:29.683582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:29.736575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4fdea-b586-4d4e-b6dc-b0e54ec15dff None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:29.773576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d5d32-39aa-4929-9788-08c9d30aaa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:29.774155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d5d32-39aa-4929-9788-08c9d30aaa53 None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:29.774431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d5d32-39aa-4929-9788-08c9d30aaa53 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:29.774696 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d5d32-39aa-4929-9788-08c9d30aaa53 None admin] PATH_INFO: `/v3/projects/a60cf5a7e8bc4e6d9cab8aea126da181/users/43e892783970461299ac58cba33bacea/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:29.776861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d5d32-39aa-4929-9788-08c9d30aaa53 None admin] RBAC: Authorizing `identity:create_grant(project_id=a60cf5a7e8bc4e6d9cab8aea126da181, user_id=43e892783970461299ac58cba33bacea, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:29.778635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d5d32-39aa-4929-9788-08c9d30aaa53 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:29.793578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 574/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:04:29 2022] PUT /identity/v3/projects/a60cf5a7e8bc4e6d9cab8aea126da181/users/43e892783970461299ac58cba33bacea/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:04:31.695140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb1786-1f30-4151-9879-6bc32cd8b395 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:31.695775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb1786-1f30-4151-9879-6bc32cd8b395 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:31.695775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb1786-1f30-4151-9879-6bc32cd8b395 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:31.697010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 580/1154] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:04:31.703410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f22ef9-3353-4ea2-bd76-3e58ae158578 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:31.704125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f22ef9-3353-4ea2-bd76-3e58ae158578 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:31.704259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f22ef9-3353-4ea2-bd76-3e58ae158578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:31.729884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-78f22ef9-3353-4ea2-bd76-3e58ae158578 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:31.731053 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-78f22ef9-3353-4ea2-bd76-3e58ae158578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:31.805876 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 575/1155] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:32.076048 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb1786-1f30-4151-9879-6bc32cd8b395 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:32.196351 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb1786-1f30-4151-9879-6bc32cd8b395 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:32.222256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:32.236669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9065e2-040d-4c16-8587-345cd2aa2dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:32.237400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9065e2-040d-4c16-8587-345cd2aa2dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:32.237668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9065e2-040d-4c16-8587-345cd2aa2dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:32.237939 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9065e2-040d-4c16-8587-345cd2aa2dd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:32.248689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9065e2-040d-4c16-8587-345cd2aa2dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-7c9065e2-040d-4c16-8587-345cd2aa2dd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:04:32.253599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:32.254678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:32.255683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:32.255683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:32.255683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:32.255683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:32.255683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:04:32.255683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:04:32.255683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:04:32.255683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:04:32.255683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:04:32.255683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:04:32.255683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:32.255683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:04:32.255683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 581/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:04:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:04:32.261037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f22ef9-3353-4ea2-bd76-3e58ae158578 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:32.305786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:32.364482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f22ef9-3353-4ea2-bd76-3e58ae158578 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:32.400630 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e9fca-613a-4aa0-b702-75b3335c780d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:32.401253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e9fca-613a-4aa0-b702-75b3335c780d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:32.401532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e9fca-613a-4aa0-b702-75b3335c780d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:32.401800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e9fca-613a-4aa0-b702-75b3335c780d None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:32.402458 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e9fca-613a-4aa0-b702-75b3335c780d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:32.402756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e9fca-613a-4aa0-b702-75b3335c780d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:32.404432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e9fca-613a-4aa0-b702-75b3335c780d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:32.413477 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 576/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:04:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:32.420189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9065e2-040d-4c16-8587-345cd2aa2dd7 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:32.547868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9065e2-040d-4c16-8587-345cd2aa2dd7 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:32.585178 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ca14c-c363-4ad9-9471-721e9584f8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:32.585826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca14c-c363-4ad9-9471-721e9584f8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:32.586096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca14c-c363-4ad9-9471-721e9584f8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:32.586361 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca14c-c363-4ad9-9471-721e9584f8a2 None admin] PATH_INFO: `/v3/users/43e892783970461299ac58cba33bacea` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:32.587479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ca14c-c363-4ad9-9471-721e9584f8a2 None admin] RBAC: Authorizing `identity:get_user(user_id=43e892783970461299ac58cba33bacea)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:32.588905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ca14c-c363-4ad9-9471-721e9584f8a2 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:32.590473 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 582/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:32 2022] GET /identity/v3/users/43e892783970461299ac58cba33bacea => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:32.597024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e9fca-613a-4aa0-b702-75b3335c780d None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:32.715517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e9fca-613a-4aa0-b702-75b3335c780d None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:32.717779 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:32.751044 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fecd6-bcf2-4143-87f4-c90e2483bf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:32.751649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fecd6-bcf2-4143-87f4-c90e2483bf8d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:32.751923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fecd6-bcf2-4143-87f4-c90e2483bf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:32.752187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fecd6-bcf2-4143-87f4-c90e2483bf8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:32.826105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4fecd6-bcf2-4143-87f4-c90e2483bf8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:32.827542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4fecd6-bcf2-4143-87f4-c90e2483bf8d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:32.928000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 577/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:04:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:04:32.934341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ca14c-c363-4ad9-9471-721e9584f8a2 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:32.996065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:33.048730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ca14c-c363-4ad9-9471-721e9584f8a2 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:33.086741 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0ea9f-885d-49c2-bc3e-0ff203e037cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:33.087391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ea9f-885d-49c2-bc3e-0ff203e037cb None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:33.087665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ea9f-885d-49c2-bc3e-0ff203e037cb None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:33.087931 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ea9f-885d-49c2-bc3e-0ff203e037cb None admin] PATH_INFO: `/v3/projects/a60cf5a7e8bc4e6d9cab8aea126da181` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:33.089185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0ea9f-885d-49c2-bc3e-0ff203e037cb None admin] RBAC: Authorizing `identity:get_project(project_id=a60cf5a7e8bc4e6d9cab8aea126da181)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:33.090628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0ea9f-885d-49c2-bc3e-0ff203e037cb None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:33.092268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 583/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:04:32 2022] GET /identity/v3/projects/a60cf5a7e8bc4e6d9cab8aea126da181 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:04:33.099395 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fecd6-bcf2-4143-87f4-c90e2483bf8d None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:33.102645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:33.219615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fecd6-bcf2-4143-87f4-c90e2483bf8d None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:33.254912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1f2d3-ad58-46c5-aa48-3581cc1c2609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:33.255508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1f2d3-ad58-46c5-aa48-3581cc1c2609 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:33.255782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1f2d3-ad58-46c5-aa48-3581cc1c2609 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:33.256043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1f2d3-ad58-46c5-aa48-3581cc1c2609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:33.256743 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1f2d3-ad58-46c5-aa48-3581cc1c2609 None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=a60cf5a7e8bc4e6d9cab8aea126da181, user.id=43e892783970461299ac58cba33bacea) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:33.257049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1f2d3-ad58-46c5-aa48-3581cc1c2609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:33.258505 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1f2d3-ad58-46c5-aa48-3581cc1c2609 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:33.264236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 578/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:04:33 2022] GET /identity/v3/role_assignments?user.id=43e892783970461299ac58cba33bacea&scope.project.id=a60cf5a7e8bc4e6d9cab8aea126da181&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:35.148160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b293e5-d4ba-47ce-ab5a-ca07117e8042 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:35.149037 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b293e5-d4ba-47ce-ab5a-ca07117e8042 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:35.149037 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b293e5-d4ba-47ce-ab5a-ca07117e8042 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:35.151225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 584/1162] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:35.157017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265b70b-3ae5-490d-956b-9924f5615ce4 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:35.157462 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265b70b-3ae5-490d-956b-9924f5615ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:35.157571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265b70b-3ae5-490d-956b-9924f5615ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:35.177685 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-1265b70b-3ae5-490d-956b-9924f5615ce4 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:35.178853 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1265b70b-3ae5-490d-956b-9924f5615ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:35.251725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:35.258147 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 579/1163] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:35.519587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b293e5-d4ba-47ce-ab5a-ca07117e8042 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:35.638976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b293e5-d4ba-47ce-ab5a-ca07117e8042 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:35.656747 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:35.675041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48f2ad-c293-4450-b96d-999ad52a5535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:35.675649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48f2ad-c293-4450-b96d-999ad52a5535 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:35.675918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48f2ad-c293-4450-b96d-999ad52a5535 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:35.676182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48f2ad-c293-4450-b96d-999ad52a5535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:35.747564 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48f2ad-c293-4450-b96d-999ad52a5535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:35.748998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48f2ad-c293-4450-b96d-999ad52a5535 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:35.850827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 585/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:04:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:04:35.860688 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265b70b-3ae5-490d-956b-9924f5615ce4 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:35.969976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265b70b-3ae5-490d-956b-9924f5615ce4 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:36.009045 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2033e01-a8be-49d7-84db-c1c8fac56e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:36.009710 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2033e01-a8be-49d7-84db-c1c8fac56e53 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:36.009982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2033e01-a8be-49d7-84db-c1c8fac56e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:36.010233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2033e01-a8be-49d7-84db-c1c8fac56e53 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:36.018029 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2033e01-a8be-49d7-84db-c1c8fac56e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:36.019507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2033e01-a8be-49d7-84db-c1c8fac56e53 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-b2033e01-a8be-49d7-84db-c1c8fac56e53 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:36.032671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:36.035893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:04:36.037725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 580/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 31 00:04:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:04:36.043859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48f2ad-c293-4450-b96d-999ad52a5535 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:36.065024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:36.152600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48f2ad-c293-4450-b96d-999ad52a5535 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:36.198268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62225aee-46f1-466a-bafd-d2cd501c726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:36.198877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62225aee-46f1-466a-bafd-d2cd501c726f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:36.199153 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62225aee-46f1-466a-bafd-d2cd501c726f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:36.199426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62225aee-46f1-466a-bafd-d2cd501c726f None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:36.200070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62225aee-46f1-466a-bafd-d2cd501c726f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:36.200366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62225aee-46f1-466a-bafd-d2cd501c726f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:36.201838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62225aee-46f1-466a-bafd-d2cd501c726f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:36.210101 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 586/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 31 00:04:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:38.094771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4f649-ffea-421c-93e8-4a9d01ded421 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:38.095517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4f649-ffea-421c-93e8-4a9d01ded421 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:38.095657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4f649-ffea-421c-93e8-4a9d01ded421 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:38.097558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 581/1167] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:38.103824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae4c9-7450-4e1d-9a1b-add07992df9c None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:38.104258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae4c9-7450-4e1d-9a1b-add07992df9c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:38.104416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae4c9-7450-4e1d-9a1b-add07992df9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:38.126899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-97aae4c9-7450-4e1d-9a1b-add07992df9c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:38.128319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-97aae4c9-7450-4e1d-9a1b-add07992df9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:38.204080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 587/1168] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:38.471682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4f649-ffea-421c-93e8-4a9d01ded421 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:38.543972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:38.586988 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4f649-ffea-421c-93e8-4a9d01ded421 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:38.623099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ee0ed-3833-4bdf-b529-083dfa11a153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:38.623727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ee0ed-3833-4bdf-b529-083dfa11a153 None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:38.623999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ee0ed-3833-4bdf-b529-083dfa11a153 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:38.624264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ee0ed-3833-4bdf-b529-083dfa11a153 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:38.624924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ee0ed-3833-4bdf-b529-083dfa11a153 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:38.626315 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ee0ed-3833-4bdf-b529-083dfa11a153 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:38.646381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 582/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Wed Aug 31 00:04:38 2022] POST /identity/v3/domains => generated 267 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:04:40.583715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac78f5-0c41-4932-8efc-dc39e22576c3 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:40.584317 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac78f5-0c41-4932-8efc-dc39e22576c3 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:40.584317 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac78f5-0c41-4932-8efc-dc39e22576c3 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:40.586338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 588/1170] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:40.595117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8170c-76a0-4ec2-a3cd-6870d54ce939 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:40.595530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8170c-76a0-4ec2-a3cd-6870d54ce939 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:40.595709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8170c-76a0-4ec2-a3cd-6870d54ce939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:40.614887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-49d8170c-76a0-4ec2-a3cd-6870d54ce939 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:40.616067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-49d8170c-76a0-4ec2-a3cd-6870d54ce939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:40.699297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 583/1171] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:04:40.970141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac78f5-0c41-4932-8efc-dc39e22576c3 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:40.987513 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:41.090985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac78f5-0c41-4932-8efc-dc39e22576c3 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:41.134731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2066e-9efb-481e-b596-c46e6283ad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:41.135340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2066e-9efb-481e-b596-c46e6283ad61 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:41.135605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2066e-9efb-481e-b596-c46e6283ad61 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:41.135867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2066e-9efb-481e-b596-c46e6283ad61 None admin] PATH_INFO: `/v3/domains/3f2020402528489f97c99b3c4ed99ff9` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:41.147127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2066e-9efb-481e-b596-c46e6283ad61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3f2020402528489f97c99b3c4ed99ff9)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:41.148553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2066e-9efb-481e-b596-c46e6283ad61 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:41.150154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 589/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Wed Aug 31 00:04:40 2022] GET /identity/v3/domains/3f2020402528489f97c99b3c4ed99ff9 => generated 267 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:41.157015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8170c-76a0-4ec2-a3cd-6870d54ce939 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:41.215325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:41.271842 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8170c-76a0-4ec2-a3cd-6870d54ce939 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:41.309022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065b630-05a2-42c6-851a-238bd9a0237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:41.309655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065b630-05a2-42c6-851a-238bd9a0237f None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:41.309928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065b630-05a2-42c6-851a-238bd9a0237f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:41.310199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065b630-05a2-42c6-851a-238bd9a0237f None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:41.310847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065b630-05a2-42c6-851a-238bd9a0237f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:41.312254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065b630-05a2-42c6-851a-238bd9a0237f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:41.343936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 584/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:04:41 2022] POST /identity/v3/projects => generated 361 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:04:43.264123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c54aa-4aee-4d13-9a7e-da78bf992268 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:43.264716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c54aa-4aee-4d13-9a7e-da78bf992268 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:43.264716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c54aa-4aee-4d13-9a7e-da78bf992268 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:43.266039 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 590/1174] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:43.272349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4ed30-9b3f-4c8f-b4d6-021ebfdb5eeb None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:43.272985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4ed30-9b3f-4c8f-b4d6-021ebfdb5eeb None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:43.273174 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4ed30-9b3f-4c8f-b4d6-021ebfdb5eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:43.302312 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-33e4ed30-9b3f-4c8f-b4d6-021ebfdb5eeb None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:43.303490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-33e4ed30-9b3f-4c8f-b4d6-021ebfdb5eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:43.375018 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 585/1175] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:43.649023 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c54aa-4aee-4d13-9a7e-da78bf992268 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:43.728817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:43.770086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c54aa-4aee-4d13-9a7e-da78bf992268 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:43.805726 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e358f8b-a3dd-480f-8d73-af0b1805ea6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:43.806363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e358f8b-a3dd-480f-8d73-af0b1805ea6a None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:43.806636 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e358f8b-a3dd-480f-8d73-af0b1805ea6a None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:43.806908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e358f8b-a3dd-480f-8d73-af0b1805ea6a None admin] PATH_INFO: `/v3/domains/3f2020402528489f97c99b3c4ed99ff9` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:43.808181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e358f8b-a3dd-480f-8d73-af0b1805ea6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=3f2020402528489f97c99b3c4ed99ff9)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:43.809672 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e358f8b-a3dd-480f-8d73-af0b1805ea6a None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:43.811252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 591/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Wed Aug 31 00:04:43 2022] GET /identity/v3/domains/3f2020402528489f97c99b3c4ed99ff9 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:43.818311 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4ed30-9b3f-4c8f-b4d6-021ebfdb5eeb None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:43.856783 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:43.936687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4ed30-9b3f-4c8f-b4d6-021ebfdb5eeb None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:43.972921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039a854-0ba9-4b37-ad1e-68a1d5ecdc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:43.973548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039a854-0ba9-4b37-ad1e-68a1d5ecdc4c None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:43.973823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039a854-0ba9-4b37-ad1e-68a1d5ecdc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:43.974090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039a854-0ba9-4b37-ad1e-68a1d5ecdc4c None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:43.974734 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039a854-0ba9-4b37-ad1e-68a1d5ecdc4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:43.976152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039a854-0ba9-4b37-ad1e-68a1d5ecdc4c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:43.999020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 586/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:04:43 2022] POST /identity/v3/users => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:04:45.895661 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f5b45-6326-42e1-94ca-3ccf7ed31193 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:45.896550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f5b45-6326-42e1-94ca-3ccf7ed31193 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:45.896550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f5b45-6326-42e1-94ca-3ccf7ed31193 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:45.898740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 592/1178] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:45.908968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321b592-2e70-44b3-86df-b1f527174171 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:45.909412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321b592-2e70-44b3-86df-b1f527174171 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:45.909542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321b592-2e70-44b3-86df-b1f527174171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:45.930546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-6321b592-2e70-44b3-86df-b1f527174171 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:45.931776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-6321b592-2e70-44b3-86df-b1f527174171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:46.007340 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 587/1179] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:46.271676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f5b45-6326-42e1-94ca-3ccf7ed31193 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:46.382637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f5b45-6326-42e1-94ca-3ccf7ed31193 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:46.419854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49c12d-cf9c-4abb-8339-cf65bf13c495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:46.420467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49c12d-cf9c-4abb-8339-cf65bf13c495 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:46.420738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49c12d-cf9c-4abb-8339-cf65bf13c495 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:46.421006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49c12d-cf9c-4abb-8339-cf65bf13c495 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:46.431503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:46.435918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49c12d-cf9c-4abb-8339-cf65bf13c495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-ff49c12d-cf9c-4abb-8339-cf65bf13c495 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:04:46.444272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:46.445543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:46.446471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:46.446471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:46.446471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:46.446471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:46.446471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:04:46.446471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:04:46.446471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:04:46.446471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:04:46.446471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:04:46.446471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:04:46.446471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:46.446471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:04:46.446471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 593/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:04:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:04:46.453851 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321b592-2e70-44b3-86df-b1f527174171 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:46.474727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:46.562995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321b592-2e70-44b3-86df-b1f527174171 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:46.599045 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1d98d-94d8-47c4-a0d8-94183870ae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:46.599646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1d98d-94d8-47c4-a0d8-94183870ae28 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:46.599921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1d98d-94d8-47c4-a0d8-94183870ae28 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:46.600186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1d98d-94d8-47c4-a0d8-94183870ae28 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:46.600844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1d98d-94d8-47c4-a0d8-94183870ae28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:46.601143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1d98d-94d8-47c4-a0d8-94183870ae28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:46.602530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1d98d-94d8-47c4-a0d8-94183870ae28 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:46.610731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 588/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:04:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:46.620865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49c12d-cf9c-4abb-8339-cf65bf13c495 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:46.746063 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49c12d-cf9c-4abb-8339-cf65bf13c495 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:46.789024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d509edc-eabe-493b-b583-ba18027d8342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:46.789681 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509edc-eabe-493b-b583-ba18027d8342 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:46.789953 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509edc-eabe-493b-b583-ba18027d8342 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:46.790218 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509edc-eabe-493b-b583-ba18027d8342 None admin] PATH_INFO: `/v3/users/f5451896b5124e01a14c2397f17b7324` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:46.804639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d509edc-eabe-493b-b583-ba18027d8342 None admin] RBAC: Authorizing `identity:get_user(user_id=f5451896b5124e01a14c2397f17b7324)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:46.806105 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d509edc-eabe-493b-b583-ba18027d8342 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:46.807707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 594/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:46 2022] GET /identity/v3/users/f5451896b5124e01a14c2397f17b7324 => generated 311 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:46.814179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1d98d-94d8-47c4-a0d8-94183870ae28 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:46.900446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:46.924623 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1d98d-94d8-47c4-a0d8-94183870ae28 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:46.960291 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afcba2-01d3-4c12-bd8d-f893fcf61bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:46.960891 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afcba2-01d3-4c12-bd8d-f893fcf61bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:46.961165 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afcba2-01d3-4c12-bd8d-f893fcf61bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:46.961440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afcba2-01d3-4c12-bd8d-f893fcf61bc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:47.031408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afcba2-01d3-4c12-bd8d-f893fcf61bc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:47.032845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afcba2-01d3-4c12-bd8d-f893fcf61bc2 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:47.121050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:47.144881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 589/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:04:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:04:47.151181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d509edc-eabe-493b-b583-ba18027d8342 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:47.224643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:47.272425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d509edc-eabe-493b-b583-ba18027d8342 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:47.309481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54acfc1-a44f-41b5-ac01-8fc9f816bd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:47.310102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54acfc1-a44f-41b5-ac01-8fc9f816bd6b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:47.310390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54acfc1-a44f-41b5-ac01-8fc9f816bd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:47.310633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54acfc1-a44f-41b5-ac01-8fc9f816bd6b None admin] PATH_INFO: `/v3/projects/5ce53ca3f4224b18a75122eb7c3ee4d8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:47.311782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54acfc1-a44f-41b5-ac01-8fc9f816bd6b None admin] RBAC: Authorizing `identity:get_project(project_id=5ce53ca3f4224b18a75122eb7c3ee4d8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:47.313237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54acfc1-a44f-41b5-ac01-8fc9f816bd6b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:47.314984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 595/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:04:47 2022] GET /identity/v3/projects/5ce53ca3f4224b18a75122eb7c3ee4d8 => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:47.321958 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afcba2-01d3-4c12-bd8d-f893fcf61bc2 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:47.440446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afcba2-01d3-4c12-bd8d-f893fcf61bc2 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:47.476298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba437a-d77f-4876-aa5a-1d8c989dc227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:47.476888 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba437a-d77f-4876-aa5a-1d8c989dc227 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:47.477159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba437a-d77f-4876-aa5a-1d8c989dc227 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:47.477455 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba437a-d77f-4876-aa5a-1d8c989dc227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:47.478157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba437a-d77f-4876-aa5a-1d8c989dc227 None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=5ce53ca3f4224b18a75122eb7c3ee4d8, user.id=f5451896b5124e01a14c2397f17b7324) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:47.478461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba437a-d77f-4876-aa5a-1d8c989dc227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:47.479865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba437a-d77f-4876-aa5a-1d8c989dc227 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:47.485622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 590/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:04:47 2022] GET /identity/v3/role_assignments?user.id=f5451896b5124e01a14c2397f17b7324&scope.project.id=5ce53ca3f4224b18a75122eb7c3ee4d8&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:49.338634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d16bd6-8862-4fc0-8b13-ce5c89f66e1a None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:49.339239 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d16bd6-8862-4fc0-8b13-ce5c89f66e1a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:49.339239 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d16bd6-8862-4fc0-8b13-ce5c89f66e1a None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:49.340473 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 596/1186] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:49.347152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0a8fb-bc42-476e-af34-a44f7138a712 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:49.347844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0a8fb-bc42-476e-af34-a44f7138a712 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:49.348012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0a8fb-bc42-476e-af34-a44f7138a712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:49.372915 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7ee0a8fb-bc42-476e-af34-a44f7138a712 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:49.374125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7ee0a8fb-bc42-476e-af34-a44f7138a712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:49.411934 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:49.444422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 591/1187] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:49.710158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d16bd6-8862-4fc0-8b13-ce5c89f66e1a None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:49.823603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d16bd6-8862-4fc0-8b13-ce5c89f66e1a None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:49.849198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:49.863147 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984deba6-4081-4d55-8941-4a0a82162f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:49.864097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984deba6-4081-4d55-8941-4a0a82162f9d None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:49.864517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984deba6-4081-4d55-8941-4a0a82162f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:49.864937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984deba6-4081-4d55-8941-4a0a82162f9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:49.880907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984deba6-4081-4d55-8941-4a0a82162f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-984deba6-4081-4d55-8941-4a0a82162f9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:04:49.885731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:49.886787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:49.887680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:49.887680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:49.887680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:49.887680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:49.887680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:04:49.887680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:04:49.887680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:04:49.887680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:04:49.887680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:04:49.887680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:04:49.887680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:49.887680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:04:49.887680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 597/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:04:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:04:49.893030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0a8fb-bc42-476e-af34-a44f7138a712 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:50.006996 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0a8fb-bc42-476e-af34-a44f7138a712 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:50.042893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37aca2-1734-4138-9d7e-712780b0831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:50.043494 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37aca2-1734-4138-9d7e-712780b0831e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:50.043763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37aca2-1734-4138-9d7e-712780b0831e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:50.044022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37aca2-1734-4138-9d7e-712780b0831e None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:50.044670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37aca2-1734-4138-9d7e-712780b0831e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:50.044963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37aca2-1734-4138-9d7e-712780b0831e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:50.046328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37aca2-1734-4138-9d7e-712780b0831e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:50.054780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 592/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:04:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:50.061086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984deba6-4081-4d55-8941-4a0a82162f9d None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:50.189238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984deba6-4081-4d55-8941-4a0a82162f9d None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:50.234323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6e08b-038a-4db6-9e1c-857e89634af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:50.234960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6e08b-038a-4db6-9e1c-857e89634af9 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:50.235228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6e08b-038a-4db6-9e1c-857e89634af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:50.235494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6e08b-038a-4db6-9e1c-857e89634af9 None admin] PATH_INFO: `/v3/users/f5451896b5124e01a14c2397f17b7324` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:50.237273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6e08b-038a-4db6-9e1c-857e89634af9 None admin] RBAC: Authorizing `identity:get_user(user_id=f5451896b5124e01a14c2397f17b7324)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:50.239412 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6e08b-038a-4db6-9e1c-857e89634af9 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:50.241039 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 598/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:50 2022] GET /identity/v3/users/f5451896b5124e01a14c2397f17b7324 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:04:50.247252 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37aca2-1734-4138-9d7e-712780b0831e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:50.286578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:50.363445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37aca2-1734-4138-9d7e-712780b0831e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:50.406528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84934b6e-e93f-44c0-9c8b-e0399409a726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:50.407148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84934b6e-e93f-44c0-9c8b-e0399409a726 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:50.407424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84934b6e-e93f-44c0-9c8b-e0399409a726 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:50.407690 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84934b6e-e93f-44c0-9c8b-e0399409a726 None admin] PATH_INFO: `/v3/projects/5ce53ca3f4224b18a75122eb7c3ee4d8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:50.409195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84934b6e-e93f-44c0-9c8b-e0399409a726 None admin] RBAC: Authorizing `identity:get_project(project_id=5ce53ca3f4224b18a75122eb7c3ee4d8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:50.410642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84934b6e-e93f-44c0-9c8b-e0399409a726 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:50.412288 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 593/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:04:50 2022] GET /identity/v3/projects/5ce53ca3f4224b18a75122eb7c3ee4d8 => generated 361 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:50.419373 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6e08b-038a-4db6-9e1c-857e89634af9 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:50.504512 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:50.564480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6e08b-038a-4db6-9e1c-857e89634af9 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:50.603542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae80b7-0f72-4b82-becc-ce8620cd1372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:50.604192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae80b7-0f72-4b82-becc-ce8620cd1372 None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:50.604459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae80b7-0f72-4b82-becc-ce8620cd1372 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:50.604725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae80b7-0f72-4b82-becc-ce8620cd1372 None admin] PATH_INFO: `/v3/projects/5ce53ca3f4224b18a75122eb7c3ee4d8/users/f5451896b5124e01a14c2397f17b7324/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:50.606744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae80b7-0f72-4b82-becc-ce8620cd1372 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ce53ca3f4224b18a75122eb7c3ee4d8, user_id=f5451896b5124e01a14c2397f17b7324, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:50.608168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae80b7-0f72-4b82-becc-ce8620cd1372 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:50.624574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 599/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:04:50 2022] PUT /identity/v3/projects/5ce53ca3f4224b18a75122eb7c3ee4d8/users/f5451896b5124e01a14c2397f17b7324/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:04:52.593782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cd925-e632-4a47-85c2-34de266035c1 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:52.594362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cd925-e632-4a47-85c2-34de266035c1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:52.594362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cd925-e632-4a47-85c2-34de266035c1 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:52.595728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 594/1193] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:04:52.602352 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1caf-016e-4627-980b-7120f5302ad0 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:52.603096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1caf-016e-4627-980b-7120f5302ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:52.603243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1caf-016e-4627-980b-7120f5302ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:52.631240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-828c1caf-016e-4627-980b-7120f5302ad0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:04:52.632435 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-828c1caf-016e-4627-980b-7120f5302ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:04:52.720926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 600/1194] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:04:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:04:52.989724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cd925-e632-4a47-85c2-34de266035c1 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:53.114117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cd925-e632-4a47-85c2-34de266035c1 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:53.115673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:53.150029 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2b411-4ecc-4b2c-905e-3d7a5ddcc08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:53.150646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2b411-4ecc-4b2c-905e-3d7a5ddcc08e None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:53.150921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2b411-4ecc-4b2c-905e-3d7a5ddcc08e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:53.151185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2b411-4ecc-4b2c-905e-3d7a5ddcc08e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:53.163123 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2b411-4ecc-4b2c-905e-3d7a5ddcc08e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-d0a2b411-4ecc-4b2c-905e-3d7a5ddcc08e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:04:53.167914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:04:53.168979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:04:53.169878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:04:53.169878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:04:53.169878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:04:53.169878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:04:53.169878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:04:53.169878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:04:53.169878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:04:53.169878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:04:53.169878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:04:53.169878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:04:53.169878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:04:53.169878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:04:53.169878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 595/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:04:53.175783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c1caf-016e-4627-980b-7120f5302ad0 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:53.230431 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:53.290902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c1caf-016e-4627-980b-7120f5302ad0 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:53.327512 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a4596-a9e4-42b6-94c3-5557c5cd5742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:53.328109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a4596-a9e4-42b6-94c3-5557c5cd5742 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:53.328383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a4596-a9e4-42b6-94c3-5557c5cd5742 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:53.328653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a4596-a9e4-42b6-94c3-5557c5cd5742 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:53.329346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a4596-a9e4-42b6-94c3-5557c5cd5742 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:53.329643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a4596-a9e4-42b6-94c3-5557c5cd5742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:53.331756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a4596-a9e4-42b6-94c3-5557c5cd5742 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:53.340326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 601/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:04:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:53.346686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2b411-4ecc-4b2c-905e-3d7a5ddcc08e None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:53.461022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2b411-4ecc-4b2c-905e-3d7a5ddcc08e None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:53.506404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5d0d9-91ff-4459-a3ac-1b450716b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:53.507043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5d0d9-91ff-4459-a3ac-1b450716b89c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:53.507311 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5d0d9-91ff-4459-a3ac-1b450716b89c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:53.507569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5d0d9-91ff-4459-a3ac-1b450716b89c None admin] PATH_INFO: `/v3/users/f5451896b5124e01a14c2397f17b7324` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:53.508802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5d0d9-91ff-4459-a3ac-1b450716b89c None admin] RBAC: Authorizing `identity:get_user(user_id=f5451896b5124e01a14c2397f17b7324)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:53.518383 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5d0d9-91ff-4459-a3ac-1b450716b89c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:53.520154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 596/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 31 00:04:53 2022] GET /identity/v3/users/f5451896b5124e01a14c2397f17b7324 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:53.527237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a4596-a9e4-42b6-94c3-5557c5cd5742 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:53.641894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a4596-a9e4-42b6-94c3-5557c5cd5742 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:53.648986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:53.683349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c8658-6381-479e-aef2-ec54bd4ef908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:53.684251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c8658-6381-479e-aef2-ec54bd4ef908 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:53.684668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c8658-6381-479e-aef2-ec54bd4ef908 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:53.685077 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c8658-6381-479e-aef2-ec54bd4ef908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:53.771060 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c8658-6381-479e-aef2-ec54bd4ef908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:53.772494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c8658-6381-479e-aef2-ec54bd4ef908 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:53.891218 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 602/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:04:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:04:53.897723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5d0d9-91ff-4459-a3ac-1b450716b89c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:53.938336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:54.009859 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5d0d9-91ff-4459-a3ac-1b450716b89c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:54.044761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcf154-03ec-472a-8323-d93da426384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:54.045403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcf154-03ec-472a-8323-d93da426384a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:54.045679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcf154-03ec-472a-8323-d93da426384a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:54.045945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcf154-03ec-472a-8323-d93da426384a None admin] PATH_INFO: `/v3/projects/5ce53ca3f4224b18a75122eb7c3ee4d8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:54.047175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcf154-03ec-472a-8323-d93da426384a None admin] RBAC: Authorizing `identity:get_project(project_id=5ce53ca3f4224b18a75122eb7c3ee4d8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:54.048703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcf154-03ec-472a-8323-d93da426384a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:54.050375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 597/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 31 00:04:53 2022] GET /identity/v3/projects/5ce53ca3f4224b18a75122eb7c3ee4d8 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:04:54.057445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c8658-6381-479e-aef2-ec54bd4ef908 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:04:54.070776 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:04:54.175053 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c8658-6381-479e-aef2-ec54bd4ef908 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:04:54.210897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5de33-eee0-44b6-aa47-0da6086acf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:04:54.211492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5de33-eee0-44b6-aa47-0da6086acf71 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:54.211782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5de33-eee0-44b6-aa47-0da6086acf71 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:54.212023 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5de33-eee0-44b6-aa47-0da6086acf71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:54.212736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5de33-eee0-44b6-aa47-0da6086acf71 None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=5ce53ca3f4224b18a75122eb7c3ee4d8, user.id=f5451896b5124e01a14c2397f17b7324) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:04:54.213034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5de33-eee0-44b6-aa47-0da6086acf71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:04:54.214477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5de33-eee0-44b6-aa47-0da6086acf71 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:04:54.221472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 603/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:04:54 2022] GET /identity/v3/role_assignments?user.id=f5451896b5124e01a14c2397f17b7324&scope.project.id=5ce53ca3f4224b18a75122eb7c3ee4d8&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:04.040151 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=51 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:04.218053 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=65 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:49.854093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cacfa-cc3a-4384-b893-b4f5c30f3765 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:49.854093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cacfa-cc3a-4384-b893-b4f5c30f3765 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:49.854093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cacfa-cc3a-4384-b893-b4f5c30f3765 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:49.856246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 598/1201] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:49.862578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee4a25-449b-4fa5-a8e0-3123c3b859f7 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:49.863135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee4a25-449b-4fa5-a8e0-3123c3b859f7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:49.863135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee4a25-449b-4fa5-a8e0-3123c3b859f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:49.882628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-90ee4a25-449b-4fa5-a8e0-3123c3b859f7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:49.883912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-90ee4a25-449b-4fa5-a8e0-3123c3b859f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:49.969503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 604/1202] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:05:50.273988 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cacfa-cc3a-4384-b893-b4f5c30f3765 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:50.444475 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cacfa-cc3a-4384-b893-b4f5c30f3765 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:50.500430 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b1489-e694-4077-8c99-ea3188e0084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:50.501781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b1489-e694-4077-8c99-ea3188e0084c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.502352 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b1489-e694-4077-8c99-ea3188e0084c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.502883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b1489-e694-4077-8c99-ea3188e0084c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.521249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b1489-e694-4077-8c99-ea3188e0084c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:50.524748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b1489-e694-4077-8c99-ea3188e0084c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-3c1b1489-e694-4077-8c99-ea3188e0084c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:05:50.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:50.556160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:05:50.557879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:05:50.557879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:50.557879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:05:50.557879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 599/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:50.570776 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee4a25-449b-4fa5-a8e0-3123c3b859f7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:50.725094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee4a25-449b-4fa5-a8e0-3123c3b859f7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:50.766526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:50.774965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165129d-0509-4851-9f51-da2a334f465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:50.775552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165129d-0509-4851-9f51-da2a334f465f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.775820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165129d-0509-4851-9f51-da2a334f465f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.776076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165129d-0509-4851-9f51-da2a334f465f None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.776739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165129d-0509-4851-9f51-da2a334f465f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:50.777084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165129d-0509-4851-9f51-da2a334f465f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:50.778984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165129d-0509-4851-9f51-da2a334f465f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:50.797259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 605/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:50.800354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b1489-e694-4077-8c99-ea3188e0084c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:50.872164 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:50.939491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b1489-e694-4077-8c99-ea3188e0084c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:50.986757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386cc61-8b14-4434-aa86-af8c6c5b1631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:50.987471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386cc61-8b14-4434-aa86-af8c6c5b1631 None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.987936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386cc61-8b14-4434-aa86-af8c6c5b1631 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.988377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386cc61-8b14-4434-aa86-af8c6c5b1631 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.989315 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386cc61-8b14-4434-aa86-af8c6c5b1631 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:50.991932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386cc61-8b14-4434-aa86-af8c6c5b1631 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:51.019505 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 600/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 31 00:05:50 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:53.331815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76416f8b-074a-4ee8-96da-6198759f6319 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:53.332407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76416f8b-074a-4ee8-96da-6198759f6319 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:53.332508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76416f8b-074a-4ee8-96da-6198759f6319 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:53.334208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 606/1206] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:05:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:53.340328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45add68-53db-4287-8f0a-1f4e802decbd None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:53.340765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45add68-53db-4287-8f0a-1f4e802decbd None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:53.340765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45add68-53db-4287-8f0a-1f4e802decbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:53.366001 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-a45add68-53db-4287-8f0a-1f4e802decbd None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:53.367443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a45add68-53db-4287-8f0a-1f4e802decbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:53.442155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 601/1207] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:05:53.765151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76416f8b-074a-4ee8-96da-6198759f6319 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:53.893824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76416f8b-074a-4ee8-96da-6198759f6319 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:53.940228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edb87d-6e9b-40f2-93c8-03e10d472c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:53.940967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb87d-6e9b-40f2-93c8-03e10d472c31 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:53.941368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb87d-6e9b-40f2-93c8-03e10d472c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:53.941547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb87d-6e9b-40f2-93c8-03e10d472c31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:53.953503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edb87d-6e9b-40f2-93c8-03e10d472c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-06edb87d-6e9b-40f2-93c8-03e10d472c31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:53.958372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:53.959374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:53.960434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:53.960434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:53.960434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:53.960434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:53.960434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:53.960434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:53.960434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:53.960434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:53.960434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:53.960434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:53.960434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:05:53.960434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:05:53.960434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 607/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:05:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:53.966134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45add68-53db-4287-8f0a-1f4e802decbd None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:54.011737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:54.088099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45add68-53db-4287-8f0a-1f4e802decbd None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:54.132373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2780e-7355-4ddb-9d09-91489f2c5cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:54.132991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2780e-7355-4ddb-9d09-91489f2c5cfd None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.133288 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2780e-7355-4ddb-9d09-91489f2c5cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.133555 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2780e-7355-4ddb-9d09-91489f2c5cfd None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.134215 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2780e-7355-4ddb-9d09-91489f2c5cfd None admin] RBAC: Adding query filter params (name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:54.134513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2780e-7355-4ddb-9d09-91489f2c5cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:54.135878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2780e-7355-4ddb-9d09-91489f2c5cfd None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:54.145562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 602/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:05:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:54.151604 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edb87d-6e9b-40f2-93c8-03e10d472c31 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:54.210182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:54.272236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edb87d-6e9b-40f2-93c8-03e10d472c31 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:54.311296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db40fd0-134f-4cd3-b606-530d5d2dc24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:54.311924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db40fd0-134f-4cd3-b606-530d5d2dc24f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.312197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db40fd0-134f-4cd3-b606-530d5d2dc24f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.313075 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db40fd0-134f-4cd3-b606-530d5d2dc24f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.324727 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db40fd0-134f-4cd3-b606-530d5d2dc24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:54.326301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db40fd0-134f-4cd3-b606-530d5d2dc24f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-8db40fd0-134f-4cd3-b606-530d5d2dc24f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:05:54.341506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:54.343177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:05:54.344491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:05:54.344491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:54.344491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:05:54.344491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 608/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:54.349684 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2780e-7355-4ddb-9d09-91489f2c5cfd None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:54.471878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:54.475157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2780e-7355-4ddb-9d09-91489f2c5cfd None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:54.513679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f98016-c8cb-4d09-be28-5658d3c7b151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:54.514419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98016-c8cb-4d09-be28-5658d3c7b151 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.514694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98016-c8cb-4d09-be28-5658d3c7b151 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.514953 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98016-c8cb-4d09-be28-5658d3c7b151 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.515760 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f98016-c8cb-4d09-be28-5658d3c7b151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:54.516538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f98016-c8cb-4d09-be28-5658d3c7b151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:54.517944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f98016-c8cb-4d09-be28-5658d3c7b151 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:54.535909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 603/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:54.537117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db40fd0-134f-4cd3-b606-530d5d2dc24f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:54.644911 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db40fd0-134f-4cd3-b606-530d5d2dc24f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:54.646883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:54.685422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f3cf2-bb84-41e5-8dfd-9c76e4530473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:54.686055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f3cf2-bb84-41e5-8dfd-9c76e4530473 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.686318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f3cf2-bb84-41e5-8dfd-9c76e4530473 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.686658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f3cf2-bb84-41e5-8dfd-9c76e4530473 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.696310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f3cf2-bb84-41e5-8dfd-9c76e4530473 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:54.697812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f3cf2-bb84-41e5-8dfd-9c76e4530473 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-c38f3cf2-bb84-41e5-8dfd-9c76e4530473 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:05:54.710298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:54.711368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:54.712406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:54.712406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:54.712406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:05:54.712406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:05:54.712406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:05:54.712406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:05:54.712406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:05:54.712406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:05:54.712406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:05:54.712406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:05:54.712406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 609/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:05:54.719977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f98016-c8cb-4d09-be28-5658d3c7b151 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:54.833879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f98016-c8cb-4d09-be28-5658d3c7b151 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:54.874291 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee981e1-5bc2-4034-95b9-de4c58a4a003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:54.874972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee981e1-5bc2-4034-95b9-de4c58a4a003 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.875979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee981e1-5bc2-4034-95b9-de4c58a4a003 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.876234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee981e1-5bc2-4034-95b9-de4c58a4a003 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.876976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee981e1-5bc2-4034-95b9-de4c58a4a003 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:54.877376 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee981e1-5bc2-4034-95b9-de4c58a4a003 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:54.878956 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee981e1-5bc2-4034-95b9-de4c58a4a003 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:54.900023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 604/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 31 00:05:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:54.906652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f3cf2-bb84-41e5-8dfd-9c76e4530473 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.034232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f3cf2-bb84-41e5-8dfd-9c76e4530473 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.082953 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7ba8b-9725-46a3-950c-0b35f188b85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.084114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ba8b-9725-46a3-950c-0b35f188b85b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.084399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ba8b-9725-46a3-950c-0b35f188b85b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.084669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ba8b-9725-46a3-950c-0b35f188b85b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.124659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.168487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7ba8b-9725-46a3-950c-0b35f188b85b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:55.169912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7ba8b-9725-46a3-950c-0b35f188b85b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:55.287061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 610/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:05:55.293367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee981e1-5bc2-4034-95b9-de4c58a4a003 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.318504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.408211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee981e1-5bc2-4034-95b9-de4c58a4a003 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.447946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccecf9f-e074-4ea7-9f1a-ccca9339f1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.448511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccecf9f-e074-4ea7-9f1a-ccca9339f1fe None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.448780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccecf9f-e074-4ea7-9f1a-ccca9339f1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.449144 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccecf9f-e074-4ea7-9f1a-ccca9339f1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.464370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccecf9f-e074-4ea7-9f1a-ccca9339f1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:55.466348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccecf9f-e074-4ea7-9f1a-ccca9339f1fe None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-9ccecf9f-e074-4ea7-9f1a-ccca9339f1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:05:55.486627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:55.487718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:05:55.488631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:05:55.488631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:55.488631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:05:55.488631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 605/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:55.493966 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7ba8b-9725-46a3-950c-0b35f188b85b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.565337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.606634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7ba8b-9725-46a3-950c-0b35f188b85b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.642488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60d403-cf66-4ccd-b236-ad355c572979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.643233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60d403-cf66-4ccd-b236-ad355c572979 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.643505 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60d403-cf66-4ccd-b236-ad355c572979 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.643833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60d403-cf66-4ccd-b236-ad355c572979 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.644500 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60d403-cf66-4ccd-b236-ad355c572979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:55.644839 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60d403-cf66-4ccd-b236-ad355c572979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:55.646445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60d403-cf66-4ccd-b236-ad355c572979 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:55.659085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 611/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:55.665629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccecf9f-e074-4ea7-9f1a-ccca9339f1fe None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.740952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.786442 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccecf9f-e074-4ea7-9f1a-ccca9339f1fe None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.824075 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec5736-9044-4749-98d2-b05af39b9aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.824732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec5736-9044-4749-98d2-b05af39b9aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.825002 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec5736-9044-4749-98d2-b05af39b9aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.825289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec5736-9044-4749-98d2-b05af39b9aa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.833247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec5736-9044-4749-98d2-b05af39b9aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:55.834693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec5736-9044-4749-98d2-b05af39b9aa8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-a0ec5736-9044-4749-98d2-b05af39b9aa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:05:55.849073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:55.850235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:55.851259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:05:55.851259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:05:55.851259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:05:55.851259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:05:55.851259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:05:55.851259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:05:55.851259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:05:55.851259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:05:55.851259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 606/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:05:55.856246 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60d403-cf66-4ccd-b236-ad355c572979 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.971738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60d403-cf66-4ccd-b236-ad355c572979 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.996960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:56.012816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453771b2-d3d6-4d97-a591-bcde416fd018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:56.013640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453771b2-d3d6-4d97-a591-bcde416fd018 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:56.014016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453771b2-d3d6-4d97-a591-bcde416fd018 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:56.014427 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453771b2-d3d6-4d97-a591-bcde416fd018 None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:56.015345 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453771b2-d3d6-4d97-a591-bcde416fd018 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:56.015801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453771b2-d3d6-4d97-a591-bcde416fd018 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:56.017575 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453771b2-d3d6-4d97-a591-bcde416fd018 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:56.038045 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 612/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:56.039431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec5736-9044-4749-98d2-b05af39b9aa8 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:56.172358 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec5736-9044-4749-98d2-b05af39b9aa8 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:56.216006 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:56.224253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82baf9f-617f-440d-99fb-04986620f75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:56.224867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82baf9f-617f-440d-99fb-04986620f75a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:56.225137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82baf9f-617f-440d-99fb-04986620f75a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:56.225443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82baf9f-617f-440d-99fb-04986620f75a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:56.226154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82baf9f-617f-440d-99fb-04986620f75a None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=227f958b82a446e19a4d5b29d74193bd) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:56.226458 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82baf9f-617f-440d-99fb-04986620f75a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:56.228775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82baf9f-617f-440d-99fb-04986620f75a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:56.236009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 607/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:56 2022] GET /identity/v3/role_assignments?user.id=227f958b82a446e19a4d5b29d74193bd&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:58.352068 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dc4d9-42dc-4bea-847f-bfee5b97f819 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.352613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dc4d9-42dc-4bea-847f-bfee5b97f819 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.352613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dc4d9-42dc-4bea-847f-bfee5b97f819 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.353912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 613/1220] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:58.359317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7b42-83bd-4c0a-ae63-56a321c243ed None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.359773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7b42-83bd-4c0a-ae63-56a321c243ed None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.359884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7b42-83bd-4c0a-ae63-56a321c243ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.382114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-84fb7b42-83bd-4c0a-ae63-56a321c243ed None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:58.383332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-84fb7b42-83bd-4c0a-ae63-56a321c243ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:58.461822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 608/1221] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:05:58.737102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dc4d9-42dc-4bea-847f-bfee5b97f819 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:58.851785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dc4d9-42dc-4bea-847f-bfee5b97f819 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:58.885974 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d81d5-0d51-41a1-b0a4-ba69f5e0a2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:58.886611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d81d5-0d51-41a1-b0a4-ba69f5e0a2eb None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.886949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d81d5-0d51-41a1-b0a4-ba69f5e0a2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.887214 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d81d5-0d51-41a1-b0a4-ba69f5e0a2eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.898693 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d81d5-0d51-41a1-b0a4-ba69f5e0a2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-4d2d81d5-0d51-41a1-b0a4-ba69f5e0a2eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:58.904828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:58.906001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:58.907236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:58.907236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:58.907236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:58.907236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:58.907236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:58.907236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:58.907236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:58.907236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:58.907236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:58.907236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:58.907236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:05:58.907236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:05:58.907236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 614/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:05:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:58.912649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7b42-83bd-4c0a-ae63-56a321c243ed None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:59.017258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7b42-83bd-4c0a-ae63-56a321c243ed None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:59.041323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:59.053127 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2b646-63ee-454e-b3e4-b695229a9cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:59.053766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2b646-63ee-454e-b3e4-b695229a9cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:59.054057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2b646-63ee-454e-b3e4-b695229a9cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:59.054317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2b646-63ee-454e-b3e4-b695229a9cd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:59.054975 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2b646-63ee-454e-b3e4-b695229a9cd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:59.055273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2b646-63ee-454e-b3e4-b695229a9cd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:59.056624 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2b646-63ee-454e-b3e4-b695229a9cd7 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:59.065458 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 609/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:05:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:59.071739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d81d5-0d51-41a1-b0a4-ba69f5e0a2eb None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:59.122427 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:59.181234 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d81d5-0d51-41a1-b0a4-ba69f5e0a2eb None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:59.217538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccda54-f4b8-4d58-ba61-5cb0546ad45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:59.218178 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccda54-f4b8-4d58-ba61-5cb0546ad45f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:59.218487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccda54-f4b8-4d58-ba61-5cb0546ad45f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:59.218746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccda54-f4b8-4d58-ba61-5cb0546ad45f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:59.230589 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccda54-f4b8-4d58-ba61-5cb0546ad45f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:59.232026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccda54-f4b8-4d58-ba61-5cb0546ad45f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-deccda54-f4b8-4d58-ba61-5cb0546ad45f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:05:59.246946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:59.248069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:05:59.249142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:05:59.249142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:59.249142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:05:59.249142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 615/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:59.254274 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2b646-63ee-454e-b3e4-b695229a9cd7 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:59.356139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2b646-63ee-454e-b3e4-b695229a9cd7 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:59.392565 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44194be1-5079-410a-a288-aea5d515128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:59.394061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44194be1-5079-410a-a288-aea5d515128f None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:59.394061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44194be1-5079-410a-a288-aea5d515128f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:59.394061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44194be1-5079-410a-a288-aea5d515128f None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:59.394435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44194be1-5079-410a-a288-aea5d515128f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:59.394734 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44194be1-5079-410a-a288-aea5d515128f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:59.396094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44194be1-5079-410a-a288-aea5d515128f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:59.410262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 610/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:59.416100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccda54-f4b8-4d58-ba61-5cb0546ad45f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:59.518959 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:59.528538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccda54-f4b8-4d58-ba61-5cb0546ad45f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:59.563638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab853693-7c10-4763-8086-2211ef2e6b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:59.564323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab853693-7c10-4763-8086-2211ef2e6b91 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:59.564590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab853693-7c10-4763-8086-2211ef2e6b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:59.564852 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab853693-7c10-4763-8086-2211ef2e6b91 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:59.573265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab853693-7c10-4763-8086-2211ef2e6b91 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:59.575006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab853693-7c10-4763-8086-2211ef2e6b91 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-ab853693-7c10-4763-8086-2211ef2e6b91 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:05:59.588204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:59.589408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:59.590705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:59.590705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:59.590705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:05:59.590705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:05:59.590705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:05:59.590705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:05:59.590705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:05:59.590705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:05:59.590705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:05:59.590705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:05:59.590705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 616/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:59.595680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44194be1-5079-410a-a288-aea5d515128f None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:59.647130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:59.706567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44194be1-5079-410a-a288-aea5d515128f None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:59.742919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cb714-406e-4ecd-a7c4-7f9077b39ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:59.743549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cb714-406e-4ecd-a7c4-7f9077b39ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:59.743909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cb714-406e-4ecd-a7c4-7f9077b39ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:59.744251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cb714-406e-4ecd-a7c4-7f9077b39ac6 None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:59.745123 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cb714-406e-4ecd-a7c4-7f9077b39ac6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:59.745541 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cb714-406e-4ecd-a7c4-7f9077b39ac6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:59.747422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cb714-406e-4ecd-a7c4-7f9077b39ac6 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:59.767355 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 611/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 31 00:05:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:59.773279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab853693-7c10-4763-8086-2211ef2e6b91 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:59.900002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab853693-7c10-4763-8086-2211ef2e6b91 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:59.947347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473016e1-bf67-4469-b7b1-8c4e47aeb733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:59.948346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473016e1-bf67-4469-b7b1-8c4e47aeb733 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:59.948675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473016e1-bf67-4469-b7b1-8c4e47aeb733 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:59.949065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473016e1-bf67-4469-b7b1-8c4e47aeb733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:59.961845 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473016e1-bf67-4469-b7b1-8c4e47aeb733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:59.963282 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473016e1-bf67-4469-b7b1-8c4e47aeb733 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-473016e1-bf67-4469-b7b1-8c4e47aeb733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:05:59.978152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:59.984453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:05:59.985471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:05:59.985471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:59.985471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:05:59.985471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 617/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:59.985708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cb714-406e-4ecd-a7c4-7f9077b39ac6 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:00.090338 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cb714-406e-4ecd-a7c4-7f9077b39ac6 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:00.093015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:00.127469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb710d08-dd31-43b4-a9d9-977ee8e9da53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:00.128079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb710d08-dd31-43b4-a9d9-977ee8e9da53 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:00.128390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb710d08-dd31-43b4-a9d9-977ee8e9da53 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:00.128662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb710d08-dd31-43b4-a9d9-977ee8e9da53 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:00.129481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb710d08-dd31-43b4-a9d9-977ee8e9da53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:00.129786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb710d08-dd31-43b4-a9d9-977ee8e9da53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:00.131136 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb710d08-dd31-43b4-a9d9-977ee8e9da53 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:00.143695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 612/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:00.149844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473016e1-bf67-4469-b7b1-8c4e47aeb733 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:00.160068 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:00.262656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473016e1-bf67-4469-b7b1-8c4e47aeb733 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:00.296927 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c582f3-b4ea-4726-9ab8-63674ad58bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:00.297582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c582f3-b4ea-4726-9ab8-63674ad58bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:00.297851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c582f3-b4ea-4726-9ab8-63674ad58bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:00.298114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c582f3-b4ea-4726-9ab8-63674ad58bd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:00.304817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c582f3-b4ea-4726-9ab8-63674ad58bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:00.306287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c582f3-b4ea-4726-9ab8-63674ad58bd4 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-d4c582f3-b4ea-4726-9ab8-63674ad58bd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:00.317582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:00.318902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:00.320172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:00.320172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:00.320172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:00.320172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:00.320172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:00.320172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:00.320172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:00.320172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:00.320172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 618/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:00.324699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb710d08-dd31-43b4-a9d9-977ee8e9da53 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:00.432700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb710d08-dd31-43b4-a9d9-977ee8e9da53 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:00.474386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb99cd-2216-4dfa-a4c0-2864238b255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:00.474975 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb99cd-2216-4dfa-a4c0-2864238b255d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:00.475278 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb99cd-2216-4dfa-a4c0-2864238b255d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:00.475593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb99cd-2216-4dfa-a4c0-2864238b255d None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:00.476240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb99cd-2216-4dfa-a4c0-2864238b255d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:00.476582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb99cd-2216-4dfa-a4c0-2864238b255d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:00.478395 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb99cd-2216-4dfa-a4c0-2864238b255d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:00.492356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 613/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:00.498597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c582f3-b4ea-4726-9ab8-63674ad58bd4 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:00.574111 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:00.614109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c582f3-b4ea-4726-9ab8-63674ad58bd4 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:00.652920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28081f-6f58-43df-bb1b-5d84af1789cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:00.653616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28081f-6f58-43df-bb1b-5d84af1789cb None admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:00.653894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28081f-6f58-43df-bb1b-5d84af1789cb None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:00.654172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28081f-6f58-43df-bb1b-5d84af1789cb None admin] PATH_INFO: `/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/227f958b82a446e19a4d5b29d74193bd/roles/25b5ec65e62b4d48881026cb00fbd74f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:00.671193 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28081f-6f58-43df-bb1b-5d84af1789cb None admin] RBAC: Authorizing `identity:create_grant(project_id=204574e6a3c34ca4a7c266b5549bfdfa, user_id=227f958b82a446e19a4d5b29d74193bd, role_id=25b5ec65e62b4d48881026cb00fbd74f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:00.673105 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28081f-6f58-43df-bb1b-5d84af1789cb None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:00.686626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 619/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:00 2022] PUT /identity/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/227f958b82a446e19a4d5b29d74193bd/roles/25b5ec65e62b4d48881026cb00fbd74f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:02.759370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f7c2-e5f4-4e09-851d-f62ad3937ee0 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.759938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f7c2-e5f4-4e09-851d-f62ad3937ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.760055 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f7c2-e5f4-4e09-851d-f62ad3937ee0 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.761452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 614/1233] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:02.767159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e9e4f-a095-455c-9506-aa2d66d637fb None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.767635 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e9e4f-a095-455c-9506-aa2d66d637fb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.767743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e9e4f-a095-455c-9506-aa2d66d637fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.788467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-b80e9e4f-a095-455c-9506-aa2d66d637fb None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:02.789687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b80e9e4f-a095-455c-9506-aa2d66d637fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:02.861981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 620/1234] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:06:03.142027 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8f7c2-e5f4-4e09-851d-f62ad3937ee0 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.169855 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.259163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8f7c2-e5f4-4e09-851d-f62ad3937ee0 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.297415 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079cfc4-8b44-4a37-a553-692f6f091677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.298110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079cfc4-8b44-4a37-a553-692f6f091677 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.298373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079cfc4-8b44-4a37-a553-692f6f091677 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.298571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079cfc4-8b44-4a37-a553-692f6f091677 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.309609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079cfc4-8b44-4a37-a553-692f6f091677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-9079cfc4-8b44-4a37-a553-692f6f091677 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:03.314446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:03.317651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:03.318704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:03.318704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:03.318704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:03.318704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:03.318704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:03.318704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:03.318704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:03.318704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:03.318704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:03.318704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:03.318704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:03.318704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:06:03.318704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 615/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:03.321755 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e9e4f-a095-455c-9506-aa2d66d637fb None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.372217 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.431857 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e9e4f-a095-455c-9506-aa2d66d637fb None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.471196 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ae736-0f12-4a43-988d-b66af50a48ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.471798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae736-0f12-4a43-988d-b66af50a48ac None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.472064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae736-0f12-4a43-988d-b66af50a48ac None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.472334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae736-0f12-4a43-988d-b66af50a48ac None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.473003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ae736-0f12-4a43-988d-b66af50a48ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:03.473318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ae736-0f12-4a43-988d-b66af50a48ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:03.474751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ae736-0f12-4a43-988d-b66af50a48ac None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:03.484208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 621/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:03.490224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079cfc4-8b44-4a37-a553-692f6f091677 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.581500 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.601526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079cfc4-8b44-4a37-a553-692f6f091677 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.639932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ba771-0e93-4b46-bcd2-237396891c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.640719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ba771-0e93-4b46-bcd2-237396891c1a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.640999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ba771-0e93-4b46-bcd2-237396891c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.641311 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ba771-0e93-4b46-bcd2-237396891c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.653656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ba771-0e93-4b46-bcd2-237396891c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:03.655103 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ba771-0e93-4b46-bcd2-237396891c1a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-908ba771-0e93-4b46-bcd2-237396891c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:03.672519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:03.673785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:03.674890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:03.674890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:03.674890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:06:03.674890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 616/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:03.679975 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ae736-0f12-4a43-988d-b66af50a48ac None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.795020 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ae736-0f12-4a43-988d-b66af50a48ac None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.804820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.830472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579563f-3fb1-4093-a382-d3df79aa971b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.831072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579563f-3fb1-4093-a382-d3df79aa971b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.831341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579563f-3fb1-4093-a382-d3df79aa971b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.831604 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579563f-3fb1-4093-a382-d3df79aa971b None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.832289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579563f-3fb1-4093-a382-d3df79aa971b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:03.833175 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579563f-3fb1-4093-a382-d3df79aa971b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:03.834559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579563f-3fb1-4093-a382-d3df79aa971b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:03.846480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 622/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:03.852356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ba771-0e93-4b46-bcd2-237396891c1a None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.961160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ba771-0e93-4b46-bcd2-237396891c1a None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.997800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b383e3-04d3-496c-b049-88774fa40273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.998430 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b383e3-04d3-496c-b049-88774fa40273 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.998704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b383e3-04d3-496c-b049-88774fa40273 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.998970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b383e3-04d3-496c-b049-88774fa40273 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.001698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.008022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b383e3-04d3-496c-b049-88774fa40273 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.009891 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b383e3-04d3-496c-b049-88774fa40273 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-59b383e3-04d3-496c-b049-88774fa40273 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:04.021561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:04.022811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:04.023962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:04.023962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:04.023962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:04.023962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:04.023962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:04.023962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:04.023962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:04.023962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:04.023962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:06:04.023962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:06:04.028189 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 617/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:04.029276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579563f-3fb1-4093-a382-d3df79aa971b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.133552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579563f-3fb1-4093-a382-d3df79aa971b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.168568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c9d5e-4975-4134-ad0d-07d92405d6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.169147 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c9d5e-4975-4134-ad0d-07d92405d6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.169440 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c9d5e-4975-4134-ad0d-07d92405d6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.169709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c9d5e-4975-4134-ad0d-07d92405d6c6 None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.170438 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c9d5e-4975-4134-ad0d-07d92405d6c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:04.170739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c9d5e-4975-4134-ad0d-07d92405d6c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.172285 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c9d5e-4975-4134-ad0d-07d92405d6c6 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.192543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 623/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:04.198299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b383e3-04d3-496c-b049-88774fa40273 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.310093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b383e3-04d3-496c-b049-88774fa40273 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.347804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dade9d-d763-474d-91e6-2b2150c09626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.348611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dade9d-d763-474d-91e6-2b2150c09626 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.348889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dade9d-d763-474d-91e6-2b2150c09626 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.349152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dade9d-d763-474d-91e6-2b2150c09626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.419322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.427661 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dade9d-d763-474d-91e6-2b2150c09626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.429549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dade9d-d763-474d-91e6-2b2150c09626 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.562399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 618/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:06:04.568343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c9d5e-4975-4134-ad0d-07d92405d6c6 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.596510 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.684964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c9d5e-4975-4134-ad0d-07d92405d6c6 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.735266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53956c6-831b-4696-8e80-c4cef4e6f636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.735908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53956c6-831b-4696-8e80-c4cef4e6f636 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.736189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53956c6-831b-4696-8e80-c4cef4e6f636 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.736455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53956c6-831b-4696-8e80-c4cef4e6f636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.747215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53956c6-831b-4696-8e80-c4cef4e6f636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.748648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53956c6-831b-4696-8e80-c4cef4e6f636 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-c53956c6-831b-4696-8e80-c4cef4e6f636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:04.763055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:04.764200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:04.765531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:04.765531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:04.765531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:04.765531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 624/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:04.770091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dade9d-d763-474d-91e6-2b2150c09626 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.871445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.879293 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dade9d-d763-474d-91e6-2b2150c09626 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.919454 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3a880-4e83-4e71-b266-cc5d27415c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.920085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3a880-4e83-4e71-b266-cc5d27415c7f None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.920359 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3a880-4e83-4e71-b266-cc5d27415c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.920658 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3a880-4e83-4e71-b266-cc5d27415c7f None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.921471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3a880-4e83-4e71-b266-cc5d27415c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:04.921768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3a880-4e83-4e71-b266-cc5d27415c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.923190 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3a880-4e83-4e71-b266-cc5d27415c7f None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.935967 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 619/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:04.942036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53956c6-831b-4696-8e80-c4cef4e6f636 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.036104 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:05.060174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53956c6-831b-4696-8e80-c4cef4e6f636 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.103130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1419d-870b-47c8-9782-9067cdbb97a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.103761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1419d-870b-47c8-9782-9067cdbb97a0 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.104028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1419d-870b-47c8-9782-9067cdbb97a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.104291 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1419d-870b-47c8-9782-9067cdbb97a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.113925 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1419d-870b-47c8-9782-9067cdbb97a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.116704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1419d-870b-47c8-9782-9067cdbb97a0 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-b6f1419d-870b-47c8-9782-9067cdbb97a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:05.129315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:05.131151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:05.133128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:05.133128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:05.133128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:05.133128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:05.133128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:05.133128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:05.133128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:05.133128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:05.133128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 625/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:05.136636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3a880-4e83-4e71-b266-cc5d27415c7f None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.265453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3a880-4e83-4e71-b266-cc5d27415c7f None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.304750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b1fff-73e3-4679-8ad4-8c9b5bc39fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.305519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b1fff-73e3-4679-8ad4-8c9b5bc39fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.305816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b1fff-73e3-4679-8ad4-8c9b5bc39fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.306083 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b1fff-73e3-4679-8ad4-8c9b5bc39fd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.306803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b1fff-73e3-4679-8ad4-8c9b5bc39fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:05.307169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b1fff-73e3-4679-8ad4-8c9b5bc39fd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.308683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b1fff-73e3-4679-8ad4-8c9b5bc39fd1 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.327715 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 620/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:05.334579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1419d-870b-47c8-9782-9067cdbb97a0 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.455830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1419d-870b-47c8-9782-9067cdbb97a0 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.503482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0691b-8641-4fb3-a981-4765588217b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.504181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0691b-8641-4fb3-a981-4765588217b8 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.504513 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0691b-8641-4fb3-a981-4765588217b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.504790 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0691b-8641-4fb3-a981-4765588217b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.505542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0691b-8641-4fb3-a981-4765588217b8 None admin] RBAC: Adding query filter params (role.id=25b5ec65e62b4d48881026cb00fbd74f, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=227f958b82a446e19a4d5b29d74193bd) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:05.505913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0691b-8641-4fb3-a981-4765588217b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.507342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0691b-8641-4fb3-a981-4765588217b8 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.513667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 626/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:05 2022] GET /identity/v3/role_assignments?user.id=227f958b82a446e19a4d5b29d74193bd&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=25b5ec65e62b4d48881026cb00fbd74f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:07.662721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffb1f-23ef-4d6d-9283-56ff5fab6a82 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:07.663331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffb1f-23ef-4d6d-9283-56ff5fab6a82 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:07.663331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffb1f-23ef-4d6d-9283-56ff5fab6a82 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:07.665243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 621/1247] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:07.674645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c65b24-7211-4142-be24-56f5731d96f3 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:07.675132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c65b24-7211-4142-be24-56f5731d96f3 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:07.675534 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c65b24-7211-4142-be24-56f5731d96f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:07.686627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:07.699987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-28c65b24-7211-4142-be24-56f5731d96f3 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:07.701307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-28c65b24-7211-4142-be24-56f5731d96f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:07.782820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 627/1248] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:06:08.059538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ffb1f-23ef-4d6d-9283-56ff5fab6a82 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:08.084253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:08.177951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ffb1f-23ef-4d6d-9283-56ff5fab6a82 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:08.218254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed976b-d1e0-4d18-ab2d-1dba1bb55776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:08.219032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed976b-d1e0-4d18-ab2d-1dba1bb55776 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.219313 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed976b-d1e0-4d18-ab2d-1dba1bb55776 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.219582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed976b-d1e0-4d18-ab2d-1dba1bb55776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.231999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed976b-d1e0-4d18-ab2d-1dba1bb55776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-bfed976b-d1e0-4d18-ab2d-1dba1bb55776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:08.237755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:08.239235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:08.240607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:08.240607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:08.240607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:08.240607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:08.240607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:08.240607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:08.240607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:08.240607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:08.240607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:08.240607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:08.240607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:08.240607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:06:08.240607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 622/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:08.245134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c65b24-7211-4142-be24-56f5731d96f3 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:08.356123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c65b24-7211-4142-be24-56f5731d96f3 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:08.389181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:08.395016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8f24d-7dc4-4cef-bea2-9af6aa20bc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:08.395627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8f24d-7dc4-4cef-bea2-9af6aa20bc1c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.395890 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8f24d-7dc4-4cef-bea2-9af6aa20bc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.396155 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8f24d-7dc4-4cef-bea2-9af6aa20bc1c None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.396894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8f24d-7dc4-4cef-bea2-9af6aa20bc1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:08.397144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8f24d-7dc4-4cef-bea2-9af6aa20bc1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:08.398577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8f24d-7dc4-4cef-bea2-9af6aa20bc1c None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:08.408673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 628/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:08.414241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed976b-d1e0-4d18-ab2d-1dba1bb55776 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:08.502110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:08.527841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed976b-d1e0-4d18-ab2d-1dba1bb55776 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:08.564548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd49841-971b-48db-8180-c773780079cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:08.565320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd49841-971b-48db-8180-c773780079cb None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.565595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd49841-971b-48db-8180-c773780079cb None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.565859 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd49841-971b-48db-8180-c773780079cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.576919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd49841-971b-48db-8180-c773780079cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:08.578699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd49841-971b-48db-8180-c773780079cb None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-7bd49841-971b-48db-8180-c773780079cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:08.593304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:08.594569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:08.595664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:08.595664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:08.595664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:06:08.595664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 623/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:08.600742 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8f24d-7dc4-4cef-bea2-9af6aa20bc1c None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:08.713633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8f24d-7dc4-4cef-bea2-9af6aa20bc1c None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:08.749953 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c44e06-4509-4763-b456-cc12d0d2920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:08.750544 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c44e06-4509-4763-b456-cc12d0d2920f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.750857 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c44e06-4509-4763-b456-cc12d0d2920f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.751136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c44e06-4509-4763-b456-cc12d0d2920f None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.751894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c44e06-4509-4763-b456-cc12d0d2920f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:08.752205 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c44e06-4509-4763-b456-cc12d0d2920f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:08.753853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c44e06-4509-4763-b456-cc12d0d2920f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:08.768302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 629/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:08.775579 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd49841-971b-48db-8180-c773780079cb None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:08.904590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd49841-971b-48db-8180-c773780079cb None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:08.932533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:08.940267 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c9d59-af7f-4fb0-aa53-164cc98651cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:08.940900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c9d59-af7f-4fb0-aa53-164cc98651cc None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.941173 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c9d59-af7f-4fb0-aa53-164cc98651cc None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.941472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c9d59-af7f-4fb0-aa53-164cc98651cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.949321 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c9d59-af7f-4fb0-aa53-164cc98651cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:08.950757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c9d59-af7f-4fb0-aa53-164cc98651cc None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-d78c9d59-af7f-4fb0-aa53-164cc98651cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:08.962339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:08.963446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:08.964657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:08.964657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:08.964657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:08.964657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:08.964657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:08.964657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:08.964657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:08.964657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:08.964657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:06:08.964657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:06:08.964657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 624/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:08.971829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c44e06-4509-4763-b456-cc12d0d2920f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.031112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:09.077356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c44e06-4509-4763-b456-cc12d0d2920f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.113080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abceac-f7cc-4d94-bacc-888abf7af34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.113715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abceac-f7cc-4d94-bacc-888abf7af34b None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.113975 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abceac-f7cc-4d94-bacc-888abf7af34b None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.114241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abceac-f7cc-4d94-bacc-888abf7af34b None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.114969 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abceac-f7cc-4d94-bacc-888abf7af34b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:09.115268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abceac-f7cc-4d94-bacc-888abf7af34b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:09.116692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abceac-f7cc-4d94-bacc-888abf7af34b None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:09.134159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 630/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 31 00:06:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:09.140863 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c9d59-af7f-4fb0-aa53-164cc98651cc None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.245490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c9d59-af7f-4fb0-aa53-164cc98651cc None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.280785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651fde5-7cc3-43f3-a507-6d6079a82d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.281430 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651fde5-7cc3-43f3-a507-6d6079a82d58 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.281711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651fde5-7cc3-43f3-a507-6d6079a82d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.281982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651fde5-7cc3-43f3-a507-6d6079a82d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.339046 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:09.351915 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651fde5-7cc3-43f3-a507-6d6079a82d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:09.353446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651fde5-7cc3-43f3-a507-6d6079a82d58 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:09.461134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 625/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:06:09.467287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abceac-f7cc-4d94-bacc-888abf7af34b None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.577490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abceac-f7cc-4d94-bacc-888abf7af34b None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.590431 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:09.614648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93789380-fa6c-4bfc-ae8b-601b3d959e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.615458 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789380-fa6c-4bfc-ae8b-601b3d959e2d None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.615791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789380-fa6c-4bfc-ae8b-601b3d959e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.616171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789380-fa6c-4bfc-ae8b-601b3d959e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.631550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93789380-fa6c-4bfc-ae8b-601b3d959e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:09.633071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93789380-fa6c-4bfc-ae8b-601b3d959e2d None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-93789380-fa6c-4bfc-ae8b-601b3d959e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:09.652980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:09.654320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:09.655206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:09.655206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:09.655206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:09.655206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 631/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:09.660951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651fde5-7cc3-43f3-a507-6d6079a82d58 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.772496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:09.787522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651fde5-7cc3-43f3-a507-6d6079a82d58 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.825845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb87b7f-b06b-404e-b720-647bbd70d308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.826554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb87b7f-b06b-404e-b720-647bbd70d308 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.826893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb87b7f-b06b-404e-b720-647bbd70d308 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.827152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb87b7f-b06b-404e-b720-647bbd70d308 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.828370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb87b7f-b06b-404e-b720-647bbd70d308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:09.828370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb87b7f-b06b-404e-b720-647bbd70d308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:09.829763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb87b7f-b06b-404e-b720-647bbd70d308 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:09.841905 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 626/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:09.848189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93789380-fa6c-4bfc-ae8b-601b3d959e2d None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.959382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93789380-fa6c-4bfc-ae8b-601b3d959e2d None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.995259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4ca73-cfc6-4e44-b7da-3a6585d8dbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.998070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4ca73-cfc6-4e44-b7da-3a6585d8dbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.998070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4ca73-cfc6-4e44-b7da-3a6585d8dbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.998070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4ca73-cfc6-4e44-b7da-3a6585d8dbf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.004076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4ca73-cfc6-4e44-b7da-3a6585d8dbf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:10.005641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4ca73-cfc6-4e44-b7da-3a6585d8dbf6 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-d8d4ca73-cfc6-4e44-b7da-3a6585d8dbf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:10.020255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:10.021867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:10.023182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:10.023182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:10.023182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:10.023182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:10.023182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:10.023182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:10.023182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:10.023182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:10.026505 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 632/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:10.028966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb87b7f-b06b-404e-b720-647bbd70d308 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:10.150635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb87b7f-b06b-404e-b720-647bbd70d308 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:10.194590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f595ab-b782-4206-840b-a815a27d1a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:10.195290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f595ab-b782-4206-840b-a815a27d1a50 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.195572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f595ab-b782-4206-840b-a815a27d1a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.195904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f595ab-b782-4206-840b-a815a27d1a50 None admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.196568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f595ab-b782-4206-840b-a815a27d1a50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:10.196866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f595ab-b782-4206-840b-a815a27d1a50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:10.198381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f595ab-b782-4206-840b-a815a27d1a50 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:10.211292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 627/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:10.217500 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4ca73-cfc6-4e44-b7da-3a6585d8dbf6 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:10.244442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:10.325957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4ca73-cfc6-4e44-b7da-3a6585d8dbf6 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:10.370747 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fdc8f-dc85-49c6-93d2-104e190b4a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:10.371606 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fdc8f-dc85-49c6-93d2-104e190b4a74 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.372032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fdc8f-dc85-49c6-93d2-104e190b4a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.372448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fdc8f-dc85-49c6-93d2-104e190b4a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.373386 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fdc8f-dc85-49c6-93d2-104e190b4a74 None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=227f958b82a446e19a4d5b29d74193bd) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:10.373742 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fdc8f-dc85-49c6-93d2-104e190b4a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:10.375496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fdc8f-dc85-49c6-93d2-104e190b4a74 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:10.390522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 633/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:10 2022] GET /identity/v3/role_assignments?user.id=227f958b82a446e19a4d5b29d74193bd&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:12.467133 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77762ff0-e4d5-4faa-a778-84eccd00bce0 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.467739 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77762ff0-e4d5-4faa-a778-84eccd00bce0 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.467739 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77762ff0-e4d5-4faa-a778-84eccd00bce0 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.469065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 628/1261] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:12.475525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa346cb-5f82-475b-ab3a-b151401ea8ba None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.476049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa346cb-5f82-475b-ab3a-b151401ea8ba None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.476049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa346cb-5f82-475b-ab3a-b151401ea8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.499450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-daa346cb-5f82-475b-ab3a-b151401ea8ba None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:12.500885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-daa346cb-5f82-475b-ab3a-b151401ea8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:12.573403 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 634/1262] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:06:12.838861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77762ff0-e4d5-4faa-a778-84eccd00bce0 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.858373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:12.961588 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77762ff0-e4d5-4faa-a778-84eccd00bce0 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.002441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3abaa-340b-43a4-b3cb-914a5fb74c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.003059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3abaa-340b-43a4-b3cb-914a5fb74c44 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.003333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3abaa-340b-43a4-b3cb-914a5fb74c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.003595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3abaa-340b-43a4-b3cb-914a5fb74c44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.015601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3abaa-340b-43a4-b3cb-914a5fb74c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-5af3abaa-340b-43a4-b3cb-914a5fb74c44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:13.020435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:13.021614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:13.022559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:13.022559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:13.022559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:13.022559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:13.022559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:13.022559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:13.022559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:13.022559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:13.022559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:13.022559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:13.022559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:13.022559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:06:13.022559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 629/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:13.028582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa346cb-5f82-475b-ab3a-b151401ea8ba None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.048450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.133164 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa346cb-5f82-475b-ab3a-b151401ea8ba None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.172510 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc51dd7-5958-444a-9df0-ac5025981b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.173113 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc51dd7-5958-444a-9df0-ac5025981b37 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.173424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc51dd7-5958-444a-9df0-ac5025981b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.173695 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc51dd7-5958-444a-9df0-ac5025981b37 None admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.174360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc51dd7-5958-444a-9df0-ac5025981b37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:13.174657 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc51dd7-5958-444a-9df0-ac5025981b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.176048 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc51dd7-5958-444a-9df0-ac5025981b37 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.184184 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 635/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:13.190299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3abaa-340b-43a4-b3cb-914a5fb74c44 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.258345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.293185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3abaa-340b-43a4-b3cb-914a5fb74c44 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.329794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20f56e-c118-48c4-ad0f-e18c7c6eda86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.330409 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20f56e-c118-48c4-ad0f-e18c7c6eda86 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.330684 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20f56e-c118-48c4-ad0f-e18c7c6eda86 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.330955 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20f56e-c118-48c4-ad0f-e18c7c6eda86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.341711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20f56e-c118-48c4-ad0f-e18c7c6eda86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.343090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20f56e-c118-48c4-ad0f-e18c7c6eda86 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-3f20f56e-c118-48c4-ad0f-e18c7c6eda86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:13.358181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:13.359556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:13.360577 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:13.360577 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:13.360577 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:06:13.360577 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 630/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:13.365414 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc51dd7-5958-444a-9df0-ac5025981b37 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.461710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.488072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc51dd7-5958-444a-9df0-ac5025981b37 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.522935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a488f6c-cf04-4d2d-9cbc-ac64bae2f9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.523534 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488f6c-cf04-4d2d-9cbc-ac64bae2f9ac None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.523801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488f6c-cf04-4d2d-9cbc-ac64bae2f9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.524065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488f6c-cf04-4d2d-9cbc-ac64bae2f9ac None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.524690 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a488f6c-cf04-4d2d-9cbc-ac64bae2f9ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:13.524981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a488f6c-cf04-4d2d-9cbc-ac64bae2f9ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.526367 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a488f6c-cf04-4d2d-9cbc-ac64bae2f9ac None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.538032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 636/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:13.546621 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20f56e-c118-48c4-ad0f-e18c7c6eda86 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.654511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20f56e-c118-48c4-ad0f-e18c7c6eda86 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.675365 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.691350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf07079-02e6-4448-be9a-5d1c7a5059ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.691966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf07079-02e6-4448-be9a-5d1c7a5059ea None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.692255 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf07079-02e6-4448-be9a-5d1c7a5059ea None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.692502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf07079-02e6-4448-be9a-5d1c7a5059ea None admin] PATH_INFO: `/v3/users/placement` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.700339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf07079-02e6-4448-be9a-5d1c7a5059ea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.701840 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf07079-02e6-4448-be9a-5d1c7a5059ea None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-cdf07079-02e6-4448-be9a-5d1c7a5059ea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:13.715426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:13.716468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:13.717552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:13.717552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:13.717552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:13.717552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:13.717552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:13.717552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:13.717552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:13.717552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:13.717552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:06:13.717552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:06:13.717552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 631/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:13.723297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a488f6c-cf04-4d2d-9cbc-ac64bae2f9ac None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.836943 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a488f6c-cf04-4d2d-9cbc-ac64bae2f9ac None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.872482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15918be1-76ee-4416-b2b1-93419457a1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.873080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15918be1-76ee-4416-b2b1-93419457a1fa None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.873566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15918be1-76ee-4416-b2b1-93419457a1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.873838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15918be1-76ee-4416-b2b1-93419457a1fa None admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.874661 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15918be1-76ee-4416-b2b1-93419457a1fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:13.875194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15918be1-76ee-4416-b2b1-93419457a1fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.876676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15918be1-76ee-4416-b2b1-93419457a1fa None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.885522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.897582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 637/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:13.903844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf07079-02e6-4448-be9a-5d1c7a5059ea None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.012187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf07079-02e6-4448-be9a-5d1c7a5059ea None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.052206 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40f932-09b2-4d64-a018-caa06bc3c1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.052832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40f932-09b2-4d64-a018-caa06bc3c1bc None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.053109 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40f932-09b2-4d64-a018-caa06bc3c1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.053415 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40f932-09b2-4d64-a018-caa06bc3c1bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.064966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40f932-09b2-4d64-a018-caa06bc3c1bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.066435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40f932-09b2-4d64-a018-caa06bc3c1bc None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-de40f932-09b2-4d64-a018-caa06bc3c1bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:14.081635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:14.082730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:14.083836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:14.083836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:14.083836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:06:14.083836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 632/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:14.089037 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15918be1-76ee-4416-b2b1-93419457a1fa None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.196123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15918be1-76ee-4416-b2b1-93419457a1fa None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.241832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251872b-9742-4870-b329-c30c276b5252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.242419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251872b-9742-4870-b329-c30c276b5252 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.242710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251872b-9742-4870-b329-c30c276b5252 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.242959 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251872b-9742-4870-b329-c30c276b5252 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.243590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251872b-9742-4870-b329-c30c276b5252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:14.243883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251872b-9742-4870-b329-c30c276b5252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.245253 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251872b-9742-4870-b329-c30c276b5252 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.256812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 638/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:14.266653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40f932-09b2-4d64-a018-caa06bc3c1bc None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.304312 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:14.383835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40f932-09b2-4d64-a018-caa06bc3c1bc None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.419520 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdebed9-1aa3-44ba-b236-84fba49f12ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.420136 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdebed9-1aa3-44ba-b236-84fba49f12ba None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.420405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdebed9-1aa3-44ba-b236-84fba49f12ba None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.420697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdebed9-1aa3-44ba-b236-84fba49f12ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.427693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdebed9-1aa3-44ba-b236-84fba49f12ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.429106 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdebed9-1aa3-44ba-b236-84fba49f12ba None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-7cdebed9-1aa3-44ba-b236-84fba49f12ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:14.442543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:14.443616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:14.444530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:14.444530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:14.444530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:14.444530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:14.444530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:14.444530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:14.444530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:14.444530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:06:14.444530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 633/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:14.450452 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251872b-9742-4870-b329-c30c276b5252 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.519530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:14.563289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251872b-9742-4870-b329-c30c276b5252 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.606171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8488d-f10b-448b-9598-54cba369ea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.607048 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8488d-f10b-448b-9598-54cba369ea35 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.607400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8488d-f10b-448b-9598-54cba369ea35 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.607735 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8488d-f10b-448b-9598-54cba369ea35 None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.608797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8488d-f10b-448b-9598-54cba369ea35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:14.609536 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8488d-f10b-448b-9598-54cba369ea35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.610848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8488d-f10b-448b-9598-54cba369ea35 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.628598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 639/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:14.638025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdebed9-1aa3-44ba-b236-84fba49f12ba None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.749308 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:14.759713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdebed9-1aa3-44ba-b236-84fba49f12ba None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.796239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6a1e2-8268-4566-9432-f4ec9666cba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.797388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6a1e2-8268-4566-9432-f4ec9666cba1 None admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.797644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6a1e2-8268-4566-9432-f4ec9666cba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.797939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6a1e2-8268-4566-9432-f4ec9666cba1 None admin] PATH_INFO: `/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/227f958b82a446e19a4d5b29d74193bd/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.799980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6a1e2-8268-4566-9432-f4ec9666cba1 None admin] RBAC: Authorizing `identity:create_grant(project_id=204574e6a3c34ca4a7c266b5549bfdfa, user_id=227f958b82a446e19a4d5b29d74193bd, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.801425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6a1e2-8268-4566-9432-f4ec9666cba1 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.818841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 634/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:14 2022] PUT /identity/v3/projects/204574e6a3c34ca4a7c266b5549bfdfa/users/227f958b82a446e19a4d5b29d74193bd/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:16.677926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa686fd-adc5-4647-b8f6-74a02fab27ce None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:16.678483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa686fd-adc5-4647-b8f6-74a02fab27ce None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:16.678483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa686fd-adc5-4647-b8f6-74a02fab27ce None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:16.679799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 640/1274] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:16.685485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740ba5e-b56c-4ab2-9e18-114e3e336451 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:16.685921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740ba5e-b56c-4ab2-9e18-114e3e336451 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:16.686012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740ba5e-b56c-4ab2-9e18-114e3e336451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:16.711416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c740ba5e-b56c-4ab2-9e18-114e3e336451 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:16.712630 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c740ba5e-b56c-4ab2-9e18-114e3e336451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:16.785588 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 635/1275] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:06:17.054254 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa686fd-adc5-4647-b8f6-74a02fab27ce None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.164923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa686fd-adc5-4647-b8f6-74a02fab27ce None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:17.184323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:17.203533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7617c-a120-41e4-85a7-eb6f2a9ae8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:17.204155 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7617c-a120-41e4-85a7-eb6f2a9ae8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.204421 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7617c-a120-41e4-85a7-eb6f2a9ae8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.204687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7617c-a120-41e4-85a7-eb6f2a9ae8d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.214897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7617c-a120-41e4-85a7-eb6f2a9ae8d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-3dc7617c-a120-41e4-85a7-eb6f2a9ae8d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:17.219978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:17.221043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:17.222109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:17.222109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:17.222109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:17.222109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:17.222109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:17.222109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:17.222109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:17.222109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:17.222109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:17.222109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:17.222109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:17.222109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:17.225387 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 641/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:17.227256 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740ba5e-b56c-4ab2-9e18-114e3e336451 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.318969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:17.342573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740ba5e-b56c-4ab2-9e18-114e3e336451 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:17.381813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b37a02-d858-4b28-af9b-799e22a70650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:17.382413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b37a02-d858-4b28-af9b-799e22a70650 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.382686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b37a02-d858-4b28-af9b-799e22a70650 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.382952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b37a02-d858-4b28-af9b-799e22a70650 None admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.383610 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b37a02-d858-4b28-af9b-799e22a70650 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:17.383904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b37a02-d858-4b28-af9b-799e22a70650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:17.385250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b37a02-d858-4b28-af9b-799e22a70650 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:17.394167 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 636/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:17.400831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7617c-a120-41e4-85a7-eb6f2a9ae8d5 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.526816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7617c-a120-41e4-85a7-eb6f2a9ae8d5 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:17.564347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ec529-6377-4fe0-b9bd-69025821269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:17.564962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ec529-6377-4fe0-b9bd-69025821269f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.565248 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ec529-6377-4fe0-b9bd-69025821269f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.565523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ec529-6377-4fe0-b9bd-69025821269f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.576160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ec529-6377-4fe0-b9bd-69025821269f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:17.577770 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ec529-6377-4fe0-b9bd-69025821269f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-fe2ec529-6377-4fe0-b9bd-69025821269f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:17.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:17.593522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:17.594652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:17.594652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:17.594652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:17.594652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 642/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:17.599791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b37a02-d858-4b28-af9b-799e22a70650 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.711258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b37a02-d858-4b28-af9b-799e22a70650 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:17.750311 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048262a9-d9c6-4d63-a82f-b2fae60ca688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:17.751068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048262a9-d9c6-4d63-a82f-b2fae60ca688 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.751342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048262a9-d9c6-4d63-a82f-b2fae60ca688 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.751605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048262a9-d9c6-4d63-a82f-b2fae60ca688 None admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.752229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048262a9-d9c6-4d63-a82f-b2fae60ca688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:17.752521 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048262a9-d9c6-4d63-a82f-b2fae60ca688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:17.753879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048262a9-d9c6-4d63-a82f-b2fae60ca688 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:17.767463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 637/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:17.773713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ec529-6377-4fe0-b9bd-69025821269f None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.808446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:17.895251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ec529-6377-4fe0-b9bd-69025821269f None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:17.930384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fb1f1-efc4-4595-9bdf-0d13f5a4a65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:17.931015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fb1f1-efc4-4595-9bdf-0d13f5a4a65c None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.931269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fb1f1-efc4-4595-9bdf-0d13f5a4a65c None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.931535 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fb1f1-efc4-4595-9bdf-0d13f5a4a65c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.939609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fb1f1-efc4-4595-9bdf-0d13f5a4a65c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:17.941101 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fb1f1-efc4-4595-9bdf-0d13f5a4a65c None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-0c3fb1f1-efc4-4595-9bdf-0d13f5a4a65c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:17.952320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:17.953483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:17.954668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:17.954668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:17.954668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:17.954668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:17.954668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:17.954668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:17.954668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:17.954668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:17.954668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:06:17.954668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:17.954668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 643/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:17.962019 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048262a9-d9c6-4d63-a82f-b2fae60ca688 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.966305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.066755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048262a9-d9c6-4d63-a82f-b2fae60ca688 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.110424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f0643-0b0e-49f9-bccf-0ebc1fa71f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.111033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0643-0b0e-49f9-bccf-0ebc1fa71f3b None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.111304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0643-0b0e-49f9-bccf-0ebc1fa71f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.111565 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0643-0b0e-49f9-bccf-0ebc1fa71f3b None admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.112283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f0643-0b0e-49f9-bccf-0ebc1fa71f3b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:18.112580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f0643-0b0e-49f9-bccf-0ebc1fa71f3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.114033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f0643-0b0e-49f9-bccf-0ebc1fa71f3b None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.134022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 638/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:18.142152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fb1f1-efc4-4595-9bdf-0d13f5a4a65c None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.241242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.256917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fb1f1-efc4-4595-9bdf-0d13f5a4a65c None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.301885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095f1cc-3dac-45ff-8fa7-ac949d7cb748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.302480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095f1cc-3dac-45ff-8fa7-ac949d7cb748 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.302748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095f1cc-3dac-45ff-8fa7-ac949d7cb748 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.303008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095f1cc-3dac-45ff-8fa7-ac949d7cb748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.373337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095f1cc-3dac-45ff-8fa7-ac949d7cb748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.374788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095f1cc-3dac-45ff-8fa7-ac949d7cb748 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.473287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.483729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 644/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:06:18.493230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f0643-0b0e-49f9-bccf-0ebc1fa71f3b None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.560196 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.605272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f0643-0b0e-49f9-bccf-0ebc1fa71f3b None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.642994 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564680fb-5dc0-4845-8911-ed7762cdb76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.643618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564680fb-5dc0-4845-8911-ed7762cdb76d None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.643885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564680fb-5dc0-4845-8911-ed7762cdb76d None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.644156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564680fb-5dc0-4845-8911-ed7762cdb76d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.655641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564680fb-5dc0-4845-8911-ed7762cdb76d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.657080 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564680fb-5dc0-4845-8911-ed7762cdb76d None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-564680fb-5dc0-4845-8911-ed7762cdb76d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:18.671751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:18.672825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:18.673929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:18.673929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:18.673929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:06:18.673929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 639/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:18.679015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095f1cc-3dac-45ff-8fa7-ac949d7cb748 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.798761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095f1cc-3dac-45ff-8fa7-ac949d7cb748 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.837006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52440585-b91e-494b-9bc9-443fa75e90d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.837631 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52440585-b91e-494b-9bc9-443fa75e90d8 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.837899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52440585-b91e-494b-9bc9-443fa75e90d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.838168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52440585-b91e-494b-9bc9-443fa75e90d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.838806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52440585-b91e-494b-9bc9-443fa75e90d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:18.839108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52440585-b91e-494b-9bc9-443fa75e90d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.840469 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52440585-b91e-494b-9bc9-443fa75e90d8 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.851797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 645/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:18.857875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564680fb-5dc0-4845-8911-ed7762cdb76d None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.972243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564680fb-5dc0-4845-8911-ed7762cdb76d None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.991543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:19.016480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006c126-093c-4448-abbb-59eed72719d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.017093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006c126-093c-4448-abbb-59eed72719d5 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.017401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006c126-093c-4448-abbb-59eed72719d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.017662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006c126-093c-4448-abbb-59eed72719d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.024684 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006c126-093c-4448-abbb-59eed72719d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:19.026134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006c126-093c-4448-abbb-59eed72719d5 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application [None req-3006c126-093c-4448-abbb-59eed72719d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:19.037860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:19.038850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:19.039835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:19.039835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:19.039835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:19.039835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:19.039835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:19.039835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:19.039835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:19.039835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: ERROR keystone.server.flask.application Aug 31 00:06:19.039835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 640/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:19.045028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52440585-b91e-494b-9bc9-443fa75e90d8 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:19.099467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:19.158825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52440585-b91e-494b-9bc9-443fa75e90d8 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:19.194593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d588a66-e932-4c4f-ac3e-8a8e0e2b560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.195184 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d588a66-e932-4c4f-ac3e-8a8e0e2b560f None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.195450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d588a66-e932-4c4f-ac3e-8a8e0e2b560f None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.195719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d588a66-e932-4c4f-ac3e-8a8e0e2b560f None admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.196407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d588a66-e932-4c4f-ac3e-8a8e0e2b560f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:19.196699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d588a66-e932-4c4f-ac3e-8a8e0e2b560f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:19.198186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d588a66-e932-4c4f-ac3e-8a8e0e2b560f None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:19.211989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 646/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:19.221451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006c126-093c-4448-abbb-59eed72719d5 None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:19.340908 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006c126-093c-4448-abbb-59eed72719d5 None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:19.375905 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2190212-fa2e-4a2d-b775-4f5f14ee908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.376497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2190212-fa2e-4a2d-b775-4f5f14ee908a None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.376766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2190212-fa2e-4a2d-b775-4f5f14ee908a None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.377035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2190212-fa2e-4a2d-b775-4f5f14ee908a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.377795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2190212-fa2e-4a2d-b775-4f5f14ee908a None admin] RBAC: Adding query filter params (role.id=9aeb65f617f04008b419583f1e3ccb55, scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa, user.id=227f958b82a446e19a4d5b29d74193bd) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:19.378097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2190212-fa2e-4a2d-b775-4f5f14ee908a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:19.379509 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2190212-fa2e-4a2d-b775-4f5f14ee908a None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:19.385383 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 641/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:19 2022] GET /identity/v3/role_assignments?user.id=227f958b82a446e19a4d5b29d74193bd&scope.project.id=204574e6a3c34ca4a7c266b5549bfdfa&role.id=9aeb65f617f04008b419583f1e3ccb55 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:21.287646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42134-db55-4b5d-a7be-0df7102d79ad None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.288624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42134-db55-4b5d-a7be-0df7102d79ad None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.288784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42134-db55-4b5d-a7be-0df7102d79ad None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.291047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 647/1288] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:06:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:21.299523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dca067-7927-4f41-b277-ef7f6e8ce6d5 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.299952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dca067-7927-4f41-b277-ef7f6e8ce6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.300041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dca067-7927-4f41-b277-ef7f6e8ce6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.330168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-f0dca067-7927-4f41-b277-ef7f6e8ce6d5 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:21.331410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f0dca067-7927-4f41-b277-ef7f6e8ce6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:21.367519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:21.406574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 642/1289] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:06:21.677737 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed42134-db55-4b5d-a7be-0df7102d79ad None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.802710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed42134-db55-4b5d-a7be-0df7102d79ad None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:21.815145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:21.841866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346ad5a-4bc3-4196-81d1-f8698cc593e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.842478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346ad5a-4bc3-4196-81d1-f8698cc593e8 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.842749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346ad5a-4bc3-4196-81d1-f8698cc593e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.843040 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346ad5a-4bc3-4196-81d1-f8698cc593e8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.843625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346ad5a-4bc3-4196-81d1-f8698cc593e8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:21.844993 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346ad5a-4bc3-4196-81d1-f8698cc593e8 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-0346ad5a-4bc3-4196-81d1-f8698cc593e8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:21.854166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:21.855337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:21.856212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 648/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:21.862340 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dca067-7927-4f41-b277-ef7f6e8ce6d5 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.973964 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dca067-7927-4f41-b277-ef7f6e8ce6d5 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.019895 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba12ad-be46-46ed-ba1f-c09004c22d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.020506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba12ad-be46-46ed-ba1f-c09004c22d30 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.020781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba12ad-be46-46ed-ba1f-c09004c22d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.021047 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba12ad-be46-46ed-ba1f-c09004c22d30 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.021731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba12ad-be46-46ed-ba1f-c09004c22d30 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:22.022030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba12ad-be46-46ed-ba1f-c09004c22d30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.023379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba12ad-be46-46ed-ba1f-c09004c22d30 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.028565 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 643/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:22.037745 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346ad5a-4bc3-4196-81d1-f8698cc593e8 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:22.159147 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346ad5a-4bc3-4196-81d1-f8698cc593e8 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.195618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194250df-9196-4567-a965-7715e9dd35a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.196207 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194250df-9196-4567-a965-7715e9dd35a6 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.196483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194250df-9196-4567-a965-7715e9dd35a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.196744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194250df-9196-4567-a965-7715e9dd35a6 None admin] PATH_INFO: `/v3/services` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.197396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194250df-9196-4567-a965-7715e9dd35a6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:22.197673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194250df-9196-4567-a965-7715e9dd35a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.199028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194250df-9196-4567-a965-7715e9dd35a6 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.203957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 649/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Aug 31 00:06:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:24.082237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28026a9a-3192-4372-9df6-c0ba3ff8613c None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.082843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28026a9a-3192-4372-9df6-c0ba3ff8613c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.082843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28026a9a-3192-4372-9df6-c0ba3ff8613c None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.084144 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 644/1293] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:24.090454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f7f49-4a78-4541-87b2-a3299e37ba8f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.090831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f7f49-4a78-4541-87b2-a3299e37ba8f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.090935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f7f49-4a78-4541-87b2-a3299e37ba8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.117167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-eb5f7f49-4a78-4541-87b2-a3299e37ba8f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:24.118400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-eb5f7f49-4a78-4541-87b2-a3299e37ba8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:24.149611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:24.192781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 650/1294] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:06:24.467287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28026a9a-3192-4372-9df6-c0ba3ff8613c None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.501547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:24.582035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28026a9a-3192-4372-9df6-c0ba3ff8613c None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.618165 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8b9b5-1242-422d-9193-d5fc655e979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.618753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8b9b5-1242-422d-9193-d5fc655e979e None admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.619024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8b9b5-1242-422d-9193-d5fc655e979e None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.619290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8b9b5-1242-422d-9193-d5fc655e979e None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.619934 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8b9b5-1242-422d-9193-d5fc655e979e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:24.621275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8b9b5-1242-422d-9193-d5fc655e979e None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:24.637889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 645/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 31 00:06:24 2022] POST /identity/v3/services => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:26.546358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07fdd-f4e5-43ec-b93f-900bbb033a35 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.547039 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07fdd-f4e5-43ec-b93f-900bbb033a35 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.547039 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07fdd-f4e5-43ec-b93f-900bbb033a35 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.548945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 651/1296] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:06:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:26.556969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d858f-4859-4793-83ec-23770459ac1d None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.557437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d858f-4859-4793-83ec-23770459ac1d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.557525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d858f-4859-4793-83ec-23770459ac1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.578376 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-694d858f-4859-4793-83ec-23770459ac1d None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:26.579561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-694d858f-4859-4793-83ec-23770459ac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:26.671705 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 646/1297] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:06:26.949943 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07fdd-f4e5-43ec-b93f-900bbb033a35 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:27.095788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07fdd-f4e5-43ec-b93f-900bbb033a35 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:27.131192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006d433-86f9-4a30-a3f1-5c8712876dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:27.131806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d433-86f9-4a30-a3f1-5c8712876dac None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.132072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d433-86f9-4a30-a3f1-5c8712876dac None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.132307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d433-86f9-4a30-a3f1-5c8712876dac None admin] PATH_INFO: `/v3/services/placement` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.132904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006d433-86f9-4a30-a3f1-5c8712876dac None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:27.134299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006d433-86f9-4a30-a3f1-5c8712876dac None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-0006d433-86f9-4a30-a3f1-5c8712876dac None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:27.143194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:27.144324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:27.145926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 652/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 31 00:06:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:27.154180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d858f-4859-4793-83ec-23770459ac1d None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:27.179171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:27.265549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d858f-4859-4793-83ec-23770459ac1d None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:27.301971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db9939-4de1-4eed-a2db-b05963864e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:27.302571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db9939-4de1-4eed-a2db-b05963864e1c None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.302849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db9939-4de1-4eed-a2db-b05963864e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.303111 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db9939-4de1-4eed-a2db-b05963864e1c None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.303735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db9939-4de1-4eed-a2db-b05963864e1c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:27.304037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db9939-4de1-4eed-a2db-b05963864e1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:27.305441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db9939-4de1-4eed-a2db-b05963864e1c None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:27.310669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 647/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Aug 31 00:06:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:27.318533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006d433-86f9-4a30-a3f1-5c8712876dac None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:27.357444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:27.431581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006d433-86f9-4a30-a3f1-5c8712876dac None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:27.471630 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924b7d0-3c12-4d32-a6d1-57b1779676fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:27.472598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924b7d0-3c12-4d32-a6d1-57b1779676fc None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.472864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924b7d0-3c12-4d32-a6d1-57b1779676fc None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.473134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924b7d0-3c12-4d32-a6d1-57b1779676fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.474223 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924b7d0-3c12-4d32-a6d1-57b1779676fc None admin] RBAC: Adding query filter params (interface=public, service_id=1684705f759240d593ab79e845c77c7e, region_id=RegionOne) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:27.474668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924b7d0-3c12-4d32-a6d1-57b1779676fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:27.476473 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924b7d0-3c12-4d32-a6d1-57b1779676fc None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:27.483241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 653/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 31 00:06:27 2022] GET /identity/v3/endpoints?service_id=1684705f759240d593ab79e845c77c7e&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:27.490828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db9939-4de1-4eed-a2db-b05963864e1c None admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:27.582843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:27.602402 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db9939-4de1-4eed-a2db-b05963864e1c None admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:27.641699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e3b90-d882-47cd-816c-3006528b35c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:27.642293 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e3b90-d882-47cd-816c-3006528b35c8 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.642562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e3b90-d882-47cd-816c-3006528b35c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.642823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e3b90-d882-47cd-816c-3006528b35c8 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.643418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e3b90-d882-47cd-816c-3006528b35c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:27.644771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e3b90-d882-47cd-816c-3006528b35c8 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:27.652542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 648/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 31 00:06:27 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:06:29.557031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147a1d9-2c38-4933-b30a-d902317b4080 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.557962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147a1d9-2c38-4933-b30a-d902317b4080 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.557962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147a1d9-2c38-4933-b30a-d902317b4080 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.560083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 654/1302] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:06:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:29.569780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb484a39-7961-43ea-a06f-3c462f5d9d19 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.570232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb484a39-7961-43ea-a06f-3c462f5d9d19 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.570331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb484a39-7961-43ea-a06f-3c462f5d9d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.591735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-cb484a39-7961-43ea-a06f-3c462f5d9d19 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:29.593038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-cb484a39-7961-43ea-a06f-3c462f5d9d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:29.675884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 649/1303] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:06:29.949538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147a1d9-2c38-4933-b30a-d902317b4080 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.061049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.073622 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147a1d9-2c38-4933-b30a-d902317b4080 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.111432 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4de3a3-acfa-4b5c-9b69-48d4158f1349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.112073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4de3a3-acfa-4b5c-9b69-48d4158f1349 None admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.112356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4de3a3-acfa-4b5c-9b69-48d4158f1349 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.112588 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4de3a3-acfa-4b5c-9b69-48d4158f1349 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.113185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4de3a3-acfa-4b5c-9b69-48d4158f1349 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.114623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4de3a3-acfa-4b5c-9b69-48d4158f1349 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application [None req-4b4de3a3-acfa-4b5c-9b69-48d4158f1349 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:30.124360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:30.125581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: ERROR keystone.server.flask.application Aug 31 00:06:30.126719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 655/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:30.135006 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb484a39-7961-43ea-a06f-3c462f5d9d19 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.211710 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.236187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb484a39-7961-43ea-a06f-3c462f5d9d19 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.272043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae682e41-df88-4ef6-9461-2cccbdb3b132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.272652 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae682e41-df88-4ef6-9461-2cccbdb3b132 None admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.272927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae682e41-df88-4ef6-9461-2cccbdb3b132 None admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.273194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae682e41-df88-4ef6-9461-2cccbdb3b132 None admin] PATH_INFO: `/v3/services` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.273845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae682e41-df88-4ef6-9461-2cccbdb3b132 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:30.274168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae682e41-df88-4ef6-9461-2cccbdb3b132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.275522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae682e41-df88-4ef6-9461-2cccbdb3b132 None admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.281349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 650/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:30.288232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4de3a3-acfa-4b5c-9b69-48d4158f1349 None admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.406338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4de3a3-acfa-4b5c-9b69-48d4158f1349 None admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.450435 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e126eef-b215-4b62-97a8-113b7b8b0796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.451149 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e126eef-b215-4b62-97a8-113b7b8b0796 None admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.451423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e126eef-b215-4b62-97a8-113b7b8b0796 None admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.451693 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e126eef-b215-4b62-97a8-113b7b8b0796 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.452734 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e126eef-b215-4b62-97a8-113b7b8b0796 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.454205 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e126eef-b215-4b62-97a8-113b7b8b0796 None admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.479448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 656/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:06:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:40.278161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=30 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:40.474393 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:36.440517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84185e-6690-4e5a-a785-cee0a471ec43 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.441095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84185e-6690-4e5a-a785-cee0a471ec43 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.441095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84185e-6690-4e5a-a785-cee0a471ec43 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.442475 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 651/1307] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:36.448161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ecd45-d7e9-4f67-8411-8a0d900750b3 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.450262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ecd45-d7e9-4f67-8411-8a0d900750b3 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.450262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ecd45-d7e9-4f67-8411-8a0d900750b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.561869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-4c7ecd45-d7e9-4f67-8411-8a0d900750b3 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:36.563999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4c7ecd45-d7e9-4f67-8411-8a0d900750b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:36.706170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 657/1308] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:07:36.994425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff233e-302e-4ebe-8ae6-749ea812ef3b None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.994800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff233e-302e-4ebe-8ae6-749ea812ef3b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.994970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff233e-302e-4ebe-8ae6-749ea812ef3b None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.996470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 652/1309] 10.222.0.60 () {54 vars in 965 bytes} [Wed Aug 31 00:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:37.002513 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e4481-50d2-4da6-85c9-dd50cd2bf276 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.002917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e4481-50d2-4da6-85c9-dd50cd2bf276 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.003272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e4481-50d2-4da6-85c9-dd50cd2bf276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.090633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-548e4481-50d2-4da6-85c9-dd50cd2bf276 None None] MFA Rules not processed for user `d4f2b852544b450a86fdcb5fa18fd290`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:37.092078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-548e4481-50d2-4da6-85c9-dd50cd2bf276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:37.120957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:37.192789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 658/1310] 10.222.0.60 () {58 vars in 1062 bytes} [Wed Aug 31 00:07:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:07:37.203461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff233e-302e-4ebe-8ae6-749ea812ef3b None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.205243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d8ff233e-302e-4ebe-8ae6-749ea812ef3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:37.337563 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff233e-302e-4ebe-8ae6-749ea812ef3b None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.415020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804ee7-25d6-4555-b59e-dfdf54cebe61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.415664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804ee7-25d6-4555-b59e-dfdf54cebe61 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.415927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804ee7-25d6-4555-b59e-dfdf54cebe61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.416186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804ee7-25d6-4555-b59e-dfdf54cebe61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.417794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-98804ee7-25d6-4555-b59e-dfdf54cebe61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:37.477696 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:37.544539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98804ee7-25d6-4555-b59e-dfdf54cebe61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.546127 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98804ee7-25d6-4555-b59e-dfdf54cebe61 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.566462 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 653/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:07:39.733063 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689584a-44de-4a18-aa10-d280655b8bf8 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.733748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689584a-44de-4a18-aa10-d280655b8bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.733748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689584a-44de-4a18-aa10-d280655b8bf8 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.734959 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 659/1312] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:39.740232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad036-3b9d-4edc-9a2a-493b51175a9f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.740653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad036-3b9d-4edc-9a2a-493b51175a9f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.740761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad036-3b9d-4edc-9a2a-493b51175a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.829069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-977ad036-3b9d-4edc-9a2a-493b51175a9f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:39.830369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-977ad036-3b9d-4edc-9a2a-493b51175a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:39.941996 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 654/1313] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:07:40.235355 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d864c-7b32-474a-b2bf-1e6ca88b363d None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.235635 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d864c-7b32-474a-b2bf-1e6ca88b363d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.235918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d864c-7b32-474a-b2bf-1e6ca88b363d None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.237972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 660/1314] 10.222.0.60 () {54 vars in 965 bytes} [Wed Aug 31 00:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:40.249854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9281e-76f9-494e-8043-08156f02822f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.250117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9281e-76f9-494e-8043-08156f02822f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.250418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9281e-76f9-494e-8043-08156f02822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.262664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.330456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-38e9281e-76f9-494e-8043-08156f02822f None None] MFA Rules not processed for user `d4f2b852544b450a86fdcb5fa18fd290`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:40.331657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-38e9281e-76f9-494e-8043-08156f02822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:40.411952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 655/1315] 10.222.0.60 () {58 vars in 1062 bytes} [Wed Aug 31 00:07:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:07:40.421051 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d864c-7b32-474a-b2bf-1e6ca88b363d None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.422625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3f2d864c-7b32-474a-b2bf-1e6ca88b363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:40.531936 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d864c-7b32-474a-b2bf-1e6ca88b363d None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.606834 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.609897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd9c42-8543-4295-9907-76dac956abf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.610509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd9c42-8543-4295-9907-76dac956abf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.610781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd9c42-8543-4295-9907-76dac956abf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.611168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd9c42-8543-4295-9907-76dac956abf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.613243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1ebd9c42-8543-4295-9907-76dac956abf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:40.738706 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd9c42-8543-4295-9907-76dac956abf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:40.740147 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd9c42-8543-4295-9907-76dac956abf5 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:40.759731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 661/1316] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:07:43.212679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc47b1-4ee9-4ca0-9685-04ab3b322381 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.213674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc47b1-4ee9-4ca0-9685-04ab3b322381 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.213674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc47b1-4ee9-4ca0-9685-04ab3b322381 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.215774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 656/1317] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:07:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:43.221417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2ee0f-bf2f-4a38-ac84-bb610e5668e4 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.221900 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2ee0f-bf2f-4a38-ac84-bb610e5668e4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.221900 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2ee0f-bf2f-4a38-ac84-bb610e5668e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.301724 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-35b2ee0f-bf2f-4a38-ac84-bb610e5668e4 None None] MFA Rules not processed for user `1fbe4ab79488470aa6024ab06cb3767f`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:43.303532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-35b2ee0f-bf2f-4a38-ac84-bb610e5668e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:43.376382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:43.429665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 662/1318] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:07:43.727909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc47b1-4ee9-4ca0-9685-04ab3b322381 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:43.730611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0efc47b1-4ee9-4ca0-9685-04ab3b322381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:43.849577 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc47b1-4ee9-4ca0-9685-04ab3b322381 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:43.852430 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:43.930633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0dd83-9b6d-437a-9e56-f1b688cd917a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:43.931249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0dd83-9b6d-437a-9e56-f1b688cd917a service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.931523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0dd83-9b6d-437a-9e56-f1b688cd917a service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.931791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0dd83-9b6d-437a-9e56-f1b688cd917a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.933430 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9ff0dd83-9b6d-437a-9e56-f1b688cd917a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:44.051583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0dd83-9b6d-437a-9e56-f1b688cd917a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:44.053916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0dd83-9b6d-437a-9e56-f1b688cd917a service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:44.075875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 657/1319] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:07:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:07:46.553959 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d347b5f-c2e6-4822-8fb4-289e7e6092cb None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.554853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d347b5f-c2e6-4822-8fb4-289e7e6092cb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.554853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d347b5f-c2e6-4822-8fb4-289e7e6092cb None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.556950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 663/1320] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:07:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:46.563168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165c568-6063-4f02-af29-db3ef42d7898 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.563631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165c568-6063-4f02-af29-db3ef42d7898 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.563734 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165c568-6063-4f02-af29-db3ef42d7898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.611352 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.637763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7165c568-6063-4f02-af29-db3ef42d7898 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:46.639044 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7165c568-6063-4f02-af29-db3ef42d7898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:46.745345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 658/1321] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:07:47.033424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d347b5f-c2e6-4822-8fb4-289e7e6092cb None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.035808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0d347b5f-c2e6-4822-8fb4-289e7e6092cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:47.161658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d347b5f-c2e6-4822-8fb4-289e7e6092cb None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.247228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4e8f6-5a42-4fc9-b44c-fa83fa2acbad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.248019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4e8f6-5a42-4fc9-b44c-fa83fa2acbad service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.248295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4e8f6-5a42-4fc9-b44c-fa83fa2acbad service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.248558 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4e8f6-5a42-4fc9-b44c-fa83fa2acbad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.251092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-39a4e8f6-5a42-4fc9-b44c-fa83fa2acbad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:47.263216 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:47.379553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4e8f6-5a42-4fc9-b44c-fa83fa2acbad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:47.381703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4e8f6-5a42-4fc9-b44c-fa83fa2acbad service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.404221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 664/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:07:50.000185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727112bc-e850-49bd-9103-bf335e6ae2fd None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.000788 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727112bc-e850-49bd-9103-bf335e6ae2fd None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.000788 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727112bc-e850-49bd-9103-bf335e6ae2fd None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.002121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 659/1323] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:50.007493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d900b27-cfc2-442c-9e2c-310a2f9c9f8c None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.007933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d900b27-cfc2-442c-9e2c-310a2f9c9f8c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.008042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d900b27-cfc2-442c-9e2c-310a2f9c9f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.080044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-7d900b27-cfc2-442c-9e2c-310a2f9c9f8c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:50.081261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7d900b27-cfc2-442c-9e2c-310a2f9c9f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:50.145401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:50.187856 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 665/1324] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:07:50.468534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727112bc-e850-49bd-9103-bf335e6ae2fd None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:50.470138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-727112bc-e850-49bd-9103-bf335e6ae2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:50.584222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727112bc-e850-49bd-9103-bf335e6ae2fd None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:50.597446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:50.661798 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57c609-d698-4fb3-95c6-3cbf9d3df350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:50.662381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57c609-d698-4fb3-95c6-3cbf9d3df350 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.662650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57c609-d698-4fb3-95c6-3cbf9d3df350 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.662910 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57c609-d698-4fb3-95c6-3cbf9d3df350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.664486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ba57c609-d698-4fb3-95c6-3cbf9d3df350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:50.784773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57c609-d698-4fb3-95c6-3cbf9d3df350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:50.786248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57c609-d698-4fb3-95c6-3cbf9d3df350 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:50.804914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 660/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:07:52.762662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d84599-a555-4e8f-970a-0d0740df2d52 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.763212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d84599-a555-4e8f-970a-0d0740df2d52 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.763212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d84599-a555-4e8f-970a-0d0740df2d52 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.765073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 666/1326] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:52.770269 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c4855-998c-42c2-b52f-8ce31e9c87ed None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.770739 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c4855-998c-42c2-b52f-8ce31e9c87ed None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.770835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c4855-998c-42c2-b52f-8ce31e9c87ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.822807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:52.842742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e00c4855-998c-42c2-b52f-8ce31e9c87ed None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:52.843957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e00c4855-998c-42c2-b52f-8ce31e9c87ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:52.945292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 661/1327] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:07:53.218294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d84599-a555-4e8f-970a-0d0740df2d52 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:53.219880 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-41d84599-a555-4e8f-970a-0d0740df2d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:53.335134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d84599-a555-4e8f-970a-0d0740df2d52 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:53.412579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb902d-5a7e-4365-aceb-edf8b57566f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:53.413192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb902d-5a7e-4365-aceb-edf8b57566f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:53.413497 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb902d-5a7e-4365-aceb-edf8b57566f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:53.413764 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb902d-5a7e-4365-aceb-edf8b57566f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.415385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3dcb902d-5a7e-4365-aceb-edf8b57566f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:53.433819 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:53.533002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb902d-5a7e-4365-aceb-edf8b57566f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:53.534482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb902d-5a7e-4365-aceb-edf8b57566f1 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:53.553247 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 667/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:07:55.676023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119c31f-60fd-4dcf-ab4b-ea28141b0b10 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.676633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119c31f-60fd-4dcf-ab4b-ea28141b0b10 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.676633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119c31f-60fd-4dcf-ab4b-ea28141b0b10 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.677964 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 662/1329] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:55.683262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b388645-4d88-4605-95db-4b410d225133 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.683712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b388645-4d88-4605-95db-4b410d225133 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.683813 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b388645-4d88-4605-95db-4b410d225133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.753299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-9b388645-4d88-4605-95db-4b410d225133 None None] MFA Rules not processed for user `1fbe4ab79488470aa6024ab06cb3767f`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:55.754523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-9b388645-4d88-4605-95db-4b410d225133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:55.821367 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.856448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 668/1330] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:07:56.136246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119c31f-60fd-4dcf-ab4b-ea28141b0b10 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.138205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d119c31f-60fd-4dcf-ab4b-ea28141b0b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:56.260289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119c31f-60fd-4dcf-ab4b-ea28141b0b10 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.283526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:56.344951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336b207-16e7-402d-94a5-64666e6a3ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.345498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336b207-16e7-402d-94a5-64666e6a3ddc service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.345772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336b207-16e7-402d-94a5-64666e6a3ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.346037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336b207-16e7-402d-94a5-64666e6a3ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.347651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c336b207-16e7-402d-94a5-64666e6a3ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:56.463826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336b207-16e7-402d-94a5-64666e6a3ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.465254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336b207-16e7-402d-94a5-64666e6a3ddc service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.485781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 663/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:07:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:07:58.619037 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c1103-1f0f-472a-9328-f3330c693786 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.619971 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c1103-1f0f-472a-9328-f3330c693786 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.620419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c1103-1f0f-472a-9328-f3330c693786 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.622645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 669/1332] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:07:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:58.631829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2f5f7-9ff3-46e0-8770-0b6f3de4ac69 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.632557 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2f5f7-9ff3-46e0-8770-0b6f3de4ac69 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.632724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2f5f7-9ff3-46e0-8770-0b6f3de4ac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.706890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:58.710156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-63b2f5f7-9ff3-46e0-8770-0b6f3de4ac69 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:58.712191 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-63b2f5f7-9ff3-46e0-8770-0b6f3de4ac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:58.813818 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 664/1333] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:07:59.097511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c1103-1f0f-472a-9328-f3330c693786 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:59.099313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-190c1103-1f0f-472a-9328-f3330c693786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:59.213838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c1103-1f0f-472a-9328-f3330c693786 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:59.302268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dee21-c7a6-4d7d-8f4c-32c7a6dec9c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:59.302879 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dee21-c7a6-4d7d-8f4c-32c7a6dec9c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:59.303144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dee21-c7a6-4d7d-8f4c-32c7a6dec9c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:59.303410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dee21-c7a6-4d7d-8f4c-32c7a6dec9c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:59.304996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-447dee21-c7a6-4d7d-8f4c-32c7a6dec9c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:59.332872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:59.425867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dee21-c7a6-4d7d-8f4c-32c7a6dec9c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:59.427225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dee21-c7a6-4d7d-8f4c-32c7a6dec9c3 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:59.446525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 670/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:08:01.424067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f85fa-3c63-4bcd-8ba1-9a5364011164 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.424906 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f85fa-3c63-4bcd-8ba1-9a5364011164 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.424906 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f85fa-3c63-4bcd-8ba1-9a5364011164 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.426987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 665/1335] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:01.436243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ebc14-1bdc-49a6-b9c1-50e09f11e384 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.436660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ebc14-1bdc-49a6-b9c1-50e09f11e384 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.436876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ebc14-1bdc-49a6-b9c1-50e09f11e384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.513901 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-e78ebc14-1bdc-49a6-b9c1-50e09f11e384 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:01.515107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e78ebc14-1bdc-49a6-b9c1-50e09f11e384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:01.591980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.617349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 671/1336] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:01.919981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f85fa-3c63-4bcd-8ba1-9a5364011164 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.922506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-695f85fa-3c63-4bcd-8ba1-9a5364011164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:02.049467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f85fa-3c63-4bcd-8ba1-9a5364011164 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.085570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:02.136649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87351d5-0f4b-4c04-a746-12d4b0eb1fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.137256 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87351d5-0f4b-4c04-a746-12d4b0eb1fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.137554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87351d5-0f4b-4c04-a746-12d4b0eb1fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.137813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87351d5-0f4b-4c04-a746-12d4b0eb1fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.139470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b87351d5-0f4b-4c04-a746-12d4b0eb1fb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:02.265153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87351d5-0f4b-4c04-a746-12d4b0eb1fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.266606 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87351d5-0f4b-4c04-a746-12d4b0eb1fb1 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.285177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 666/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:08:04.531696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d742c-bfbb-4736-b339-7378b518a1f6 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:04.532569 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d742c-bfbb-4736-b339-7378b518a1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:04.532569 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d742c-bfbb-4736-b339-7378b518a1f6 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:04.534874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 672/1338] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:04.541247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dda72-af5a-4c0d-bc12-06793a1e1bcf None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:04.541976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dda72-af5a-4c0d-bc12-06793a1e1bcf None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:04.542181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dda72-af5a-4c0d-bc12-06793a1e1bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:04.613920 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-845dda72-af5a-4c0d-bc12-06793a1e1bcf None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:04.615168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-845dda72-af5a-4c0d-bc12-06793a1e1bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:04.624127 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:04.726457 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 667/1339] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:05.022269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d742c-bfbb-4736-b339-7378b518a1f6 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.024760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-593d742c-bfbb-4736-b339-7378b518a1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:05.149311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d742c-bfbb-4736-b339-7378b518a1f6 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.224554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d1edc-57ef-47ce-b968-769267cd39fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.225158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d1edc-57ef-47ce-b968-769267cd39fc service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.225456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d1edc-57ef-47ce-b968-769267cd39fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.225722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d1edc-57ef-47ce-b968-769267cd39fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.227322 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1b7d1edc-57ef-47ce-b968-769267cd39fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:05.271190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:05.352257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d1edc-57ef-47ce-b968-769267cd39fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:05.353722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d1edc-57ef-47ce-b968-769267cd39fc service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:05.377593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 673/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:08:09.283952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1a255-98f7-4a76-843a-99a35f8385a1 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.284590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1a255-98f7-4a76-843a-99a35f8385a1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.284590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1a255-98f7-4a76-843a-99a35f8385a1 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.286644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 668/1341] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:09.292248 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841b6e7-330a-4f13-bc8a-d996f11148e1 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.292730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841b6e7-330a-4f13-bc8a-d996f11148e1 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.292730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841b6e7-330a-4f13-bc8a-d996f11148e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.362706 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-9841b6e7-330a-4f13-bc8a-d996f11148e1 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:09.363919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-9841b6e7-330a-4f13-bc8a-d996f11148e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:09.468143 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.481224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 674/1342] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:09.764734 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1a255-98f7-4a76-843a-99a35f8385a1 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.766396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9cc1a255-98f7-4a76-843a-99a35f8385a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:09.874632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1a255-98f7-4a76-843a-99a35f8385a1 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.915977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.953993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e9770-d261-46a6-8f54-dfd8132b6034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.954635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e9770-d261-46a6-8f54-dfd8132b6034 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.954901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e9770-d261-46a6-8f54-dfd8132b6034 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.955173 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e9770-d261-46a6-8f54-dfd8132b6034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.956755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d46e9770-d261-46a6-8f54-dfd8132b6034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:10.070032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e9770-d261-46a6-8f54-dfd8132b6034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:10.071404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e9770-d261-46a6-8f54-dfd8132b6034 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:10.094240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 669/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:08:12.686772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2d03f-80ef-4cb9-886b-fb125d933ec8 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.687303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2d03f-80ef-4cb9-886b-fb125d933ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.687303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2d03f-80ef-4cb9-886b-fb125d933ec8 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.689648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 675/1344] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:12.697827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b068a-0846-4c3a-8d30-3738e7cee74e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.698368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b068a-0846-4c3a-8d30-3738e7cee74e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.698368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b068a-0846-4c3a-8d30-3738e7cee74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.768460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-063b068a-0846-4c3a-8d30-3738e7cee74e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:12.769710 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-063b068a-0846-4c3a-8d30-3738e7cee74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:12.788686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.872855 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 670/1345] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:13.154444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2d03f-80ef-4cb9-886b-fb125d933ec8 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.156093 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-aae2d03f-80ef-4cb9-886b-fb125d933ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:13.268154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2d03f-80ef-4cb9-886b-fb125d933ec8 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.349496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6538bcf-278a-48a8-9331-785a569befff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.350025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6538bcf-278a-48a8-9331-785a569befff service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.350297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6538bcf-278a-48a8-9331-785a569befff service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.350562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6538bcf-278a-48a8-9331-785a569befff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.352250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e6538bcf-278a-48a8-9331-785a569befff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:13.399767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:13.473977 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6538bcf-278a-48a8-9331-785a569befff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.475481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6538bcf-278a-48a8-9331-785a569befff service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.498943 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 676/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:08:17.494146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d541d-15a6-474b-9734-eb0f628cee44 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.494146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d541d-15a6-474b-9734-eb0f628cee44 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.494146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d541d-15a6-474b-9734-eb0f628cee44 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.495393 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5f38b-6003-4e6f-a54d-f42d683c169e None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.495799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5f38b-6003-4e6f-a54d-f42d683c169e None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.495898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5f38b-6003-4e6f-a54d-f42d683c169e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.500487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 671/1347] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:17.576991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-4ae5f38b-6003-4e6f-a54d-f42d683c169e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:17.578271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4ae5f38b-6003-4e6f-a54d-f42d683c169e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:17.687747 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:17.695415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 677/1348] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:08:17.973175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d541d-15a6-474b-9734-eb0f628cee44 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:17.975176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-4c3d541d-15a6-474b-9734-eb0f628cee44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:18.089049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d541d-15a6-474b-9734-eb0f628cee44 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.146958 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:18.178496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431c6f9-2801-4ccf-a9dc-21a930acbfc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.179575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431c6f9-2801-4ccf-a9dc-21a930acbfc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.179845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431c6f9-2801-4ccf-a9dc-21a930acbfc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.180119 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431c6f9-2801-4ccf-a9dc-21a930acbfc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.181785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2431c6f9-2801-4ccf-a9dc-21a930acbfc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:18.299162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431c6f9-2801-4ccf-a9dc-21a930acbfc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.300649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431c6f9-2801-4ccf-a9dc-21a930acbfc4 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.319616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 672/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:08:23.261844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac39de-421b-4ce4-97a5-73562fb93af7 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.262249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac39de-421b-4ce4-97a5-73562fb93af7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.262358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac39de-421b-4ce4-97a5-73562fb93af7 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.264280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 678/1350] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:23.269386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7712f-c363-42c0-b517-15381dbf6afe None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.269815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7712f-c363-42c0-b517-15381dbf6afe None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.269913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7712f-c363-42c0-b517-15381dbf6afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.368648 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-65a7712f-c363-42c0-b517-15381dbf6afe None None] MFA Rules not processed for user `227f958b82a446e19a4d5b29d74193bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:23.370088 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-65a7712f-c363-42c0-b517-15381dbf6afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:23.414544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:23.533297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 673/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:08:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:27.721325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e0e86-769a-4ee2-94ca-ee74a3ffb124 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.721908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e0e86-769a-4ee2-94ca-ee74a3ffb124 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.721908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e0e86-769a-4ee2-94ca-ee74a3ffb124 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.723463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 679/1352] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:27.728566 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b3081-f9af-4b7b-b19a-af717a360068 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.729408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b3081-f9af-4b7b-b19a-af717a360068 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.729753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b3081-f9af-4b7b-b19a-af717a360068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.811669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-a54b3081-f9af-4b7b-b19a-af717a360068 None None] MFA Rules not processed for user `227f958b82a446e19a4d5b29d74193bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:27.812890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a54b3081-f9af-4b7b-b19a-af717a360068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:27.887389 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:27.926471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 674/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:08:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:29.293361 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ecc80-b8de-4afd-aebd-5b8e51237e56 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.293908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ecc80-b8de-4afd-aebd-5b8e51237e56 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.293908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ecc80-b8de-4afd-aebd-5b8e51237e56 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.295422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 680/1354] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:29.301170 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23d831-9ff0-45eb-a9d7-e191ed28a318 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.301684 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23d831-9ff0-45eb-a9d7-e191ed28a318 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.301781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23d831-9ff0-45eb-a9d7-e191ed28a318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.381984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-2e23d831-9ff0-45eb-a9d7-e191ed28a318 None None] MFA Rules not processed for user `227f958b82a446e19a4d5b29d74193bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:29.383117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2e23d831-9ff0-45eb-a9d7-e191ed28a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:29.492901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 675/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:08:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:32.948094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f048ca-2ef5-4193-92b5-aa32673f73b0 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:32.948653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f048ca-2ef5-4193-92b5-aa32673f73b0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:32.948653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f048ca-2ef5-4193-92b5-aa32673f73b0 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:32.950050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 681/1356] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:32.963151 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660139c-d779-472f-a3d7-3638b6c47cc5 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:32.963600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660139c-d779-472f-a3d7-3638b6c47cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:32.963689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660139c-d779-472f-a3d7-3638b6c47cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.017427 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:33.051124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-a660139c-d779-472f-a3d7-3638b6c47cc5 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:33.054837 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a660139c-d779-472f-a3d7-3638b6c47cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:33.198638 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 676/1357] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:33.528760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae104f-fc4f-4ab6-b30b-a9ced615a9e9 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.529050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae104f-fc4f-4ab6-b30b-a9ced615a9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.529369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae104f-fc4f-4ab6-b30b-a9ced615a9e9 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.530843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 682/1358] 10.222.0.60 () {54 vars in 962 bytes} [Wed Aug 31 00:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:33.539997 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfddff-99bf-4199-ba87-7d77b0cc9680 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.540548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfddff-99bf-4199-ba87-7d77b0cc9680 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.540886 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfddff-99bf-4199-ba87-7d77b0cc9680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.628679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-9bdfddff-99bf-4199-ba87-7d77b0cc9680 None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:33.630102 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9bdfddff-99bf-4199-ba87-7d77b0cc9680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:33.682309 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:33.757243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 677/1359] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Aug 31 00:08:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:33.779766 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae104f-fc4f-4ab6-b30b-a9ced615a9e9 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.781700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-50ae104f-fc4f-4ab6-b30b-a9ced615a9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:33.950490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae104f-fc4f-4ab6-b30b-a9ced615a9e9 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:34.026269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:34.069335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef3eb5-1fc7-49b4-a687-afe2125a616f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:34.070079 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef3eb5-1fc7-49b4-a687-afe2125a616f service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.070463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef3eb5-1fc7-49b4-a687-afe2125a616f service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.070830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef3eb5-1fc7-49b4-a687-afe2125a616f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.072582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a3ef3eb5-1fc7-49b4-a687-afe2125a616f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:34.173991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef3eb5-1fc7-49b4-a687-afe2125a616f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:34.175751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef3eb5-1fc7-49b4-a687-afe2125a616f service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:34.194740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 683/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:08:36.350249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b412d-544f-4722-a58d-ae5d6ce26f2f None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.350791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b412d-544f-4722-a58d-ae5d6ce26f2f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.351095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b412d-544f-4722-a58d-ae5d6ce26f2f None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.352887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 678/1361] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:36.358990 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf0d3-ee03-4024-9779-23131b66b22f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.359487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf0d3-ee03-4024-9779-23131b66b22f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.359487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf0d3-ee03-4024-9779-23131b66b22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.438233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-0daaf0d3-ee03-4024-9779-23131b66b22f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:36.439453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0daaf0d3-ee03-4024-9779-23131b66b22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:36.481842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:36.553165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 684/1362] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:36.841470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b412d-544f-4722-a58d-ae5d6ce26f2f None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:36.843209 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-328b412d-544f-4722-a58d-ae5d6ce26f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:37.000224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b412d-544f-4722-a58d-ae5d6ce26f2f None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:37.011936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:37.139379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5e287-7be9-466a-8e16-339ef7fef4e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:37.140257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5e287-7be9-466a-8e16-339ef7fef4e1 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.140710 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5e287-7be9-466a-8e16-339ef7fef4e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.141434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5e287-7be9-466a-8e16-339ef7fef4e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.143472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e5b5e287-7be9-466a-8e16-339ef7fef4e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:37.254754 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5e287-7be9-466a-8e16-339ef7fef4e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:37.256372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5e287-7be9-466a-8e16-339ef7fef4e1 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:37.279676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 679/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:08:39.523570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccab73-4b54-4eb3-a981-89345a876bf8 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.524181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccab73-4b54-4eb3-a981-89345a876bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.524181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccab73-4b54-4eb3-a981-89345a876bf8 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.525464 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 685/1364] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:39.531608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd26d14-762f-483b-beaf-afbf89ff8f85 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.532444 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd26d14-762f-483b-beaf-afbf89ff8f85 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.532693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd26d14-762f-483b-beaf-afbf89ff8f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.549137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:39.603776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-ddd26d14-762f-483b-beaf-afbf89ff8f85 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:39.605008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ddd26d14-762f-483b-beaf-afbf89ff8f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:39.709332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 680/1365] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:40.009714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29732b96-7724-4767-a1b2-9d268a28cfe9 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:40.009978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29732b96-7724-4767-a1b2-9d268a28cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:40.010576 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29732b96-7724-4767-a1b2-9d268a28cfe9 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:40.012065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 686/1366] 10.222.0.60 () {54 vars in 962 bytes} [Wed Aug 31 00:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:40.018053 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea070f2-e17e-4b9e-b168-999641ee2457 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:40.018351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea070f2-e17e-4b9e-b168-999641ee2457 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:40.018609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea070f2-e17e-4b9e-b168-999641ee2457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:40.105349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-dea070f2-e17e-4b9e-b168-999641ee2457 None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:40.106576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-dea070f2-e17e-4b9e-b168-999641ee2457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:40.145880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:40.234802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 681/1367] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Aug 31 00:08:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:40.242840 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29732b96-7724-4767-a1b2-9d268a28cfe9 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:40.244375 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-29732b96-7724-4767-a1b2-9d268a28cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:40.401867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29732b96-7724-4767-a1b2-9d268a28cfe9 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:40.423251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:40.534321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf86cbd-41e7-482d-9e91-6e4422a1a1e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:40.535051 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf86cbd-41e7-482d-9e91-6e4422a1a1e1 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:40.535173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf86cbd-41e7-482d-9e91-6e4422a1a1e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:40.535475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf86cbd-41e7-482d-9e91-6e4422a1a1e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:40.537056 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6cf86cbd-41e7-482d-9e91-6e4422a1a1e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:40.630454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf86cbd-41e7-482d-9e91-6e4422a1a1e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:40.632262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf86cbd-41e7-482d-9e91-6e4422a1a1e1 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:40.651855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 687/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:08:41.082395 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ccb1b-5da2-498d-8f78-d0598f10454f None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:41.083011 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ccb1b-5da2-498d-8f78-d0598f10454f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:41.083011 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ccb1b-5da2-498d-8f78-d0598f10454f None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:41.087660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 682/1369] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:41.089824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc892b0-e7cd-48c6-b155-419749c2d03f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:41.090085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc892b0-e7cd-48c6-b155-419749c2d03f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:41.090362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc892b0-e7cd-48c6-b155-419749c2d03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:41.123945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:41.162475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-5fc892b0-e7cd-48c6-b155-419749c2d03f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:41.165135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-5fc892b0-e7cd-48c6-b155-419749c2d03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:41.268567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 688/1370] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:41.870828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e5cf7-3429-4cc3-8261-cd5ccfbd4fd3 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:41.871115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e5cf7-3429-4cc3-8261-cd5ccfbd4fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:41.871387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e5cf7-3429-4cc3-8261-cd5ccfbd4fd3 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:41.872884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 683/1371] 10.222.0.60 () {54 vars in 964 bytes} [Wed Aug 31 00:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:41.878400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f6163-a45a-4130-8a86-21d89572a0c6 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:41.878915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f6163-a45a-4130-8a86-21d89572a0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:41.879065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f6163-a45a-4130-8a86-21d89572a0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:41.964185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d46f6163-a45a-4130-8a86-21d89572a0c6 None None] MFA Rules not processed for user `6414692e72024816a99d63234f7c233f`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:41.965442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d46f6163-a45a-4130-8a86-21d89572a0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:42.016165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:42.058176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 689/1372] 10.222.0.60 () {58 vars in 1061 bytes} [Wed Aug 31 00:08:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:42.065949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e5cf7-3429-4cc3-8261-cd5ccfbd4fd3 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:42.067472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-548e5cf7-3429-4cc3-8261-cd5ccfbd4fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:42.176572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e5cf7-3429-4cc3-8261-cd5ccfbd4fd3 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:42.220364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:42.259883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5078c76-9ecc-42dc-824d-5334cfe87abc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:42.260450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5078c76-9ecc-42dc-824d-5334cfe87abc service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.260736 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5078c76-9ecc-42dc-824d-5334cfe87abc service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.261005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5078c76-9ecc-42dc-824d-5334cfe87abc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.262649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c5078c76-9ecc-42dc-824d-5334cfe87abc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:42.382521 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5078c76-9ecc-42dc-824d-5334cfe87abc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:42.383966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5078c76-9ecc-42dc-824d-5334cfe87abc service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:42.403142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 684/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:08:42.616966 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5fcdb-1f38-40a5-a250-41833222e658 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.617271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5fcdb-1f38-40a5-a250-41833222e658 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.617699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5fcdb-1f38-40a5-a250-41833222e658 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.621380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 690/1374] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:42.624692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eb05b-afa9-4745-adc4-8f36bf0a4640 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.624976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eb05b-afa9-4745-adc4-8f36bf0a4640 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.625282 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eb05b-afa9-4745-adc4-8f36bf0a4640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.692192 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-692eb05b-afa9-4745-adc4-8f36bf0a4640 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:42.693387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-692eb05b-afa9-4745-adc4-8f36bf0a4640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:42.716223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:42.793829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 685/1375] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:43.074485 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5fcdb-1f38-40a5-a250-41833222e658 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:43.075991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-39e5fcdb-1f38-40a5-a250-41833222e658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:43.235459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5fcdb-1f38-40a5-a250-41833222e658 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:43.287800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:43.350992 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78909b41-880e-4755-b162-034618a17414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:43.351517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78909b41-880e-4755-b162-034618a17414 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:43.351786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78909b41-880e-4755-b162-034618a17414 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:43.352063 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78909b41-880e-4755-b162-034618a17414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:43.353755 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-78909b41-880e-4755-b162-034618a17414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:43.462503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78909b41-880e-4755-b162-034618a17414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:43.464111 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78909b41-880e-4755-b162-034618a17414 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:43.488962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 691/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:08:45.432931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3732d18-cd37-47be-95b2-735e1058dcc7 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.432931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3732d18-cd37-47be-95b2-735e1058dcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.435138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3732d18-cd37-47be-95b2-735e1058dcc7 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.435138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 686/1377] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:45.441276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2ef5f-57bc-442d-aa8c-f55439cdd62f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.441783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2ef5f-57bc-442d-aa8c-f55439cdd62f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.441783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2ef5f-57bc-442d-aa8c-f55439cdd62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.524895 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-56f2ef5f-57bc-442d-aa8c-f55439cdd62f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:45.526064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-56f2ef5f-57bc-442d-aa8c-f55439cdd62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:45.533905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:45.627278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 692/1378] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:45.932553 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3732d18-cd37-47be-95b2-735e1058dcc7 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:45.934254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e3732d18-cd37-47be-95b2-735e1058dcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:46.108800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3732d18-cd37-47be-95b2-735e1058dcc7 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:46.113025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:46.232973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09986c6-161c-473e-9d35-49605dc9eb5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:46.233858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09986c6-161c-473e-9d35-49605dc9eb5e service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:46.234209 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09986c6-161c-473e-9d35-49605dc9eb5e service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:46.234538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09986c6-161c-473e-9d35-49605dc9eb5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:46.236887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b09986c6-161c-473e-9d35-49605dc9eb5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:46.339831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09986c6-161c-473e-9d35-49605dc9eb5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:46.341487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09986c6-161c-473e-9d35-49605dc9eb5e service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:46.361980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 687/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:08:48.359895 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca101c65-21d1-41c9-80fd-4ccd0c3978ca None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.360446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca101c65-21d1-41c9-80fd-4ccd0c3978ca None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.360446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca101c65-21d1-41c9-80fd-4ccd0c3978ca None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.362335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 693/1380] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:48.367085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbc44-0662-4b5f-b297-5d9f1af5b55b None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.367537 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbc44-0662-4b5f-b297-5d9f1af5b55b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.367631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbc44-0662-4b5f-b297-5d9f1af5b55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.379330 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:48.438262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-098cbc44-0662-4b5f-b297-5d9f1af5b55b None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:48.439458 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-098cbc44-0662-4b5f-b297-5d9f1af5b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:48.548729 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 688/1381] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:48.829583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca101c65-21d1-41c9-80fd-4ccd0c3978ca None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:48.831384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ca101c65-21d1-41c9-80fd-4ccd0c3978ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:48.985807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:49.001094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca101c65-21d1-41c9-80fd-4ccd0c3978ca None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:49.157230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a23ec-226a-4734-934e-389f8aca5dcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:49.157860 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a23ec-226a-4734-934e-389f8aca5dcf service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:49.158129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a23ec-226a-4734-934e-389f8aca5dcf service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:49.158389 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a23ec-226a-4734-934e-389f8aca5dcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:49.159992 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a19a23ec-226a-4734-934e-389f8aca5dcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:49.254384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a23ec-226a-4734-934e-389f8aca5dcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:49.256121 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a23ec-226a-4734-934e-389f8aca5dcf service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:49.266590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:49.277410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 694/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:08:51.350324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d575912-4a34-48a6-8b4d-86e134459984 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.350882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d575912-4a34-48a6-8b4d-86e134459984 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.350882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d575912-4a34-48a6-8b4d-86e134459984 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.352671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 689/1383] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:51.359676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65b48-6e60-4624-b202-95aa2bd05474 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.360280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65b48-6e60-4624-b202-95aa2bd05474 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.360280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65b48-6e60-4624-b202-95aa2bd05474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.431754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-fae65b48-6e60-4624-b202-95aa2bd05474 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:51.433291 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-fae65b48-6e60-4624-b202-95aa2bd05474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:51.540345 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 695/1384] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:51.886668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d575912-4a34-48a6-8b4d-86e134459984 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:51.888376 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-3d575912-4a34-48a6-8b4d-86e134459984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:51.981810 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:52.048444 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d575912-4a34-48a6-8b4d-86e134459984 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:52.183786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9971fd-bdf6-4e0b-9e60-0c3bdc132607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:52.184362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9971fd-bdf6-4e0b-9e60-0c3bdc132607 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:52.184648 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9971fd-bdf6-4e0b-9e60-0c3bdc132607 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:52.184970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9971fd-bdf6-4e0b-9e60-0c3bdc132607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:52.186957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0a9971fd-bdf6-4e0b-9e60-0c3bdc132607 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:52.243944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:52.289147 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9971fd-bdf6-4e0b-9e60-0c3bdc132607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:52.291304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9971fd-bdf6-4e0b-9e60-0c3bdc132607 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:52.313655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 690/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:08:54.311100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6de17-8bf6-48c9-8792-29e769e74ce0 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.311810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6de17-8bf6-48c9-8792-29e769e74ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.311810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6de17-8bf6-48c9-8792-29e769e74ce0 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.313071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 696/1386] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:54.319263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259be5a0-c165-4755-9bc5-0d177f60ad1e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.319793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259be5a0-c165-4755-9bc5-0d177f60ad1e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.320261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259be5a0-c165-4755-9bc5-0d177f60ad1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.417866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-259be5a0-c165-4755-9bc5-0d177f60ad1e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:54.419137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-259be5a0-c165-4755-9bc5-0d177f60ad1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:54.542749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 691/1387] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:54.843624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6de17-8bf6-48c9-8792-29e769e74ce0 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:54.845313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3db6de17-8bf6-48c9-8792-29e769e74ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:54.968794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:55.072643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6de17-8bf6-48c9-8792-29e769e74ce0 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:55.202635 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d9128-1962-4728-b170-e35f6830686c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:55.205878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d9128-1962-4728-b170-e35f6830686c service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:55.205878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d9128-1962-4728-b170-e35f6830686c service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:55.205878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d9128-1962-4728-b170-e35f6830686c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:55.205878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-530d9128-1962-4728-b170-e35f6830686c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:55.261409 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:55.326781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d9128-1962-4728-b170-e35f6830686c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:55.329174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d9128-1962-4728-b170-e35f6830686c service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:55.352874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 697/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:08:57.299886 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe029a-de8c-40db-95ec-75ee1ef1b813 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.300449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe029a-de8c-40db-95ec-75ee1ef1b813 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.300449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe029a-de8c-40db-95ec-75ee1ef1b813 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.301799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 692/1389] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:57.307338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ea13-59b6-4020-8896-b4ecf6cf9478 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.307772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ea13-59b6-4020-8896-b4ecf6cf9478 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.308016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ea13-59b6-4020-8896-b4ecf6cf9478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.378922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-24b7ea13-59b6-4020-8896-b4ecf6cf9478 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:57.380022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-24b7ea13-59b6-4020-8896-b4ecf6cf9478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:57.401691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c575f-4467-495a-940a-25ffc2e2a28e None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.401945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c575f-4467-495a-940a-25ffc2e2a28e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.402228 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c575f-4467-495a-940a-25ffc2e2a28e None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.403581 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 693/1390] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:57.409081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bddd0-d3f1-4deb-88da-700f0307d79b None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.409400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bddd0-d3f1-4deb-88da-700f0307d79b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.409705 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bddd0-d3f1-4deb-88da-700f0307d79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.445544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:57.478354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-054bddd0-d3f1-4deb-88da-700f0307d79b None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:57.479571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-054bddd0-d3f1-4deb-88da-700f0307d79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:57.482404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 698/1391] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:57.579472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 694/1392] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:08:57.770289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ea13-59b6-4020-8896-b4ecf6cf9478 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:57.771521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-24b7ea13-59b6-4020-8896-b4ecf6cf9478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:57.787782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:57.892595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72f45c-aa22-44ac-8542-ce85ae9abf91 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.892850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72f45c-aa22-44ac-8542-ce85ae9abf91 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.893150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72f45c-aa22-44ac-8542-ce85ae9abf91 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.894527 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 695/1393] 10.222.0.60 () {54 vars in 967 bytes} [Wed Aug 31 00:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:57.899419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8ca26-0167-420c-982e-1525948bdd45 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.899669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8ca26-0167-420c-982e-1525948bdd45 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.899932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8ca26-0167-420c-982e-1525948bdd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.904024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ea13-59b6-4020-8896-b4ecf6cf9478 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:57.983373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-5ab8ca26-0167-420c-982e-1525948bdd45 None None] MFA Rules not processed for user `d967a3fa32ef48b68c9e3a174f0c9a03`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:57.984578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-5ab8ca26-0167-420c-982e-1525948bdd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:58.024441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa0419-581b-4617-8c43-35d2e0d4f7a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:58.024949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa0419-581b-4617-8c43-35d2e0d4f7a5 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.025304 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa0419-581b-4617-8c43-35d2e0d4f7a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.025575 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa0419-581b-4617-8c43-35d2e0d4f7a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.027510 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f9aa0419-581b-4617-8c43-35d2e0d4f7a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:58.033288 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:58.036890 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:58.062033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 696/1394] 10.222.0.60 () {58 vars in 1064 bytes} [Wed Aug 31 00:08:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:58.069614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8ca26-0167-420c-982e-1525948bdd45 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:58.077114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8ca26-0167-420c-982e-1525948bdd45 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:58.127008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa0419-581b-4617-8c43-35d2e0d4f7a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:58.128650 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa0419-581b-4617-8c43-35d2e0d4f7a5 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:58.147819 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 699/1395] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:08:58.156087 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bd96c-855a-449c-b823-d274449d4ea9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd967a3fa32ef48b68c9e3a174f0c9a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:58.156711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bd96c-855a-449c-b823-d274449d4ea9 service glance] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.156986 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bd96c-855a-449c-b823-d274449d4ea9 service glance] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.157280 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bd96c-855a-449c-b823-d274449d4ea9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.158917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2b5bd96c-855a-449c-b823-d274449d4ea9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:58.286359 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bd96c-855a-449c-b823-d274449d4ea9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:58.287753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bd96c-855a-449c-b823-d274449d4ea9 service glance] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:58.304592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:58.315811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 697/1396] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:08:59.075430 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269c54c-bf90-4a3f-a0bc-524e23e6db77 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:59.075964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269c54c-bf90-4a3f-a0bc-524e23e6db77 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:59.076137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269c54c-bf90-4a3f-a0bc-524e23e6db77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:59.148978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-8269c54c-bf90-4a3f-a0bc-524e23e6db77 None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:59.150310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8269c54c-bf90-4a3f-a0bc-524e23e6db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:59.239898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:59.243604 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 700/1397] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:08:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:59.296272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48815796-d0f8-4794-bcd0-0a5d998e7bc0 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:59.296561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48815796-d0f8-4794-bcd0-0a5d998e7bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:59.296831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48815796-d0f8-4794-bcd0-0a5d998e7bc0 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:59.298499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 698/1398] 10.222.0.60 () {54 vars in 943 bytes} [Wed Aug 31 00:08:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:59.305438 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed9a02-7bc9-4deb-a745-dc94f5fe09d3 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:59.305720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed9a02-7bc9-4deb-a745-dc94f5fe09d3 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:59.305998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed9a02-7bc9-4deb-a745-dc94f5fe09d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:59.381240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-49ed9a02-7bc9-4deb-a745-dc94f5fe09d3 None None] MFA Rules not processed for user `85c5a65170b046d08b0d1f01c6550730`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:59.382454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-49ed9a02-7bc9-4deb-a745-dc94f5fe09d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:59.493249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 701/1399] 10.222.0.60 () {58 vars in 1040 bytes} [Wed Aug 31 00:08:59 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:08:59.503026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48815796-d0f8-4794-bcd0-0a5d998e7bc0 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:59.504569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-48815796-d0f8-4794-bcd0-0a5d998e7bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:59.655374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48815796-d0f8-4794-bcd0-0a5d998e7bc0 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:59.743401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:59.765369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d829549-aac8-434c-a80a-1735fe117b8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:59.766012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d829549-aac8-434c-a80a-1735fe117b8b service swift] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:59.766282 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d829549-aac8-434c-a80a-1735fe117b8b service swift] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:59.766538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d829549-aac8-434c-a80a-1735fe117b8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:59.768149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9d829549-aac8-434c-a80a-1735fe117b8b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:59.854245 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d829549-aac8-434c-a80a-1735fe117b8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:59.855984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d829549-aac8-434c-a80a-1735fe117b8b service swift] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:59.865192 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 699/1400] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:08:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:09:00.106005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f896d73-61b4-491a-ac9f-4e00f05e6eeb None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:00.106994 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f896d73-61b4-491a-ac9f-4e00f05e6eeb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:00.107267 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f896d73-61b4-491a-ac9f-4e00f05e6eeb None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:00.108707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 702/1401] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:00.114132 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880bbde-adca-4a30-9eb9-f0883908a968 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:00.114421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880bbde-adca-4a30-9eb9-f0883908a968 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:00.114688 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880bbde-adca-4a30-9eb9-f0883908a968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:00.191506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-8880bbde-adca-4a30-9eb9-f0883908a968 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:00.192844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8880bbde-adca-4a30-9eb9-f0883908a968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:00.271179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:00.310538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 700/1402] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:00.641924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f896d73-61b4-491a-ac9f-4e00f05e6eeb None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:00.643453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4f896d73-61b4-491a-ac9f-4e00f05e6eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:00.717551 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:00.830987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f896d73-61b4-491a-ac9f-4e00f05e6eeb None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:00.952651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3dfc-72e7-4f78-a9eb-1f3a36ffa58b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:00.953170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3dfc-72e7-4f78-a9eb-1f3a36ffa58b service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:00.953464 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3dfc-72e7-4f78-a9eb-1f3a36ffa58b service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:00.953732 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3dfc-72e7-4f78-a9eb-1f3a36ffa58b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:00.957265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-90ce3dfc-72e7-4f78-a9eb-1f3a36ffa58b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:00.976814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:01.068165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce3dfc-72e7-4f78-a9eb-1f3a36ffa58b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:01.069822 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce3dfc-72e7-4f78-a9eb-1f3a36ffa58b service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:01.100354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 703/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:03.053814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79615911-2f54-46fe-a430-f948e7ae1e0d None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:03.054412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79615911-2f54-46fe-a430-f948e7ae1e0d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:03.054412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79615911-2f54-46fe-a430-f948e7ae1e0d None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:03.055959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 701/1404] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:03.061446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fa85c-c9ac-44b4-85fb-669fc1b344aa None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:03.061948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fa85c-c9ac-44b4-85fb-669fc1b344aa None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:03.062055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fa85c-c9ac-44b4-85fb-669fc1b344aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:03.140962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-4c7fa85c-c9ac-44b4-85fb-669fc1b344aa None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:03.142573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4c7fa85c-c9ac-44b4-85fb-669fc1b344aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:03.250252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:03.269382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 704/1405] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:03.556430 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79615911-2f54-46fe-a430-f948e7ae1e0d None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:03.558167 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-79615911-2f54-46fe-a430-f948e7ae1e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:03.771562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79615911-2f54-46fe-a430-f948e7ae1e0d None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:03.834757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:03.910636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d38d0-e591-4352-9757-128b2ef16dc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:03.911255 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d38d0-e591-4352-9757-128b2ef16dc3 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:03.911527 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d38d0-e591-4352-9757-128b2ef16dc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:03.911789 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d38d0-e591-4352-9757-128b2ef16dc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:03.913449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-330d38d0-e591-4352-9757-128b2ef16dc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:04.018984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d38d0-e591-4352-9757-128b2ef16dc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:04.020628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d38d0-e591-4352-9757-128b2ef16dc3 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:04.041295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 702/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:06.096098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788db31e-107a-462e-8d32-5b24d608e2e9 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:06.096098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788db31e-107a-462e-8d32-5b24d608e2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:06.096098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788db31e-107a-462e-8d32-5b24d608e2e9 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:06.101509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 705/1407] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:06.103054 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b94a6-df7c-4863-b606-4ebb6435d5ec None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:06.103526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b94a6-df7c-4863-b606-4ebb6435d5ec None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:06.103622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b94a6-df7c-4863-b606-4ebb6435d5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:06.177485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-678b94a6-df7c-4863-b606-4ebb6435d5ec None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:06.178608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-678b94a6-df7c-4863-b606-4ebb6435d5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:06.194034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:06.290573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 703/1408] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:09:06.590504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788db31e-107a-462e-8d32-5b24d608e2e9 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:06.592396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-788db31e-107a-462e-8d32-5b24d608e2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:06.757991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788db31e-107a-462e-8d32-5b24d608e2e9 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:06.835675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:06.888034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff8076-638b-412c-af6a-645dad85e637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:06.888759 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff8076-638b-412c-af6a-645dad85e637 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:06.889037 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff8076-638b-412c-af6a-645dad85e637 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:06.889349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff8076-638b-412c-af6a-645dad85e637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:06.890983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-fbff8076-638b-412c-af6a-645dad85e637 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:06.987755 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff8076-638b-412c-af6a-645dad85e637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:06.989403 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff8076-638b-412c-af6a-645dad85e637 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:07.008091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 706/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:16.288697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=38 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:17.005717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=64 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:22.425621 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9607ee-5630-4aaf-a9d0-e20855672244 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:22.426220 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9607ee-5630-4aaf-a9d0-e20855672244 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:22.426220 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9607ee-5630-4aaf-a9d0-e20855672244 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:22.427494 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 704/1410] 10.222.0.60 () {54 vars in 918 bytes} [Wed Aug 31 00:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:22.432878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70633a-b4a2-47cc-80c7-85a7d6ecdf8b None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:22.433406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70633a-b4a2-47cc-80c7-85a7d6ecdf8b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:22.433501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70633a-b4a2-47cc-80c7-85a7d6ecdf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:22.513102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-8c70633a-b4a2-47cc-80c7-85a7d6ecdf8b None None] MFA Rules not processed for user `227f958b82a446e19a4d5b29d74193bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:22.514428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8c70633a-b4a2-47cc-80c7-85a7d6ecdf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:22.637649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 707/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Aug 31 00:09:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:22.656567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443296d-5236-4446-8801-cd59acfddaac None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:22.656852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443296d-5236-4446-8801-cd59acfddaac None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:22.657236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443296d-5236-4446-8801-cd59acfddaac None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:22.659245 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 705/1412] 10.222.0.60 () {54 vars in 918 bytes} [Wed Aug 31 00:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:22.665572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea1a99-4293-4498-a326-9faa55929762 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:22.665855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea1a99-4293-4498-a326-9faa55929762 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:22.666125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea1a99-4293-4498-a326-9faa55929762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:22.750970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:22.754421 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-beea1a99-4293-4498-a326-9faa55929762 None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:22.756497 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-beea1a99-4293-4498-a326-9faa55929762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:22.903266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 708/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Aug 31 00:09:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:25.286755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affc8d6-c36d-4bf8-b21e-b74352d520cc None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:25.287662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affc8d6-c36d-4bf8-b21e-b74352d520cc None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:25.287662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affc8d6-c36d-4bf8-b21e-b74352d520cc None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:25.289844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:09:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:25.295228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cd404-14d6-4f8a-bb23-6e054cd461a2 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:25.295683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cd404-14d6-4f8a-bb23-6e054cd461a2 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:25.295793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cd404-14d6-4f8a-bb23-6e054cd461a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:25.363418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ce2cd404-14d6-4f8a-bb23-6e054cd461a2 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:25.364612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ce2cd404-14d6-4f8a-bb23-6e054cd461a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:25.420067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:25.468972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:25.775638 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affc8d6-c36d-4bf8-b21e-b74352d520cc None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:25.778538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7affc8d6-c36d-4bf8-b21e-b74352d520cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:25.936338 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affc8d6-c36d-4bf8-b21e-b74352d520cc None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:26.027154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:26.070707 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904a5c3-65b3-43e4-84cb-aceef014a862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:26.071315 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904a5c3-65b3-43e4-84cb-aceef014a862 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:26.071595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904a5c3-65b3-43e4-84cb-aceef014a862 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:26.071867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904a5c3-65b3-43e4-84cb-aceef014a862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:26.073526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c904a5c3-65b3-43e4-84cb-aceef014a862 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:26.173950 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904a5c3-65b3-43e4-84cb-aceef014a862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:26.175534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904a5c3-65b3-43e4-84cb-aceef014a862 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:26.194517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 707/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:27.079664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac976c6-eef8-4d8b-ac5f-d13355564be4 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:27.080543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac976c6-eef8-4d8b-ac5f-d13355564be4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:27.080543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac976c6-eef8-4d8b-ac5f-d13355564be4 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:27.082585 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:09:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:27.088900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d7047-5822-46f5-86df-d4f0012b7736 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:27.089378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d7047-5822-46f5-86df-d4f0012b7736 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:27.089609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d7047-5822-46f5-86df-d4f0012b7736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:27.171382 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-542d7047-5822-46f5-86df-d4f0012b7736 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:27.172587 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-542d7047-5822-46f5-86df-d4f0012b7736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:27.201305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:27.278682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:27.430105 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac976c6-eef8-4d8b-ac5f-d13355564be4 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:27.432419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0ac976c6-eef8-4d8b-ac5f-d13355564be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:27.611027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac976c6-eef8-4d8b-ac5f-d13355564be4 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:27.657272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:27.733665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605c61b-3f5c-4b95-81fe-ffdd445e3d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:27.734192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605c61b-3f5c-4b95-81fe-ffdd445e3d68 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:27.734466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605c61b-3f5c-4b95-81fe-ffdd445e3d68 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:27.734731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605c61b-3f5c-4b95-81fe-ffdd445e3d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:27.736344 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7605c61b-3f5c-4b95-81fe-ffdd445e3d68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:27.829357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605c61b-3f5c-4b95-81fe-ffdd445e3d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:27.831096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605c61b-3f5c-4b95-81fe-ffdd445e3d68 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:27.849610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 711/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:28.766004 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea682689-0539-47dd-8ae7-1fd6e0d8908c None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:28.767377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea682689-0539-47dd-8ae7-1fd6e0d8908c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:28.767640 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea682689-0539-47dd-8ae7-1fd6e0d8908c None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:28.769923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:09:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:28.778722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d95f2-3d5d-4dec-9a0c-d5d1afe55cfe None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:28.779629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d95f2-3d5d-4dec-9a0c-d5d1afe55cfe None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:28.779629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d95f2-3d5d-4dec-9a0c-d5d1afe55cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:28.842916 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:28.872229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-395d95f2-3d5d-4dec-9a0c-d5d1afe55cfe None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:28.873484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-395d95f2-3d5d-4dec-9a0c-d5d1afe55cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:28.980457 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:29.133353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea682689-0539-47dd-8ae7-1fd6e0d8908c None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:29.134897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ea682689-0539-47dd-8ae7-1fd6e0d8908c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:29.295143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea682689-0539-47dd-8ae7-1fd6e0d8908c None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:29.308979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:29.421482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1066d-e3ef-4597-b21a-08cd4b1891c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:29.422110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1066d-e3ef-4597-b21a-08cd4b1891c0 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:29.422386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1066d-e3ef-4597-b21a-08cd4b1891c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:29.422650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1066d-e3ef-4597-b21a-08cd4b1891c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:29.424273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d4b1066d-e3ef-4597-b21a-08cd4b1891c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:29.518689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1066d-e3ef-4597-b21a-08cd4b1891c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:29.520423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1066d-e3ef-4597-b21a-08cd4b1891c0 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:29.538771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 710/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:30.411036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea748a4-5436-402b-99ad-6b984069b2eb None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:30.411876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea748a4-5436-402b-99ad-6b984069b2eb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:30.411876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea748a4-5436-402b-99ad-6b984069b2eb None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:30.413926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:09:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:30.419336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7faf4-de32-408c-8193-dc66cfce98cc None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:30.419778 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7faf4-de32-408c-8193-dc66cfce98cc None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:30.419889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7faf4-de32-408c-8193-dc66cfce98cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:30.440403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:30.500578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-18d7faf4-de32-408c-8193-dc66cfce98cc None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:30.501851 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-18d7faf4-de32-408c-8193-dc66cfce98cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:30.607679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:30.763468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea748a4-5436-402b-99ad-6b984069b2eb None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:30.766031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-5ea748a4-5436-402b-99ad-6b984069b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:30.896967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:30.934522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea748a4-5436-402b-99ad-6b984069b2eb None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:31.075417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b6f09-8838-4a07-a976-c6d86d6e0ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:31.075931 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b6f09-8838-4a07-a976-c6d86d6e0ca5 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:31.076214 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b6f09-8838-4a07-a976-c6d86d6e0ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:31.076473 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b6f09-8838-4a07-a976-c6d86d6e0ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:31.078121 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-524b6f09-8838-4a07-a976-c6d86d6e0ca5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:31.156725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:31.171888 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b6f09-8838-4a07-a976-c6d86d6e0ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:31.173584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b6f09-8838-4a07-a976-c6d86d6e0ca5 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:31.193233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 714/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:32.067570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe030b2-3e0a-4921-8f4f-62fe3b197acf None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:32.068190 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe030b2-3e0a-4921-8f4f-62fe3b197acf None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:32.068190 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe030b2-3e0a-4921-8f4f-62fe3b197acf None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:32.069542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:32.075585 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336bfc4-90f2-4554-a28f-e54e853f2580 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:32.076060 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336bfc4-90f2-4554-a28f-e54e853f2580 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:32.076167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336bfc4-90f2-4554-a28f-e54e853f2580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:32.168229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-e336bfc4-90f2-4554-a28f-e54e853f2580 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:32.169461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e336bfc4-90f2-4554-a28f-e54e853f2580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:32.280934 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:32.432671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe030b2-3e0a-4921-8f4f-62fe3b197acf None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:32.435281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9fe030b2-3e0a-4921-8f4f-62fe3b197acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:32.532728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:32.602932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe030b2-3e0a-4921-8f4f-62fe3b197acf None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:32.726175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de786e-7973-4438-a45b-6093fd07316e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:32.726900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de786e-7973-4438-a45b-6093fd07316e service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:32.727205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de786e-7973-4438-a45b-6093fd07316e service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:32.727463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de786e-7973-4438-a45b-6093fd07316e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:32.729961 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-31de786e-7973-4438-a45b-6093fd07316e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:32.781564 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:32.824293 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de786e-7973-4438-a45b-6093fd07316e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:32.826065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de786e-7973-4438-a45b-6093fd07316e service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:32.846645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 713/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:33.649964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184a92-ef3b-4f47-b53b-ab5309589994 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:33.651303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184a92-ef3b-4f47-b53b-ab5309589994 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:33.651303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184a92-ef3b-4f47-b53b-ab5309589994 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:33.653390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:09:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:33.659574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1d93-1357-47f4-8851-e58ca2cce10d None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:33.660013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1d93-1357-47f4-8851-e58ca2cce10d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:33.660116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1d93-1357-47f4-8851-e58ca2cce10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:33.745458 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-157d1d93-1357-47f4-8851-e58ca2cce10d None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:33.746696 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-157d1d93-1357-47f4-8851-e58ca2cce10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:33.850205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:34.004713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184a92-ef3b-4f47-b53b-ab5309589994 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:34.006267 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7d184a92-ef3b-4f47-b53b-ab5309589994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:34.064963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:34.172753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184a92-ef3b-4f47-b53b-ab5309589994 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:34.291644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf04874-470e-4f37-bc5a-610e2e41584e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:34.292251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf04874-470e-4f37-bc5a-610e2e41584e service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:34.292519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf04874-470e-4f37-bc5a-610e2e41584e service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:34.292788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf04874-470e-4f37-bc5a-610e2e41584e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:34.294477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-bbf04874-470e-4f37-bc5a-610e2e41584e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:34.301776 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:34.402962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf04874-470e-4f37-bc5a-610e2e41584e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:34.404655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf04874-470e-4f37-bc5a-610e2e41584e service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:34.423811 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 717/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:35.301676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05ecdc-2d8a-4623-b424-83e4ff1d80be None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:35.302614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05ecdc-2d8a-4623-b424-83e4ff1d80be None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:35.302614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05ecdc-2d8a-4623-b424-83e4ff1d80be None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:35.304614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:09:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:35.311970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003602-f426-42ea-8ef6-375381fd5026 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:35.312406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003602-f426-42ea-8ef6-375381fd5026 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:35.312510 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003602-f426-42ea-8ef6-375381fd5026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:35.395323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-df003602-f426-42ea-8ef6-375381fd5026 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:35.396514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-df003602-f426-42ea-8ef6-375381fd5026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:35.484396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:35.523418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:35.681464 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05ecdc-2d8a-4623-b424-83e4ff1d80be None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:35.683053 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8e05ecdc-2d8a-4623-b424-83e4ff1d80be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:35.703915 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:35.851358 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05ecdc-2d8a-4623-b424-83e4ff1d80be None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:35.947509 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:35.992538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95b4d0-38c9-4875-9137-a9b420a4abd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:35.993452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95b4d0-38c9-4875-9137-a9b420a4abd8 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:35.993813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95b4d0-38c9-4875-9137-a9b420a4abd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:35.994162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95b4d0-38c9-4875-9137-a9b420a4abd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:35.996701 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ec95b4d0-38c9-4875-9137-a9b420a4abd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:36.096727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95b4d0-38c9-4875-9137-a9b420a4abd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:36.098372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95b4d0-38c9-4875-9137-a9b420a4abd8 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:36.116648 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 716/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:36.948441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207eaf4-6920-462f-8841-0221812209e6 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:36.949017 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207eaf4-6920-462f-8841-0221812209e6 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:36.949017 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207eaf4-6920-462f-8841-0221812209e6 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:36.950321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:36.956571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213eba9-4252-4545-aa0b-eb9b352132a9 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:36.957318 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213eba9-4252-4545-aa0b-eb9b352132a9 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:36.957513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213eba9-4252-4545-aa0b-eb9b352132a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:37.040006 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-9213eba9-4252-4545-aa0b-eb9b352132a9 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:37.041251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9213eba9-4252-4545-aa0b-eb9b352132a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:37.086656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:37.146325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:37.309870 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207eaf4-6920-462f-8841-0221812209e6 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:37.312344 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c207eaf4-6920-462f-8841-0221812209e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:37.472236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207eaf4-6920-462f-8841-0221812209e6 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:37.532755 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:37.621370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269808f-bb1b-4110-9f95-9946046b1285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:37.621934 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269808f-bb1b-4110-9f95-9946046b1285 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:37.622215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269808f-bb1b-4110-9f95-9946046b1285 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:37.622475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269808f-bb1b-4110-9f95-9946046b1285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:37.624143 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b269808f-bb1b-4110-9f95-9946046b1285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:37.716707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269808f-bb1b-4110-9f95-9946046b1285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:37.718341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269808f-bb1b-4110-9f95-9946046b1285 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:37.736665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 720/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:38.551990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05ca26-b87c-4958-aebb-0c0aebbec4eb None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:38.552549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05ca26-b87c-4958-aebb-0c0aebbec4eb None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:38.552549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05ca26-b87c-4958-aebb-0c0aebbec4eb None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:38.553895 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:38.559034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f756c-1dfb-4454-953d-4a560e9267aa None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:38.559489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f756c-1dfb-4454-953d-4a560e9267aa None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:38.559599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f756c-1dfb-4454-953d-4a560e9267aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:38.642716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-fc8f756c-1dfb-4454-953d-4a560e9267aa None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:38.643948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-fc8f756c-1dfb-4454-953d-4a560e9267aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:38.646066 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:38.747179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:38.901068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05ca26-b87c-4958-aebb-0c0aebbec4eb None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:38.902537 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9f05ca26-b87c-4958-aebb-0c0aebbec4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:39.055834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05ca26-b87c-4958-aebb-0c0aebbec4eb None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:39.083854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:39.185822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f9514-9a5f-4093-98b2-5993c26e84c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:39.186361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f9514-9a5f-4093-98b2-5993c26e84c7 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:39.186631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f9514-9a5f-4093-98b2-5993c26e84c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:39.186892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f9514-9a5f-4093-98b2-5993c26e84c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:39.188497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-981f9514-9a5f-4093-98b2-5993c26e84c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:39.300511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f9514-9a5f-4093-98b2-5993c26e84c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:39.302145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f9514-9a5f-4093-98b2-5993c26e84c7 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:39.320984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 719/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:41.138308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85521a-efa2-4f32-b555-3f84150dba08 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:41.138902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85521a-efa2-4f32-b555-3f84150dba08 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:41.138902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85521a-efa2-4f32-b555-3f84150dba08 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:41.140182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:41.146897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0e958-23e7-4338-88db-1a11753935e7 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:41.147650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0e958-23e7-4338-88db-1a11753935e7 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:41.147787 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0e958-23e7-4338-88db-1a11753935e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:41.199837 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:41.227492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-8bf0e958-23e7-4338-88db-1a11753935e7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:41.228742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8bf0e958-23e7-4338-88db-1a11753935e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:41.349676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:41.640124 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85521a-efa2-4f32-b555-3f84150dba08 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:41.641719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3b85521a-efa2-4f32-b555-3f84150dba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:41.761750 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85521a-efa2-4f32-b555-3f84150dba08 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:41.796925 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:41.843874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3ed14-1da1-498c-b8d0-3f0c1e4860fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:41.844493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ed14-1da1-498c-b8d0-3f0c1e4860fe service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:41.844790 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ed14-1da1-498c-b8d0-3f0c1e4860fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:41.845060 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ed14-1da1-498c-b8d0-3f0c1e4860fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:41.846707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-48d3ed14-1da1-498c-b8d0-3f0c1e4860fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:41.961680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3ed14-1da1-498c-b8d0-3f0c1e4860fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:41.963131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3ed14-1da1-498c-b8d0-3f0c1e4860fe service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:41.981917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 723/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:09:44.089090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f57aa-44eb-4358-9e88-d1d8d0c63e0a None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:44.089981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f57aa-44eb-4358-9e88-d1d8d0c63e0a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:44.089981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f57aa-44eb-4358-9e88-d1d8d0c63e0a None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:44.092353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:09:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:44.100625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d379b15-6e3f-4372-b189-c6c86c3e2668 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:44.101129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d379b15-6e3f-4372-b189-c6c86c3e2668 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:44.101264 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d379b15-6e3f-4372-b189-c6c86c3e2668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:44.173438 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-0d379b15-6e3f-4372-b189-c6c86c3e2668 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:44.174646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0d379b15-6e3f-4372-b189-c6c86c3e2668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:44.188042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:44.282689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:44.568711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f57aa-44eb-4358-9e88-d1d8d0c63e0a None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:44.571353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-fd1f57aa-44eb-4358-9e88-d1d8d0c63e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:44.698849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f57aa-44eb-4358-9e88-d1d8d0c63e0a None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:44.712743 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:44.777975 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb5234-ba22-4f8d-9bd0-44a0fbf27311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:44.778576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb5234-ba22-4f8d-9bd0-44a0fbf27311 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:44.778847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb5234-ba22-4f8d-9bd0-44a0fbf27311 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:44.779107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb5234-ba22-4f8d-9bd0-44a0fbf27311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:44.780725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-73eb5234-ba22-4f8d-9bd0-44a0fbf27311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:44.900893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb5234-ba22-4f8d-9bd0-44a0fbf27311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:44.902402 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb5234-ba22-4f8d-9bd0-44a0fbf27311 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:44.924735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 722/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:47.213242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be8d8-887f-4af3-860e-44bcaa1cd311 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:47.214103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be8d8-887f-4af3-860e-44bcaa1cd311 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:47.214279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be8d8-887f-4af3-860e-44bcaa1cd311 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:47.216212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:09:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:47.222861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792ecae-ba99-47fb-bd2c-272e3b8de9a9 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:47.223470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792ecae-ba99-47fb-bd2c-272e3b8de9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:47.223639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792ecae-ba99-47fb-bd2c-272e3b8de9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:47.282841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:47.313520 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e792ecae-ba99-47fb-bd2c-272e3b8de9a9 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:47.314728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e792ecae-ba99-47fb-bd2c-272e3b8de9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:47.420942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:47.711420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be8d8-887f-4af3-860e-44bcaa1cd311 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:47.713976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-078be8d8-887f-4af3-860e-44bcaa1cd311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:47.826544 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be8d8-887f-4af3-860e-44bcaa1cd311 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:47.870913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:47.911600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf624e09-f4dc-44a9-9981-957c4db27f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:47.912185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf624e09-f4dc-44a9-9981-957c4db27f56 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:47.912453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf624e09-f4dc-44a9-9981-957c4db27f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:47.912715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf624e09-f4dc-44a9-9981-957c4db27f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:47.914314 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-bf624e09-f4dc-44a9-9981-957c4db27f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:48.036910 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf624e09-f4dc-44a9-9981-957c4db27f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:48.038421 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf624e09-f4dc-44a9-9981-957c4db27f56 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:48.056997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 726/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:50.121445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069c9ee-ec76-4dec-b1d8-df21e897c083 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:50.122124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069c9ee-ec76-4dec-b1d8-df21e897c083 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:50.122124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069c9ee-ec76-4dec-b1d8-df21e897c083 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:50.123836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:50.129678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b763-1416-4db0-9096-9a806f51c863 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:50.130200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b763-1416-4db0-9096-9a806f51c863 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:50.130200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b763-1416-4db0-9096-9a806f51c863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:50.200425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d8f9b763-1416-4db0-9096-9a806f51c863 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:50.201665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d8f9b763-1416-4db0-9096-9a806f51c863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:50.222936 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:50.314121 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:50.608863 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069c9ee-ec76-4dec-b1d8-df21e897c083 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:50.611258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1069c9ee-ec76-4dec-b1d8-df21e897c083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:50.725495 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069c9ee-ec76-4dec-b1d8-df21e897c083 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:50.745883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:50.807256 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e03e4-e364-4f47-9dd8-e462c63e4421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:50.807866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e03e4-e364-4f47-9dd8-e462c63e4421 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:50.808140 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e03e4-e364-4f47-9dd8-e462c63e4421 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:50.808403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e03e4-e364-4f47-9dd8-e462c63e4421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:50.810225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a12e03e4-e364-4f47-9dd8-e462c63e4421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:50.928003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e03e4-e364-4f47-9dd8-e462c63e4421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:50.929393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e03e4-e364-4f47-9dd8-e462c63e4421 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:50.950015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 725/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:53.024343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef4da6-8745-4a5f-a730-181e736b5547 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:53.024953 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef4da6-8745-4a5f-a730-181e736b5547 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:53.024953 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef4da6-8745-4a5f-a730-181e736b5547 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:53.026758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:53.035536 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ceb2c-5c1c-45b3-801b-1fe58ef9382e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:53.036283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ceb2c-5c1c-45b3-801b-1fe58ef9382e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:53.036449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ceb2c-5c1c-45b3-801b-1fe58ef9382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:53.110312 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:53.112980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e05ceb2c-5c1c-45b3-801b-1fe58ef9382e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:53.114206 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e05ceb2c-5c1c-45b3-801b-1fe58ef9382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:53.355327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:09:53.639551 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef4da6-8745-4a5f-a730-181e736b5547 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:53.641097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0cef4da6-8745-4a5f-a730-181e736b5547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:53.769501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef4da6-8745-4a5f-a730-181e736b5547 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:53.826737 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:53.864067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49650fa0-aa4f-4fca-b905-eb1ef3681369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:53.864686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49650fa0-aa4f-4fca-b905-eb1ef3681369 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:53.864961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49650fa0-aa4f-4fca-b905-eb1ef3681369 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:53.865235 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49650fa0-aa4f-4fca-b905-eb1ef3681369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:53.866888 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-49650fa0-aa4f-4fca-b905-eb1ef3681369 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:53.992949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49650fa0-aa4f-4fca-b905-eb1ef3681369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:53.994446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49650fa0-aa4f-4fca-b905-eb1ef3681369 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:54.013090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 729/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:56.166270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823f844-e903-4141-82bf-36a91126996e None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:56.167115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823f844-e903-4141-82bf-36a91126996e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:56.167115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823f844-e903-4141-82bf-36a91126996e None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:56.169833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:09:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:56.175408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d786-e6b1-47fd-9132-996347b682ba None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:56.175875 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d786-e6b1-47fd-9132-996347b682ba None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:56.175998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d786-e6b1-47fd-9132-996347b682ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:56.245964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-f407d786-e6b1-47fd-9132-996347b682ba None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:56.247730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f407d786-e6b1-47fd-9132-996347b682ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:56.278410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:56.353233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:09:56.640656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823f844-e903-4141-82bf-36a91126996e None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:56.642253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8823f844-e903-4141-82bf-36a91126996e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:56.759484 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823f844-e903-4141-82bf-36a91126996e None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:56.790656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:56.839127 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b014e65-353f-42ac-9100-7a0d5483348c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:56.839816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b014e65-353f-42ac-9100-7a0d5483348c service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:56.840550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b014e65-353f-42ac-9100-7a0d5483348c service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:56.840832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b014e65-353f-42ac-9100-7a0d5483348c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:56.842474 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-6b014e65-353f-42ac-9100-7a0d5483348c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:56.961405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b014e65-353f-42ac-9100-7a0d5483348c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:56.963543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b014e65-353f-42ac-9100-7a0d5483348c service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:56.984915 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 728/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:09:58.931019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077bd69-2cc9-4c16-942a-cefc8c55e0d9 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:58.931614 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077bd69-2cc9-4c16-942a-cefc8c55e0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:58.931614 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077bd69-2cc9-4c16-942a-cefc8c55e0d9 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:58.933775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:09:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:58.939607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccb8f4-25cf-4237-9410-fdb215e12d6f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:58.940065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccb8f4-25cf-4237-9410-fdb215e12d6f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:58.940158 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccb8f4-25cf-4237-9410-fdb215e12d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:59.027901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-a9ccb8f4-25cf-4237-9410-fdb215e12d6f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:59.029130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a9ccb8f4-25cf-4237-9410-fdb215e12d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:59.038015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:59.135387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:09:59.422243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077bd69-2cc9-4c16-942a-cefc8c55e0d9 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:59.424704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c077bd69-2cc9-4c16-942a-cefc8c55e0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:59.543360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077bd69-2cc9-4c16-942a-cefc8c55e0d9 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:59.604064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:59.628852 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e3711-f4e3-49e7-809b-35fc177a01e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:59.629736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e3711-f4e3-49e7-809b-35fc177a01e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:59.630091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e3711-f4e3-49e7-809b-35fc177a01e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:59.630398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e3711-f4e3-49e7-809b-35fc177a01e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:59.632648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-060e3711-f4e3-49e7-809b-35fc177a01e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:59.754947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e3711-f4e3-49e7-809b-35fc177a01e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:59.756407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e3711-f4e3-49e7-809b-35fc177a01e4 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:59.780629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 732/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:09:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:10:01.776613 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade7e8f-6d4a-45b7-8dcd-66cc60056b80 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:01.777313 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade7e8f-6d4a-45b7-8dcd-66cc60056b80 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:01.777313 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade7e8f-6d4a-45b7-8dcd-66cc60056b80 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:01.778571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:01.784785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8c528-d415-4036-9870-e3da0b4e1108 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:01.785230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8c528-d415-4036-9870-e3da0b4e1108 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:01.785358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8c528-d415-4036-9870-e3da0b4e1108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:01.858041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-4fa8c528-d415-4036-9870-e3da0b4e1108 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:01.859273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4fa8c528-d415-4036-9870-e3da0b4e1108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:01.897778 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:01.962376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:10:02.252539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade7e8f-6d4a-45b7-8dcd-66cc60056b80 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:02.255031 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-bade7e8f-6d4a-45b7-8dcd-66cc60056b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:02.380446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade7e8f-6d4a-45b7-8dcd-66cc60056b80 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:02.428802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:02.465907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f68d0-41d3-42d3-91a7-c775898ebc72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:02.466573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f68d0-41d3-42d3-91a7-c775898ebc72 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:02.466837 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f68d0-41d3-42d3-91a7-c775898ebc72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:02.467099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f68d0-41d3-42d3-91a7-c775898ebc72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:02.468681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-629f68d0-41d3-42d3-91a7-c775898ebc72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:02.588877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f68d0-41d3-42d3-91a7-c775898ebc72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:02.590352 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f68d0-41d3-42d3-91a7-c775898ebc72 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:02.611738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 731/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:10:04.722542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e760d1-df55-41ed-838a-ccada6013305 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:04.723455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e760d1-df55-41ed-838a-ccada6013305 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:04.723455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e760d1-df55-41ed-838a-ccada6013305 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:04.725721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:10:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:04.731384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d1822-e065-4750-a419-0cf87a491d00 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:04.731835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d1822-e065-4750-a419-0cf87a491d00 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:04.731947 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d1822-e065-4750-a419-0cf87a491d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:04.801967 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-274d1822-e065-4750-a419-0cf87a491d00 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:04.803166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-274d1822-e065-4750-a419-0cf87a491d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:04.830907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:04.926888 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:10:05.231789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e760d1-df55-41ed-838a-ccada6013305 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:05.234382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-58e760d1-df55-41ed-838a-ccada6013305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:05.346080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e760d1-df55-41ed-838a-ccada6013305 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:05.425110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:05.433154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609996b0-2561-403e-a5a6-88f67fc43d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:05.433895 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609996b0-2561-403e-a5a6-88f67fc43d44 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:05.434165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609996b0-2561-403e-a5a6-88f67fc43d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:05.434442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609996b0-2561-403e-a5a6-88f67fc43d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:05.436044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-609996b0-2561-403e-a5a6-88f67fc43d44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:05.561525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609996b0-2561-403e-a5a6-88f67fc43d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:05.562981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609996b0-2561-403e-a5a6-88f67fc43d44 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:05.581790 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 735/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:10:07.561772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0091f22-b163-459d-b18a-8def14f74aff None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:07.562348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0091f22-b163-459d-b18a-8def14f74aff None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:07.562348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0091f22-b163-459d-b18a-8def14f74aff None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:07.563655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:07.569188 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9c931-3b62-4283-a006-5502b72745bc None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:07.569649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9c931-3b62-4283-a006-5502b72745bc None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:07.569773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9c931-3b62-4283-a006-5502b72745bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:07.646146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-e9c9c931-3b62-4283-a006-5502b72745bc None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:07.647374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e9c9c931-3b62-4283-a006-5502b72745bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:07.708728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:07.774472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:10:08.061939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0091f22-b163-459d-b18a-8def14f74aff None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:08.064365 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c0091f22-b163-459d-b18a-8def14f74aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:08.187879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0091f22-b163-459d-b18a-8def14f74aff None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:08.239416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:08.266061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef51f83-ee53-40e5-9ae7-da2ab710a53b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:08.266680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef51f83-ee53-40e5-9ae7-da2ab710a53b service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:08.266950 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef51f83-ee53-40e5-9ae7-da2ab710a53b service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:08.267209 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef51f83-ee53-40e5-9ae7-da2ab710a53b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:08.268816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-cef51f83-ee53-40e5-9ae7-da2ab710a53b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:08.381054 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef51f83-ee53-40e5-9ae7-da2ab710a53b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:08.382504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef51f83-ee53-40e5-9ae7-da2ab710a53b service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:08.400649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 734/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:10:17.771200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=22 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:18.398203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=66 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:27.905273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c904-c575-4623-a924-888851b2eb77 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:27.905801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c904-c575-4623-a924-888851b2eb77 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:27.905801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c904-c575-4623-a924-888851b2eb77 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:27.907093 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 737/1471] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:27.912691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a541-e353-476f-8647-026753e8c66a None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:27.913121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a541-e353-476f-8647-026753e8c66a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:27.913273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a541-e353-476f-8647-026753e8c66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:27.982971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-b627a541-e353-476f-8647-026753e8c66a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:27.984231 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b627a541-e353-476f-8647-026753e8c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:28.084893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 735/1472] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:10:28.378810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4f018-3558-4d3e-96d8-9d94da172cc7 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:28.379097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4f018-3558-4d3e-96d8-9d94da172cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:28.379361 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4f018-3558-4d3e-96d8-9d94da172cc7 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:28.380806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 738/1473] 10.222.0.60 () {54 vars in 967 bytes} [Wed Aug 31 00:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:28.385700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd99b93-6fb7-4420-92ef-f1804208b57d None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:28.386081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd99b93-6fb7-4420-92ef-f1804208b57d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:28.386356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd99b93-6fb7-4420-92ef-f1804208b57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:28.472286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-edd99b93-6fb7-4420-92ef-f1804208b57d None None] MFA Rules not processed for user `d967a3fa32ef48b68c9e3a174f0c9a03`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:28.473533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-edd99b93-6fb7-4420-92ef-f1804208b57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:28.495529 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:28.552290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 736/1474] 10.222.0.60 () {58 vars in 1064 bytes} [Wed Aug 31 00:10:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:10:28.560254 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4f018-3558-4d3e-96d8-9d94da172cc7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:28.561835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2fa4f018-3558-4d3e-96d8-9d94da172cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:28.672961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4f018-3558-4d3e-96d8-9d94da172cc7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:28.748348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd88813-5f5c-48a1-9aad-b43503d04296 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd967a3fa32ef48b68c9e3a174f0c9a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:28.748967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd88813-5f5c-48a1-9aad-b43503d04296 service glance] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:28.749278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd88813-5f5c-48a1-9aad-b43503d04296 service glance] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:28.749543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd88813-5f5c-48a1-9aad-b43503d04296 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:28.751158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6fd88813-5f5c-48a1-9aad-b43503d04296 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:28.809761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:28.866816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd88813-5f5c-48a1-9aad-b43503d04296 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:28.868396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd88813-5f5c-48a1-9aad-b43503d04296 service glance] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:28.890916 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 739/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:10:30.921171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ee0d8-db35-49ba-a6e0-054c7203d49a None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:30.921760 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ee0d8-db35-49ba-a6e0-054c7203d49a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:30.921760 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ee0d8-db35-49ba-a6e0-054c7203d49a None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:30.923079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 737/1476] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:30.928487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e2c73-6caa-4956-a35a-4d3db0101005 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:30.928918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e2c73-6caa-4956-a35a-4d3db0101005 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:30.929031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e2c73-6caa-4956-a35a-4d3db0101005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:31.127432 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-c41e2c73-6caa-4956-a35a-4d3db0101005 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:31.128670 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c41e2c73-6caa-4956-a35a-4d3db0101005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:31.228426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 740/1477] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:10:31.500216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ee0d8-db35-49ba-a6e0-054c7203d49a None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:31.501749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0d6ee0d8-db35-49ba-a6e0-054c7203d49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:31.634928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ee0d8-db35-49ba-a6e0-054c7203d49a None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:31.690684 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:31.738939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5f382-c1d2-4a97-a40f-7e30cfca39f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:31.739546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5f382-c1d2-4a97-a40f-7e30cfca39f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:31.739815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5f382-c1d2-4a97-a40f-7e30cfca39f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:31.740069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5f382-c1d2-4a97-a40f-7e30cfca39f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:31.740723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5f382-c1d2-4a97-a40f-7e30cfca39f2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:31.742491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: WARNING py.warnings [None req-ced5f382-c1d2-4a97-a40f-7e30cfca39f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:10:31.742491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: warnings.warn(msg) Aug 31 00:10:31.742491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: Aug 31 00:10:31.743614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5f382-c1d2-4a97-a40f-7e30cfca39f2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:31.763168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 738/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:31 2022] GET /identity/v3/projects => generated 2553 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:10:33.715569 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce893a-6356-4d3a-a280-29dbe928ff1b None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:33.716178 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce893a-6356-4d3a-a280-29dbe928ff1b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:33.716178 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce893a-6356-4d3a-a280-29dbe928ff1b None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:33.717493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 741/1479] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:10:33.723318 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7be2-ee97-4866-8c84-50cf1b538cad None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:33.723790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7be2-ee97-4866-8c84-50cf1b538cad None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:33.723905 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7be2-ee97-4866-8c84-50cf1b538cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:33.796545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-758e7be2-ee97-4866-8c84-50cf1b538cad None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:33.797854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-758e7be2-ee97-4866-8c84-50cf1b538cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:33.895522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 739/1480] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:10:34.194226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce893a-6356-4d3a-a280-29dbe928ff1b None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:34.195968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8fce893a-6356-4d3a-a280-29dbe928ff1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:34.206288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:34.344831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce893a-6356-4d3a-a280-29dbe928ff1b None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:34.427944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:34.461755 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7a99d-40be-4e90-8bbf-a645d13ccbcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:34.462364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7a99d-40be-4e90-8bbf-a645d13ccbcc service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:34.462638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7a99d-40be-4e90-8bbf-a645d13ccbcc service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:34.462878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7a99d-40be-4e90-8bbf-a645d13ccbcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:34.464548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3dc7a99d-40be-4e90-8bbf-a645d13ccbcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:34.566549 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7a99d-40be-4e90-8bbf-a645d13ccbcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:34.568332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7a99d-40be-4e90-8bbf-a645d13ccbcc service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:34.586355 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 742/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:10:36.694410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb7bb-2372-42fd-9e37-b44d6b50a844 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:36.695026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb7bb-2372-42fd-9e37-b44d6b50a844 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:36.695026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb7bb-2372-42fd-9e37-b44d6b50a844 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:36.697142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 740/1482] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:10:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:36.706344 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e27ec0-407b-4dc8-ad7a-f95b2f63fa52 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:36.707116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e27ec0-407b-4dc8-ad7a-f95b2f63fa52 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:36.707328 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e27ec0-407b-4dc8-ad7a-f95b2f63fa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:36.780563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-19e27ec0-407b-4dc8-ad7a-f95b2f63fa52 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:36.781825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-19e27ec0-407b-4dc8-ad7a-f95b2f63fa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:36.830749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:36.882914 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 743/1483] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:10:37.174786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fb7bb-2372-42fd-9e37-b44d6b50a844 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:37.177284 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e99fb7bb-2372-42fd-9e37-b44d6b50a844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:37.211156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:37.304250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fb7bb-2372-42fd-9e37-b44d6b50a844 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:37.383684 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c03433-6f1c-477e-8df6-3a2f9eea0de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:37.384311 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c03433-6f1c-477e-8df6-3a2f9eea0de2 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:37.384591 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c03433-6f1c-477e-8df6-3a2f9eea0de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:37.384857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c03433-6f1c-477e-8df6-3a2f9eea0de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:37.386627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d9c03433-6f1c-477e-8df6-3a2f9eea0de2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:37.472266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:37.511270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c03433-6f1c-477e-8df6-3a2f9eea0de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:37.512693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c03433-6f1c-477e-8df6-3a2f9eea0de2 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:37.531710 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 741/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:10:39.534976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5224f-80df-4a64-97e0-641ced664991 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:39.535584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5224f-80df-4a64-97e0-641ced664991 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:39.535584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5224f-80df-4a64-97e0-641ced664991 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:39.536847 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 744/1485] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:39.542337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822d566-ea19-4390-ac2c-04105539305b None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:39.542811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822d566-ea19-4390-ac2c-04105539305b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:39.542916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822d566-ea19-4390-ac2c-04105539305b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:39.614954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-a822d566-ea19-4390-ac2c-04105539305b None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:39.616178 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a822d566-ea19-4390-ac2c-04105539305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:39.717159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 742/1486] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:10:40.015144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5224f-80df-4a64-97e0-641ced664991 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:40.016738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d8f5224f-80df-4a64-97e0-641ced664991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:40.146901 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5224f-80df-4a64-97e0-641ced664991 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:40.225268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:40.227236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df555623-d634-4c52-af7e-0695210a8e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:40.227894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df555623-d634-4c52-af7e-0695210a8e66 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:40.228169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df555623-d634-4c52-af7e-0695210a8e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:40.228424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df555623-d634-4c52-af7e-0695210a8e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:40.231013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-df555623-d634-4c52-af7e-0695210a8e66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:40.350082 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df555623-d634-4c52-af7e-0695210a8e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:40.351524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df555623-d634-4c52-af7e-0695210a8e66 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:40.372428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 745/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:10:42.489453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e44602-bd7a-4318-8c13-bf2f0bbe5044 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:42.490073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e44602-bd7a-4318-8c13-bf2f0bbe5044 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:42.490073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e44602-bd7a-4318-8c13-bf2f0bbe5044 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:42.492004 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 743/1488] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:10:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:42.498439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493faa3-496d-48f2-b762-489aa2acd2f0 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:42.498891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493faa3-496d-48f2-b762-489aa2acd2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:42.498998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493faa3-496d-48f2-b762-489aa2acd2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:42.581228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-3493faa3-496d-48f2-b762-489aa2acd2f0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:42.582455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3493faa3-496d-48f2-b762-489aa2acd2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:42.650798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:42.697404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 746/1489] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:10:43.031584 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e44602-bd7a-4318-8c13-bf2f0bbe5044 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:43.033148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b6e44602-bd7a-4318-8c13-bf2f0bbe5044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:43.070116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:43.150037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e44602-bd7a-4318-8c13-bf2f0bbe5044 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:43.241015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919be4e-e14c-4850-90b1-0a5581a4f74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:43.241660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919be4e-e14c-4850-90b1-0a5581a4f74c service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:43.241948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919be4e-e14c-4850-90b1-0a5581a4f74c service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:43.242208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919be4e-e14c-4850-90b1-0a5581a4f74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:43.243840 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a919be4e-e14c-4850-90b1-0a5581a4f74c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:43.328885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:43.359481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919be4e-e14c-4850-90b1-0a5581a4f74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:43.360900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919be4e-e14c-4850-90b1-0a5581a4f74c service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:43.380669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 744/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:10:45.529227 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e5645-8cff-491e-9a52-d23f50bb1402 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:45.529914 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e5645-8cff-491e-9a52-d23f50bb1402 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:45.529914 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e5645-8cff-491e-9a52-d23f50bb1402 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:45.531103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 747/1491] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 31 00:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:45.539064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4301509-c9eb-4ac2-9cad-8573a17855dc None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:45.539867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4301509-c9eb-4ac2-9cad-8573a17855dc None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:45.539867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4301509-c9eb-4ac2-9cad-8573a17855dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:45.627683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-b4301509-c9eb-4ac2-9cad-8573a17855dc None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:45.628918 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b4301509-c9eb-4ac2-9cad-8573a17855dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:45.730118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 745/1492] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:10:46.021321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e5645-8cff-491e-9a52-d23f50bb1402 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:46.023703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e56e5645-8cff-491e-9a52-d23f50bb1402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:46.153483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e5645-8cff-491e-9a52-d23f50bb1402 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:46.232042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe9f6b-c276-4646-968d-39286d6bce21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:46.232638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe9f6b-c276-4646-968d-39286d6bce21 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:46.232908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe9f6b-c276-4646-968d-39286d6bce21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:46.233169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe9f6b-c276-4646-968d-39286d6bce21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:46.234803 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-23fe9f6b-c276-4646-968d-39286d6bce21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:46.243880 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:46.351112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe9f6b-c276-4646-968d-39286d6bce21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:46.352570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe9f6b-c276-4646-968d-39286d6bce21 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:46.371121 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 748/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:10:55.727952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=82 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:56.368614 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=50 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:00.482377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72b505-a134-4a26-9ff6-163a99864e57 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:00.482966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72b505-a134-4a26-9ff6-163a99864e57 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:00.482966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72b505-a134-4a26-9ff6-163a99864e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:00.564934 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-2c72b505-a134-4a26-9ff6-163a99864e57 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:00.566197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2c72b505-a134-4a26-9ff6-163a99864e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:00.671023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 746/1494] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:00.679702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba81e-8057-4392-b3e7-29a91cd1b840 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:00.680908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba81e-8057-4392-b3e7-29a91cd1b840 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:00.680908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba81e-8057-4392-b3e7-29a91cd1b840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:00.764821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-e01ba81e-8057-4392-b3e7-29a91cd1b840 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:00.766110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e01ba81e-8057-4392-b3e7-29a91cd1b840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:00.870774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 749/1495] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:00.875811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72b505-a134-4a26-9ff6-163a99864e57 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:00.877083 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2c72b505-a134-4a26-9ff6-163a99864e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:00.889033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72b505-a134-4a26-9ff6-163a99864e57 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:00.968535 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:01.009251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d4652-77c4-49b4-91cc-c8b3d7f4e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:01.009621 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d4652-77c4-49b4-91cc-c8b3d7f4e8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:01.009917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d4652-77c4-49b4-91cc-c8b3d7f4e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:01.010176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d4652-77c4-49b4-91cc-c8b3d7f4e8f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:01.010814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d4652-77c4-49b4-91cc-c8b3d7f4e8f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:12:01.011106 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d4652-77c4-49b4-91cc-c8b3d7f4e8f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:01.012145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: WARNING py.warnings [None req-1d9d4652-77c4-49b4-91cc-c8b3d7f4e8f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:12:01.012145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: warnings.warn(msg) Aug 31 00:12:01.012145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: Aug 31 00:12:01.012990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d4652-77c4-49b4-91cc-c8b3d7f4e8f5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:01.026230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 747/1496] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:12:01.035080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba81e-8057-4392-b3e7-29a91cd1b840 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:01.044924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba81e-8057-4392-b3e7-29a91cd1b840 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:01.116928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:01.158917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffb606-281d-4bba-a9fd-2162761d1828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:01.159716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffb606-281d-4bba-a9fd-2162761d1828 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:01.160073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffb606-281d-4bba-a9fd-2162761d1828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:01.160418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffb606-281d-4bba-a9fd-2162761d1828 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:01.161275 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffb606-281d-4bba-a9fd-2162761d1828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:01.163928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: WARNING py.warnings [None req-e1ffb606-281d-4bba-a9fd-2162761d1828 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:12:01.163928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: warnings.warn(msg) Aug 31 00:12:01.163928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: Aug 31 00:12:01.165275 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffb606-281d-4bba-a9fd-2162761d1828 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:01.227625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 750/1497] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:12:01 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:12:01.232020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d4652-77c4-49b4-91cc-c8b3d7f4e8f5 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:01.233626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1d9d4652-77c4-49b4-91cc-c8b3d7f4e8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:01.269660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d4652-77c4-49b4-91cc-c8b3d7f4e8f5 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:01.395220 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840128e0-a238-4b1b-a692-6d0324352d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:01.395848 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840128e0-a238-4b1b-a692-6d0324352d51 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:01.396161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840128e0-a238-4b1b-a692-6d0324352d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:01.396504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840128e0-a238-4b1b-a692-6d0324352d51 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:01.397493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840128e0-a238-4b1b-a692-6d0324352d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:01.399219 dv-cinder-852209-8-smb devstack@keystone.service[81709]: WARNING py.warnings [None req-840128e0-a238-4b1b-a692-6d0324352d51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:12:01.399219 dv-cinder-852209-8-smb devstack@keystone.service[81709]: warnings.warn(msg) Aug 31 00:12:01.399219 dv-cinder-852209-8-smb devstack@keystone.service[81709]: Aug 31 00:12:01.400455 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840128e0-a238-4b1b-a692-6d0324352d51 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:01.453797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 748/1498] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:12:01 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:12:01.455521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffb606-281d-4bba-a9fd-2162761d1828 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:01.457282 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e1ffb606-281d-4bba-a9fd-2162761d1828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:01.534446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffb606-281d-4bba-a9fd-2162761d1828 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:01.620381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:01.632391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa594aa2-7c6a-497a-a031-d34dcb647ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:01.633039 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa594aa2-7c6a-497a-a031-d34dcb647ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:01.633347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa594aa2-7c6a-497a-a031-d34dcb647ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:01.633610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa594aa2-7c6a-497a-a031-d34dcb647ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:01.634284 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa594aa2-7c6a-497a-a031-d34dcb647ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:01.635298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: WARNING py.warnings [None req-aa594aa2-7c6a-497a-a031-d34dcb647ac9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:12:01.635298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: warnings.warn(msg) Aug 31 00:12:01.635298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: Aug 31 00:12:01.636179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa594aa2-7c6a-497a-a031-d34dcb647ac9 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:01.649949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 751/1499] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:12:01.653967 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840128e0-a238-4b1b-a692-6d0324352d51 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:01.655500 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-840128e0-a238-4b1b-a692-6d0324352d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:01.667742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840128e0-a238-4b1b-a692-6d0324352d51 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:01.694695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:01.772309 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd8c89-83f8-4e5e-817c-b8b28d6bf039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:01.772917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd8c89-83f8-4e5e-817c-b8b28d6bf039 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:01.773189 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd8c89-83f8-4e5e-817c-b8b28d6bf039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:01.774295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd8c89-83f8-4e5e-817c-b8b28d6bf039 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:01.774546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd8c89-83f8-4e5e-817c-b8b28d6bf039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:01.775590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: WARNING py.warnings [None req-89bd8c89-83f8-4e5e-817c-b8b28d6bf039 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:12:01.775590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: warnings.warn(msg) Aug 31 00:12:01.775590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: Aug 31 00:12:01.776495 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd8c89-83f8-4e5e-817c-b8b28d6bf039 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:01.789463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 749/1500] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:12:01.795391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa594aa2-7c6a-497a-a031-d34dcb647ac9 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:01.796929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-aa594aa2-7c6a-497a-a031-d34dcb647ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:01.837155 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa594aa2-7c6a-497a-a031-d34dcb647ac9 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:01.946599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f32d9-cbab-4eda-bd66-2aa18c078095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:01.947166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f32d9-cbab-4eda-bd66-2aa18c078095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:01.947430 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f32d9-cbab-4eda-bd66-2aa18c078095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:01.947689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f32d9-cbab-4eda-bd66-2aa18c078095 admin admin] PATH_INFO: `/v3/projects/1ebd6a21c0424edeb96f5e155b078edf/users/e0eff18a3ce145479b025656f6567416/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:01.973909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f32d9-cbab-4eda-bd66-2aa18c078095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ebd6a21c0424edeb96f5e155b078edf, user_id=e0eff18a3ce145479b025656f6567416, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:01.974948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: WARNING py.warnings [None req-482f32d9-cbab-4eda-bd66-2aa18c078095 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:12:01.974948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: warnings.warn(msg) Aug 31 00:12:01.974948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: Aug 31 00:12:01.976984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f32d9-cbab-4eda-bd66-2aa18c078095 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:02.005011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 752/1501] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:12:01 2022] PUT /identity/v3/projects/1ebd6a21c0424edeb96f5e155b078edf/users/e0eff18a3ce145479b025656f6567416/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:12:02.017644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec686c9-b83a-4191-ad29-6b9ed6b3187b None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:02.017928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec686c9-b83a-4191-ad29-6b9ed6b3187b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:02.018191 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec686c9-b83a-4191-ad29-6b9ed6b3187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:02.080610 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-dec686c9-b83a-4191-ad29-6b9ed6b3187b None None] MFA Rules not processed for user `e0eff18a3ce145479b025656f6567416`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:02.081897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-dec686c9-b83a-4191-ad29-6b9ed6b3187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:02.167688 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 750/1502] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:12:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:02.182584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef0c5-4a49-42d4-b9a2-f34432b45af6 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:02.183031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef0c5-4a49-42d4-b9a2-f34432b45af6 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:02.183480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef0c5-4a49-42d4-b9a2-f34432b45af6 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:02.185855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 753/1503] 10.222.0.60 () {54 vars in 964 bytes} [Wed Aug 31 00:12:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:02.194019 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a706-2b05-4576-8791-a9acc7ce1ede None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:02.194345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a706-2b05-4576-8791-a9acc7ce1ede None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:02.194753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a706-2b05-4576-8791-a9acc7ce1ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:02.235806 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:02.300730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-ee55a706-2b05-4576-8791-a9acc7ce1ede None None] MFA Rules not processed for user `6414692e72024816a99d63234f7c233f`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:02.302455 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ee55a706-2b05-4576-8791-a9acc7ce1ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:02.394882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 751/1504] 10.222.0.60 () {58 vars in 1061 bytes} [Wed Aug 31 00:12:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:02.406204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acef0c5-4a49-42d4-b9a2-f34432b45af6 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:02.407890 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3acef0c5-4a49-42d4-b9a2-f34432b45af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:02.461974 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:02.525024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acef0c5-4a49-42d4-b9a2-f34432b45af6 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:02.608987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52ebe4-bfec-4db6-ab3c-394ca576abf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:02.609695 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52ebe4-bfec-4db6-ab3c-394ca576abf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:02.609960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52ebe4-bfec-4db6-ab3c-394ca576abf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:02.610217 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52ebe4-bfec-4db6-ab3c-394ca576abf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:02.611827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3c52ebe4-bfec-4db6-ab3c-394ca576abf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:02.721396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52ebe4-bfec-4db6-ab3c-394ca576abf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:02.722958 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52ebe4-bfec-4db6-ab3c-394ca576abf5 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:02.726909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:02.742449 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 754/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:02.788605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839f71-f826-429a-b7f1-d2b96c435457 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:02.789081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839f71-f826-429a-b7f1-d2b96c435457 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:02.789191 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839f71-f826-429a-b7f1-d2b96c435457 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:02.790584 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 752/1506] 10.222.0.60 () {52 vars in 830 bytes} [Wed Aug 31 00:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:02.794373 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52ebe4-bfec-4db6-ab3c-394ca576abf5 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:02.795643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3c52ebe4-bfec-4db6-ab3c-394ca576abf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:02.901428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52ebe4-bfec-4db6-ab3c-394ca576abf5 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:03.010922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:03.011598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:03.011873 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:03.012153 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] PATH_INFO: `/v3/users/e0eff18a3ce145479b025656f6567416` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:03.027351 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0eff18a3ce145479b025656f6567416)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:03.028308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: WARNING py.warnings [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:12:03.028308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: warnings.warn(msg) Aug 31 00:12:03.028308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: Aug 31 00:12:03.029556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:03.040224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:03.105582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0eff18a3ce145479b025656f6567416'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:12:03.135171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0eff18a3ce145479b025656f6567416'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:12:03.135733 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0eff18a3ce145479b025656f6567416'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:12:03.136471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0eff18a3ce145479b025656f6567416'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:12:03.151822 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0eff18a3ce145479b025656f6567416'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:12:03.172850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 755/1507] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:12:02 2022] DELETE /identity/v3/users/e0eff18a3ce145479b025656f6567416 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:12:03.177442 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455458-22ae-431c-a99f-1ae77c36c72e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:03.177731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455458-22ae-431c-a99f-1ae77c36c72e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:03.178004 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455458-22ae-431c-a99f-1ae77c36c72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:03.239939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-8d455458-22ae-431c-a99f-1ae77c36c72e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:03.241163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8d455458-22ae-431c-a99f-1ae77c36c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:03.323006 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:03.337018 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 753/1508] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:03.348001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:03.349230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:03.458074 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83da93-15cb-49ec-b286-df4030b8c4f6 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:03.519050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:03.541634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b9c65-394f-4047-8420-d20bb0c25ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:03.542245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9c65-394f-4047-8420-d20bb0c25ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:03.542515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9c65-394f-4047-8420-d20bb0c25ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:03.542789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9c65-394f-4047-8420-d20bb0c25ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:03.544377 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8d5b9c65-394f-4047-8420-d20bb0c25ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:03.661032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b9c65-394f-4047-8420-d20bb0c25ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:03.662420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b9c65-394f-4047-8420-d20bb0c25ad6 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:03.683835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 756/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:04.076012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d455458-22ae-431c-a99f-1ae77c36c72e None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:04.077307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8d455458-22ae-431c-a99f-1ae77c36c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:04.089598 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d455458-22ae-431c-a99f-1ae77c36c72e None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:04.202990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:04.203545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:04.203847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:04.204110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254 admin admin] PATH_INFO: `/v3/projects/1ebd6a21c0424edeb96f5e155b078edf` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:04.214823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ebd6a21c0424edeb96f5e155b078edf)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:04.215869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: WARNING py.warnings [None req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:12:04.215869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: warnings.warn(msg) Aug 31 00:12:04.215869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: Aug 31 00:12:04.217062 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:04.287852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ebd6a21c0424edeb96f5e155b078edf', 'request_id': 'req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:12:04.300477 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ebd6a21c0424edeb96f5e155b078edf', 'request_id': 'req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:12:04.321987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ebd6a21c0424edeb96f5e155b078edf', 'request_id': 'req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:12:04.347669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254 admin admin] The token cache is being invalidate because project 1ebd6a21c0424edeb96f5e155b078edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:12:04.348015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:12:04.348762 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c5dc6bff-1c05-4cbb-b1be-82682b3d7254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:12:04.350779 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 754/1510] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:12:04 2022] DELETE /identity/v3/projects/1ebd6a21c0424edeb96f5e155b078edf => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:12:13.681082 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=62 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:14.344485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:42.410349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218481f-0a5b-44b0-bc8e-914aee1ede9d None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:42.410933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218481f-0a5b-44b0-bc8e-914aee1ede9d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:42.410933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218481f-0a5b-44b0-bc8e-914aee1ede9d None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:42.412849 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:13:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:42.421800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354a0aa-6493-48ac-a0c9-2cfbb17159ad None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:42.422576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354a0aa-6493-48ac-a0c9-2cfbb17159ad None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:42.422733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354a0aa-6493-48ac-a0c9-2cfbb17159ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:42.521735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-f354a0aa-6493-48ac-a0c9-2cfbb17159ad None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:42.523713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f354a0aa-6493-48ac-a0c9-2cfbb17159ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:42.642924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:42.797881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218481f-0a5b-44b0-bc8e-914aee1ede9d None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:42.802034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2218481f-0a5b-44b0-bc8e-914aee1ede9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:42.950053 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218481f-0a5b-44b0-bc8e-914aee1ede9d None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:42.956274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bbf63-adbe-4c76-b8fd-fb2051c81582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:42.956887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bbf63-adbe-4c76-b8fd-fb2051c81582 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:42.957161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bbf63-adbe-4c76-b8fd-fb2051c81582 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:42.957462 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bbf63-adbe-4c76-b8fd-fb2051c81582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:42.965898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bbf63-adbe-4c76-b8fd-fb2051c81582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:42.967486 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bbf63-adbe-4c76-b8fd-fb2051c81582 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:42.977080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 758/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:43.811180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db032b6-d6b1-4e62-8d6a-ef45a73c036d None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:43.812086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db032b6-d6b1-4e62-8d6a-ef45a73c036d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:43.812086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db032b6-d6b1-4e62-8d6a-ef45a73c036d None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:43.814295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:13:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:43.822991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4bb18-e7b4-497e-b60c-3194da3cf715 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:43.823760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4bb18-e7b4-497e-b60c-3194da3cf715 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:43.823899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4bb18-e7b4-497e-b60c-3194da3cf715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:43.849061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-1cc4bb18-e7b4-497e-b60c-3194da3cf715 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:43.850280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1cc4bb18-e7b4-497e-b60c-3194da3cf715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:43.859810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:44.024785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db032b6-d6b1-4e62-8d6a-ef45a73c036d None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:44.048489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db032b6-d6b1-4e62-8d6a-ef45a73c036d None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:44.055533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa84c3-f64f-4d2b-ab4b-7ada409199d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:44.056139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa84c3-f64f-4d2b-ab4b-7ada409199d4 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:44.056418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa84c3-f64f-4d2b-ab4b-7ada409199d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:44.056691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa84c3-f64f-4d2b-ab4b-7ada409199d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:44.065220 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa84c3-f64f-4d2b-ab4b-7ada409199d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:44.066790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa84c3-f64f-4d2b-ab4b-7ada409199d4 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:44.076188 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 757/1516] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:44.646495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5a2bd-0f7c-4aa6-9642-3c90b8e938e8 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:44.646793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5a2bd-0f7c-4aa6-9642-3c90b8e938e8 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:44.646991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5a2bd-0f7c-4aa6-9642-3c90b8e938e8 None None] PATH_INFO: `/v3` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:44.648719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 760/1517] 10.222.0.52 () {54 vars in 925 bytes} [Wed Aug 31 00:13:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:13:44.656124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024704a9-768f-4352-a376-fba6717d97de None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:44.656409 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024704a9-768f-4352-a376-fba6717d97de None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:44.656680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024704a9-768f-4352-a376-fba6717d97de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:44.722155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-024704a9-768f-4352-a376-fba6717d97de None None] MFA Rules not processed for user `227f958b82a446e19a4d5b29d74193bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:44.723367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-024704a9-768f-4352-a376-fba6717d97de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:44.742997 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:44.804825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 758/1518] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 31 00:13:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:53.843667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=56 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:53.900334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c082d-f36b-49f9-97f0-b144f24d536c None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:53.900573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c082d-f36b-49f9-97f0-b144f24d536c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:53.900916 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c082d-f36b-49f9-97f0-b144f24d536c None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:53.903095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 761/1519] 10.222.0.60 () {54 vars in 961 bytes} [Wed Aug 31 00:13:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:53.908168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a814e9-a1ac-4c67-98ff-d8ab1271b15a None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:53.908660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a814e9-a1ac-4c67-98ff-d8ab1271b15a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:53.908660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a814e9-a1ac-4c67-98ff-d8ab1271b15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:53.931859 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-01a814e9-a1ac-4c67-98ff-d8ab1271b15a None None] MFA Rules not processed for user `227f958b82a446e19a4d5b29d74193bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:53.933075 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-01a814e9-a1ac-4c67-98ff-d8ab1271b15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:53.945142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 759/1520] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Aug 31 00:13:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:53.957110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c082d-f36b-49f9-97f0-b144f24d536c None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:53.973100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c082d-f36b-49f9-97f0-b144f24d536c None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:53.979892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a3fae-4486-4826-9e66-a2128be9bb1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227f958b82a446e19a4d5b29d74193bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:53.980482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a3fae-4486-4826-9e66-a2128be9bb1f service placement] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:53.980758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a3fae-4486-4826-9e66-a2128be9bb1f service placement] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:53.981029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a3fae-4486-4826-9e66-a2128be9bb1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:53.990087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a3fae-4486-4826-9e66-a2128be9bb1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:53.992047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a3fae-4486-4826-9e66-a2128be9bb1f service placement] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:54.002143 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 762/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:55.354642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bdfda-a049-4ec9-850f-d97b64857c67 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:55.355214 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bdfda-a049-4ec9-850f-d97b64857c67 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:55.355214 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bdfda-a049-4ec9-850f-d97b64857c67 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:55.356459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:55.364248 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7bd64-fcf3-43fe-88d7-ea37ffb7e9be None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:55.364851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7bd64-fcf3-43fe-88d7-ea37ffb7e9be None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:55.364973 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7bd64-fcf3-43fe-88d7-ea37ffb7e9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:55.392509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-46a7bd64-fcf3-43fe-88d7-ea37ffb7e9be None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:55.393743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-46a7bd64-fcf3-43fe-88d7-ea37ffb7e9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:55.403852 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:55.567208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bdfda-a049-4ec9-850f-d97b64857c67 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:55.588816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bdfda-a049-4ec9-850f-d97b64857c67 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:55.595042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83d450-fbd6-43a7-a7ec-b0acb23eb6bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:55.595644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83d450-fbd6-43a7-a7ec-b0acb23eb6bb service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:55.595915 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83d450-fbd6-43a7-a7ec-b0acb23eb6bb service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:55.596174 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83d450-fbd6-43a7-a7ec-b0acb23eb6bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:55.605159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83d450-fbd6-43a7-a7ec-b0acb23eb6bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:55.606704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83d450-fbd6-43a7-a7ec-b0acb23eb6bb service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:55.616612 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 761/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:56.432913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbaa8f-1706-44b9-af98-502d0d5f0ee3 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:56.433500 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbaa8f-1706-44b9-af98-502d0d5f0ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:56.433500 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbaa8f-1706-44b9-af98-502d0d5f0ee3 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:56.434762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:56.440443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec40d1-720f-4efe-96c0-4b9259400583 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:56.440899 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec40d1-720f-4efe-96c0-4b9259400583 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:56.441011 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec40d1-720f-4efe-96c0-4b9259400583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:56.468290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-64ec40d1-720f-4efe-96c0-4b9259400583 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:56.469559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-64ec40d1-720f-4efe-96c0-4b9259400583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:56.479819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:56.636216 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbaa8f-1706-44b9-af98-502d0d5f0ee3 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:56.654080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbaa8f-1706-44b9-af98-502d0d5f0ee3 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:56.661355 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4ab1b-9288-4141-8e11-c7f452cc3fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:56.661976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4ab1b-9288-4141-8e11-c7f452cc3fef service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:56.662226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4ab1b-9288-4141-8e11-c7f452cc3fef service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:56.662499 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4ab1b-9288-4141-8e11-c7f452cc3fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:56.671151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4ab1b-9288-4141-8e11-c7f452cc3fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:56.672736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4ab1b-9288-4141-8e11-c7f452cc3fef service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:56.682612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 765/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:00.532782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e94a3f-39e2-43ec-809a-4b063a08733b None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:00.533714 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e94a3f-39e2-43ec-809a-4b063a08733b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:00.533714 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e94a3f-39e2-43ec-809a-4b063a08733b None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:00.535723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:00.543328 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b8076-ed78-45e7-8256-f1cadade470a None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:00.543779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b8076-ed78-45e7-8256-f1cadade470a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:00.543873 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b8076-ed78-45e7-8256-f1cadade470a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:00.571508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ee6b8076-ed78-45e7-8256-f1cadade470a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:00.572756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ee6b8076-ed78-45e7-8256-f1cadade470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:00.580780 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:00.873796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e94a3f-39e2-43ec-809a-4b063a08733b None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:00.876141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-91e94a3f-39e2-43ec-809a-4b063a08733b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:00.965534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e94a3f-39e2-43ec-809a-4b063a08733b None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:00.970523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51076c-364b-41fe-8b16-18f0fb31b1cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:00.971155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51076c-364b-41fe-8b16-18f0fb31b1cf service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:00.971434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51076c-364b-41fe-8b16-18f0fb31b1cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:00.971700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51076c-364b-41fe-8b16-18f0fb31b1cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:00.981840 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51076c-364b-41fe-8b16-18f0fb31b1cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:00.983268 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51076c-364b-41fe-8b16-18f0fb31b1cf service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:00.993301 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 764/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:02.920197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3b524-1bf6-4aa5-9553-5b276e09caf7 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:02.920774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3b524-1bf6-4aa5-9553-5b276e09caf7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:02.920774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3b524-1bf6-4aa5-9553-5b276e09caf7 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:02.922122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:02.928332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a205-fd99-4097-9114-113e6ba6237f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:02.928757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a205-fd99-4097-9114-113e6ba6237f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:02.928884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a205-fd99-4097-9114-113e6ba6237f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:02.949788 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-3750a205-fd99-4097-9114-113e6ba6237f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:02.951009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-3750a205-fd99-4097-9114-113e6ba6237f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:02.962735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:03.281595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3b524-1bf6-4aa5-9553-5b276e09caf7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:03.301300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3b524-1bf6-4aa5-9553-5b276e09caf7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:03.307311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5059ef-85ef-4240-89c6-00b8d6f4bf9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:03.308109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5059ef-85ef-4240-89c6-00b8d6f4bf9f service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:03.308374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5059ef-85ef-4240-89c6-00b8d6f4bf9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:03.308663 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5059ef-85ef-4240-89c6-00b8d6f4bf9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:03.325075 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5059ef-85ef-4240-89c6-00b8d6f4bf9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:03.327573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5059ef-85ef-4240-89c6-00b8d6f4bf9f service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:03.339050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 768/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:14:06.982122 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063d99c-7976-4146-9018-85e78abea9fd None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:06.982662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063d99c-7976-4146-9018-85e78abea9fd None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:06.982662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063d99c-7976-4146-9018-85e78abea9fd None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:06.983916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:06.989431 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6359d0-1d6e-4217-a186-a3d9c0c13552 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:06.989906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6359d0-1d6e-4217-a186-a3d9c0c13552 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:06.989906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6359d0-1d6e-4217-a186-a3d9c0c13552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:07.011788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-3b6359d0-1d6e-4217-a186-a3d9c0c13552 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:07.012963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3b6359d0-1d6e-4217-a186-a3d9c0c13552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:07.023881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:07.586165 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063d99c-7976-4146-9018-85e78abea9fd None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:07.589009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1063d99c-7976-4146-9018-85e78abea9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:07.660478 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:07.675436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063d99c-7976-4146-9018-85e78abea9fd None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:07.679929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597ea82-ec37-49ff-9dca-668d32fd78d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:07.680542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597ea82-ec37-49ff-9dca-668d32fd78d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:07.680813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597ea82-ec37-49ff-9dca-668d32fd78d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:07.681374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597ea82-ec37-49ff-9dca-668d32fd78d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:07.691077 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597ea82-ec37-49ff-9dca-668d32fd78d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:07.692552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597ea82-ec37-49ff-9dca-668d32fd78d0 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:07.701885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 767/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:14:09.656134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb92b21-c8e2-40b4-be38-80cd6e5f900d None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:09.656879 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb92b21-c8e2-40b4-be38-80cd6e5f900d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:09.656879 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb92b21-c8e2-40b4-be38-80cd6e5f900d None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:09.658183 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:09.664555 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f32c9-b4e8-46f9-bd16-78659ec26247 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:09.665033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f32c9-b4e8-46f9-bd16-78659ec26247 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:09.665142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f32c9-b4e8-46f9-bd16-78659ec26247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:09.691538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-bf9f32c9-b4e8-46f9-bd16-78659ec26247 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:09.692762 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-bf9f32c9-b4e8-46f9-bd16-78659ec26247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:09.702247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:10.271605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb92b21-c8e2-40b4-be38-80cd6e5f900d None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:10.274947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-fdb92b21-c8e2-40b4-be38-80cd6e5f900d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:10.294627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb92b21-c8e2-40b4-be38-80cd6e5f900d None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:10.298521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc764e-ba50-40c4-8b8d-68976eac5d42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:10.299108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc764e-ba50-40c4-8b8d-68976eac5d42 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:10.299378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc764e-ba50-40c4-8b8d-68976eac5d42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:10.299641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc764e-ba50-40c4-8b8d-68976eac5d42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:10.309673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc764e-ba50-40c4-8b8d-68976eac5d42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:10.311084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc764e-ba50-40c4-8b8d-68976eac5d42 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:10.320504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 771/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:19.686400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=11 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:20.316634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=33 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:44.117568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283656d-161b-49e8-9ec2-e0c98e04ad44 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.117568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283656d-161b-49e8-9ec2-e0c98e04ad44 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.117568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283656d-161b-49e8-9ec2-e0c98e04ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.142496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-b283656d-161b-49e8-9ec2-e0c98e04ad44 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:44.143742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b283656d-161b-49e8-9ec2-e0c98e04ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:44.158961 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 769/1540] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:44.168983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e44fca-83e9-4068-8061-b44cfd313fbb None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.169666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e44fca-83e9-4068-8061-b44cfd313fbb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.169666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e44fca-83e9-4068-8061-b44cfd313fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.205663 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-f0e44fca-83e9-4068-8061-b44cfd313fbb None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:44.207077 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f0e44fca-83e9-4068-8061-b44cfd313fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:44.219872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 772/1541] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:44.224562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283656d-161b-49e8-9ec2-e0c98e04ad44 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.235140 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283656d-161b-49e8-9ec2-e0c98e04ad44 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.241781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef5ae0-f1aa-4cda-8367-c3d301ee6cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.242666 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef5ae0-f1aa-4cda-8367-c3d301ee6cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.243156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef5ae0-f1aa-4cda-8367-c3d301ee6cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.243624 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef5ae0-f1aa-4cda-8367-c3d301ee6cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.244598 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef5ae0-f1aa-4cda-8367-c3d301ee6cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:44.245103 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef5ae0-f1aa-4cda-8367-c3d301ee6cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.250745 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef5ae0-f1aa-4cda-8367-c3d301ee6cfc admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.264445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 770/1542] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:44.272875 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e44fca-83e9-4068-8061-b44cfd313fbb None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.288256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e44fca-83e9-4068-8061-b44cfd313fbb None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.295285 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e0cd0-cd0a-4429-a034-6a1148e0d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.295904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e0cd0-cd0a-4429-a034-6a1148e0d014 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.296185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e0cd0-cd0a-4429-a034-6a1148e0d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.296434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e0cd0-cd0a-4429-a034-6a1148e0d014 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.297086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e0cd0-cd0a-4429-a034-6a1148e0d014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.299030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e0cd0-cd0a-4429-a034-6a1148e0d014 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.361724 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 773/1543] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:44 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:44.366499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef5ae0-f1aa-4cda-8367-c3d301ee6cfc admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.383077 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef5ae0-f1aa-4cda-8367-c3d301ee6cfc admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.456559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd80eab-3731-407a-aaa0-7d9b6cc7ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.457682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd80eab-3731-407a-aaa0-7d9b6cc7ffe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.458198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd80eab-3731-407a-aaa0-7d9b6cc7ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.458680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd80eab-3731-407a-aaa0-7d9b6cc7ffe5 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.459533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd80eab-3731-407a-aaa0-7d9b6cc7ffe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.461803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd80eab-3731-407a-aaa0-7d9b6cc7ffe5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.465950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32f4ac-dcaa-43c5-b4e7-46fafdf0502a None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.466342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32f4ac-dcaa-43c5-b4e7-46fafdf0502a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.466629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32f4ac-dcaa-43c5-b4e7-46fafdf0502a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.506076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 771/1544] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:44 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:44.512949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ae32f4ac-dcaa-43c5-b4e7-46fafdf0502a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:44.514336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ae32f4ac-dcaa-43c5-b4e7-46fafdf0502a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:44.519803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd80eab-3731-407a-aaa0-7d9b6cc7ffe5 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.536729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 774/1545] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:44.538166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b52372-3039-43f5-bb6f-2604708bc6e0 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.538434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b52372-3039-43f5-bb6f-2604708bc6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.538708 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b52372-3039-43f5-bb6f-2604708bc6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.547543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd80eab-3731-407a-aaa0-7d9b6cc7ffe5 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.578190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-37b52372-3039-43f5-bb6f-2604708bc6e0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:44.578906 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38ba60-71ed-4a20-baeb-d255cddf47e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.579762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-37b52372-3039-43f5-bb6f-2604708bc6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:44.580049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38ba60-71ed-4a20-baeb-d255cddf47e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.580526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38ba60-71ed-4a20-baeb-d255cddf47e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.580994 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38ba60-71ed-4a20-baeb-d255cddf47e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.581877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38ba60-71ed-4a20-baeb-d255cddf47e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.583941 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38ba60-71ed-4a20-baeb-d255cddf47e5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.590689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 775/1546] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:44.592076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfcf68-cc66-4535-a40c-60e4c33ca70f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.592354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfcf68-cc66-4535-a40c-60e4c33ca70f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.592623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfcf68-cc66-4535-a40c-60e4c33ca70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.607082 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 772/1547] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:44.608860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62bead-2e1e-4f68-b910-86d2d2641559 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.609387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62bead-2e1e-4f68-b910-86d2d2641559 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.609870 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62bead-2e1e-4f68-b910-86d2d2641559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.629538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-23dfcf68-cc66-4535-a40c-60e4c33ca70f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:44.632517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-23dfcf68-cc66-4535-a40c-60e4c33ca70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:44.655104 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 776/1548] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:44.656799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfcf68-cc66-4535-a40c-60e4c33ca70f None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.668991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-2c62bead-2e1e-4f68-b910-86d2d2641559 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:44.670716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2c62bead-2e1e-4f68-b910-86d2d2641559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:44.686157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfcf68-cc66-4535-a40c-60e4c33ca70f None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.696666 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 773/1549] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:44.698470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62bead-2e1e-4f68-b910-86d2d2641559 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.707079 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d86c9-d17b-4ced-9e8c-621be1eea4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.708074 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d86c9-d17b-4ced-9e8c-621be1eea4cd admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.708546 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d86c9-d17b-4ced-9e8c-621be1eea4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.709086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d86c9-d17b-4ced-9e8c-621be1eea4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.712366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d86c9-d17b-4ced-9e8c-621be1eea4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.715072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d86c9-d17b-4ced-9e8c-621be1eea4cd admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.728955 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62bead-2e1e-4f68-b910-86d2d2641559 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.737986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 777/1550] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:44.740496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d86c9-d17b-4ced-9e8c-621be1eea4cd admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.745774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35e4c0-afb5-4406-bff3-47fdec76a2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.746957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e4c0-afb5-4406-bff3-47fdec76a2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.747478 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e4c0-afb5-4406-bff3-47fdec76a2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.747949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e4c0-afb5-4406-bff3-47fdec76a2f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.748856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35e4c0-afb5-4406-bff3-47fdec76a2f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:44.749406 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35e4c0-afb5-4406-bff3-47fdec76a2f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.751227 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35e4c0-afb5-4406-bff3-47fdec76a2f9 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.769238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d86c9-d17b-4ced-9e8c-621be1eea4cd admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.775631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 774/1551] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:44.776801 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35e4c0-afb5-4406-bff3-47fdec76a2f9 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.789233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6feaf-5a1e-435a-b16d-0ff1fd6f48bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.789233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6feaf-5a1e-435a-b16d-0ff1fd6f48bf admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.789233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6feaf-5a1e-435a-b16d-0ff1fd6f48bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.789233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6feaf-5a1e-435a-b16d-0ff1fd6f48bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.789731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6feaf-5a1e-435a-b16d-0ff1fd6f48bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:44.789731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6feaf-5a1e-435a-b16d-0ff1fd6f48bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.790169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: WARNING py.warnings [None req-dbd6feaf-5a1e-435a-b16d-0ff1fd6f48bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:44.790169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: warnings.warn(msg) Aug 31 00:15:44.790169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: Aug 31 00:15:44.791058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6feaf-5a1e-435a-b16d-0ff1fd6f48bf admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.796796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35e4c0-afb5-4406-bff3-47fdec76a2f9 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.813666 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde9259-2f4d-4ade-9d8c-76976b2f2e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.814766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde9259-2f4d-4ade-9d8c-76976b2f2e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.815265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde9259-2f4d-4ade-9d8c-76976b2f2e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.815745 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde9259-2f4d-4ade-9d8c-76976b2f2e29 admin admin] PATH_INFO: `/v3/projects/fc00a4bf834242da8514abc68c3460dc/users/cb42eefa189049d4bdaddd776eb735e0/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.816281 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 778/1552] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:44.821979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc406f1-654f-4fea-b182-78319d453b8a None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.822263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc406f1-654f-4fea-b182-78319d453b8a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.822542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc406f1-654f-4fea-b182-78319d453b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.860275 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-7cc406f1-654f-4fea-b182-78319d453b8a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:44.861288 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde9259-2f4d-4ade-9d8c-76976b2f2e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc00a4bf834242da8514abc68c3460dc, user_id=cb42eefa189049d4bdaddd776eb735e0, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.861525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7cc406f1-654f-4fea-b182-78319d453b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:44.862774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: WARNING py.warnings [None req-cbde9259-2f4d-4ade-9d8c-76976b2f2e29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:44.862774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: warnings.warn(msg) Aug 31 00:15:44.862774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: Aug 31 00:15:44.865538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde9259-2f4d-4ade-9d8c-76976b2f2e29 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.876738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 779/1553] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:44.877375 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc406f1-654f-4fea-b182-78319d453b8a None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.888263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc406f1-654f-4fea-b182-78319d453b8a None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.893062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed66b98-9b35-4f3b-b8e9-092086f91e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.893768 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66b98-9b35-4f3b-b8e9-092086f91e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.894046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66b98-9b35-4f3b-b8e9-092086f91e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.894490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66b98-9b35-4f3b-b8e9-092086f91e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.894952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed66b98-9b35-4f3b-b8e9-092086f91e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.897288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed66b98-9b35-4f3b-b8e9-092086f91e98 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.904261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 775/1554] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:44 2022] PUT /identity/v3/projects/fc00a4bf834242da8514abc68c3460dc/users/cb42eefa189049d4bdaddd776eb735e0/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:44.905430 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde9259-2f4d-4ade-9d8c-76976b2f2e29 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.944965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 780/1555] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:44 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:44.946807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251093ea-0836-4d5f-9bad-2e1825e093dd None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.947190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251093ea-0836-4d5f-9bad-2e1825e093dd None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.947564 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251093ea-0836-4d5f-9bad-2e1825e093dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.969649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-251093ea-0836-4d5f-9bad-2e1825e093dd None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:44.970985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-251093ea-0836-4d5f-9bad-2e1825e093dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:44.987455 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde9259-2f4d-4ade-9d8c-76976b2f2e29 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.018443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.033047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 781/1556] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:45.034354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a7335-32e4-4dd4-9fc1-618a7da34bf3 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.034638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a7335-32e4-4dd4-9fc1-618a7da34bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.034904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a7335-32e4-4dd4-9fc1-618a7da34bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.054684 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-792a7335-32e4-4dd4-9fc1-618a7da34bf3 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:45.055876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-792a7335-32e4-4dd4-9fc1-618a7da34bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:45.058921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d87ee-cdbe-4dc0-9def-53d2e513e681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.059758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d87ee-cdbe-4dc0-9def-53d2e513e681 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.060028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d87ee-cdbe-4dc0-9def-53d2e513e681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.060290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d87ee-cdbe-4dc0-9def-53d2e513e681 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.060913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d87ee-cdbe-4dc0-9def-53d2e513e681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.061950 dv-cinder-852209-8-smb devstack@keystone.service[81709]: WARNING py.warnings [None req-433d87ee-cdbe-4dc0-9def-53d2e513e681 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:45.061950 dv-cinder-852209-8-smb devstack@keystone.service[81709]: warnings.warn(msg) Aug 31 00:15:45.061950 dv-cinder-852209-8-smb devstack@keystone.service[81709]: Aug 31 00:15:45.063115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d87ee-cdbe-4dc0-9def-53d2e513e681 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.064180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 782/1557] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:45.072517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9d928-4aaf-4b09-b171-8b024046f739 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.072805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9d928-4aaf-4b09-b171-8b024046f739 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.073069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9d928-4aaf-4b09-b171-8b024046f739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.093548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 776/1558] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:44 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:45.094849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baa51c-6994-48c3-8151-074d5ec1482f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.095134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baa51c-6994-48c3-8151-074d5ec1482f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.095398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baa51c-6994-48c3-8151-074d5ec1482f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.097980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a1e9d928-4aaf-4b09-b171-8b024046f739 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:45.099188 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a1e9d928-4aaf-4b09-b171-8b024046f739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:45.114851 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-f5baa51c-6994-48c3-8151-074d5ec1482f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:45.116033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f5baa51c-6994-48c3-8151-074d5ec1482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:45.140241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.160667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 783/1559] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:45.162014 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b22dd7-20e2-45e7-aba7-ad9e9470d669 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.162289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b22dd7-20e2-45e7-aba7-ad9e9470d669 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.162552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b22dd7-20e2-45e7-aba7-ad9e9470d669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.177958 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 777/1560] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:45.178972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baa51c-6994-48c3-8151-074d5ec1482f None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.183042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-f6b22dd7-20e2-45e7-aba7-ad9e9470d669 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:45.184530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f6b22dd7-20e2-45e7-aba7-ad9e9470d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:45.188756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baa51c-6994-48c3-8151-074d5ec1482f None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.193812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8b64e-bb3d-463d-976a-d32e4f802086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.194389 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8b64e-bb3d-463d-976a-d32e4f802086 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.194533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 784/1561] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:45.194756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8b64e-bb3d-463d-976a-d32e4f802086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.195024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8b64e-bb3d-463d-976a-d32e4f802086 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.195790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8b64e-bb3d-463d-976a-d32e4f802086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.197791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8b64e-bb3d-463d-976a-d32e4f802086 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.198518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a122d7-acc3-4ae7-b22c-32046e666e86 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.198795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a122d7-acc3-4ae7-b22c-32046e666e86 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.199065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a122d7-acc3-4ae7-b22c-32046e666e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.220522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-b0a122d7-acc3-4ae7-b22c-32046e666e86 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:45.221794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b0a122d7-acc3-4ae7-b22c-32046e666e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:45.221952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 778/1562] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:45.223332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c234-4adc-43df-994a-d08c8cf8c78f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.223639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c234-4adc-43df-994a-d08c8cf8c78f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.223884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c234-4adc-43df-994a-d08c8cf8c78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.234367 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 785/1563] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:45.235863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc600c-994a-4e7a-9d89-95bbb7074698 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.236136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc600c-994a-4e7a-9d89-95bbb7074698 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.236397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc600c-994a-4e7a-9d89-95bbb7074698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.243407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-aab5c234-4adc-43df-994a-d08c8cf8c78f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:45.244596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-aab5c234-4adc-43df-994a-d08c8cf8c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:45.252794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 779/1564] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:45.253889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c234-4adc-43df-994a-d08c8cf8c78f None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.256251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-79cc600c-994a-4e7a-9d89-95bbb7074698 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:45.257391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-79cc600c-994a-4e7a-9d89-95bbb7074698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:45.264170 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c234-4adc-43df-994a-d08c8cf8c78f None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.265174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 786/1565] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:45.265965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc600c-994a-4e7a-9d89-95bbb7074698 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.272847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4a68a-1c59-49e5-9dd6-942f07edd0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.273483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4a68a-1c59-49e5-9dd6-942f07edd0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.273756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4a68a-1c59-49e5-9dd6-942f07edd0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.274019 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4a68a-1c59-49e5-9dd6-942f07edd0f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.274639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4a68a-1c59-49e5-9dd6-942f07edd0f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.275418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc600c-994a-4e7a-9d89-95bbb7074698 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.276537 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4a68a-1c59-49e5-9dd6-942f07edd0f2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.280436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2730d-22ef-4b4f-b26d-dd7178118351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.281291 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2730d-22ef-4b4f-b26d-dd7178118351 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.281565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2730d-22ef-4b4f-b26d-dd7178118351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.281828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2730d-22ef-4b4f-b26d-dd7178118351 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.282476 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2730d-22ef-4b4f-b26d-dd7178118351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:45.282799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2730d-22ef-4b4f-b26d-dd7178118351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.284583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2730d-22ef-4b4f-b26d-dd7178118351 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.299417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 787/1566] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:45.299688 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 780/1567] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/users => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:45.300233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2730d-22ef-4b4f-b26d-dd7178118351 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.300985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73681ef-9408-4f2d-8137-7784f4441ed0 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.301306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73681ef-9408-4f2d-8137-7784f4441ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.301573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73681ef-9408-4f2d-8137-7784f4441ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.301911 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2cf2730d-22ef-4b4f-b26d-dd7178118351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:45.324169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-b73681ef-9408-4f2d-8137-7784f4441ed0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:45.325656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b73681ef-9408-4f2d-8137-7784f4441ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:45.334085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 781/1568] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:45.334656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73681ef-9408-4f2d-8137-7784f4441ed0 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.344407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73681ef-9408-4f2d-8137-7784f4441ed0 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.349098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73a99f-2c0c-4c47-a7f9-792744700307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.349855 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73a99f-2c0c-4c47-a7f9-792744700307 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.350125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73a99f-2c0c-4c47-a7f9-792744700307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.350386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73a99f-2c0c-4c47-a7f9-792744700307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.351018 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73a99f-2c0c-4c47-a7f9-792744700307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.352597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73a99f-2c0c-4c47-a7f9-792744700307 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.362806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2730d-22ef-4b4f-b26d-dd7178118351 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.363124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 782/1569] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:45.364466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b894e98-e81c-41ac-a01d-8da0e47ea88c None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.364740 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b894e98-e81c-41ac-a01d-8da0e47ea88c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.365005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b894e98-e81c-41ac-a01d-8da0e47ea88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.369724 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52fd44-1e99-4630-bec3-ff81a14cf84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.370333 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52fd44-1e99-4630-bec3-ff81a14cf84f service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.370589 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52fd44-1e99-4630-bec3-ff81a14cf84f service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.370853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52fd44-1e99-4630-bec3-ff81a14cf84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.380280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52fd44-1e99-4630-bec3-ff81a14cf84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.381757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52fd44-1e99-4630-bec3-ff81a14cf84f service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.384187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-1b894e98-e81c-41ac-a01d-8da0e47ea88c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:45.385965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1b894e98-e81c-41ac-a01d-8da0e47ea88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:45.391763 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 788/1570] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:45.392506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52fd44-1e99-4630-bec3-ff81a14cf84f service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.395580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 783/1571] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:45.396732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b894e98-e81c-41ac-a01d-8da0e47ea88c None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.406228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52fd44-1e99-4630-bec3-ff81a14cf84f service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.406797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b894e98-e81c-41ac-a01d-8da0e47ea88c None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.411242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b3f80-3d68-455d-b036-8861ecb2c26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.411949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b3f80-3d68-455d-b036-8861ecb2c26a admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.412079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4576b87-e36c-46ce-a78f-9b0e31f57344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.412398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b3f80-3d68-455d-b036-8861ecb2c26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.412682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4576b87-e36c-46ce-a78f-9b0e31f57344 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.412865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b3f80-3d68-455d-b036-8861ecb2c26a admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.412975 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4576b87-e36c-46ce-a78f-9b0e31f57344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.413219 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4576b87-e36c-46ce-a78f-9b0e31f57344 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.413786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b3f80-3d68-455d-b036-8861ecb2c26a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:45.413915 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4576b87-e36c-46ce-a78f-9b0e31f57344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:45.414195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4576b87-e36c-46ce-a78f-9b0e31f57344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.414314 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b3f80-3d68-455d-b036-8861ecb2c26a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.415784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4576b87-e36c-46ce-a78f-9b0e31f57344 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.416077 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b3f80-3d68-455d-b036-8861ecb2c26a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.429486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 784/1572] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:45.430394 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4576b87-e36c-46ce-a78f-9b0e31f57344 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.435478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 789/1573] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:45.436600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b3f80-3d68-455d-b036-8861ecb2c26a admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.448222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4576b87-e36c-46ce-a78f-9b0e31f57344 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.448565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b3f80-3d68-455d-b036-8861ecb2c26a admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.453679 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b5c54-4d70-4d79-adb3-6ffc5b5ad210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.454466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5c54-4d70-4d79-adb3-6ffc5b5ad210 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.454600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa9a4c-978f-4534-a2c1-0e7c170f8fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.454854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5c54-4d70-4d79-adb3-6ffc5b5ad210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.455181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5c54-4d70-4d79-adb3-6ffc5b5ad210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.455374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9a4c-978f-4534-a2c1-0e7c170f8fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.455714 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9a4c-978f-4534-a2c1-0e7c170f8fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.456041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b5c54-4d70-4d79-adb3-6ffc5b5ad210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.456151 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9a4c-978f-4534-a2c1-0e7c170f8fd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.456797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa9a4c-978f-4534-a2c1-0e7c170f8fd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.457851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b5c54-4d70-4d79-adb3-6ffc5b5ad210 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.458861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa9a4c-978f-4534-a2c1-0e7c170f8fd6 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.470647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 790/1574] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:45.471587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b5c54-4d70-4d79-adb3-6ffc5b5ad210 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.483872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b5c54-4d70-4d79-adb3-6ffc5b5ad210 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.491939 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf202bd-b4e0-488e-9d16-b424c3a7b528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.492572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf202bd-b4e0-488e-9d16-b424c3a7b528 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.492847 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf202bd-b4e0-488e-9d16-b424c3a7b528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.493190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf202bd-b4e0-488e-9d16-b424c3a7b528 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.493892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf202bd-b4e0-488e-9d16-b424c3a7b528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:45.494274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf202bd-b4e0-488e-9d16-b424c3a7b528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.495987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf202bd-b4e0-488e-9d16-b424c3a7b528 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.498370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 785/1575] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:45.500112 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa9a4c-978f-4534-a2c1-0e7c170f8fd6 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.513526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.516665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 791/1576] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:45.517640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf202bd-b4e0-488e-9d16-b424c3a7b528 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.534545 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf202bd-b4e0-488e-9d16-b424c3a7b528 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.598451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa9a4c-978f-4534-a2c1-0e7c170f8fd6 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.604883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f184c46-bcd9-4b3f-950f-d9e95eeaae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.605670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f184c46-bcd9-4b3f-950f-d9e95eeaae51 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.606270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f184c46-bcd9-4b3f-950f-d9e95eeaae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.606398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b54d3-5c25-48f3-84fa-51cadf0031df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.606506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f184c46-bcd9-4b3f-950f-d9e95eeaae51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.606783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b54d3-5c25-48f3-84fa-51cadf0031df admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.606909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f184c46-bcd9-4b3f-950f-d9e95eeaae51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.607225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b54d3-5c25-48f3-84fa-51cadf0031df admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.607502 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b54d3-5c25-48f3-84fa-51cadf0031df admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.608206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b54d3-5c25-48f3-84fa-51cadf0031df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:45.608459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f184c46-bcd9-4b3f-950f-d9e95eeaae51 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.608569 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b54d3-5c25-48f3-84fa-51cadf0031df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.610194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b54d3-5c25-48f3-84fa-51cadf0031df admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.619769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 786/1577] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:45.620035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f184c46-bcd9-4b3f-950f-d9e95eeaae51 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.629240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 792/1578] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:45.630757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b54d3-5c25-48f3-84fa-51cadf0031df admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.632062 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f184c46-bcd9-4b3f-950f-d9e95eeaae51 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.639533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94aaca3-2fe8-4ad4-a53e-fa80545dfbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.640112 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94aaca3-2fe8-4ad4-a53e-fa80545dfbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.640499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94aaca3-2fe8-4ad4-a53e-fa80545dfbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.640837 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94aaca3-2fe8-4ad4-a53e-fa80545dfbb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.641582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94aaca3-2fe8-4ad4-a53e-fa80545dfbb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.643280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b54d3-5c25-48f3-84fa-51cadf0031df admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.643782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94aaca3-2fe8-4ad4-a53e-fa80545dfbb5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.648633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb65451-bb01-4a2d-9e57-70701e9d4a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.649480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb65451-bb01-4a2d-9e57-70701e9d4a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.649816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb65451-bb01-4a2d-9e57-70701e9d4a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.650153 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb65451-bb01-4a2d-9e57-70701e9d4a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.650776 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb65451-bb01-4a2d-9e57-70701e9d4a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.653086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb65451-bb01-4a2d-9e57-70701e9d4a6c admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.663403 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.680671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 787/1579] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:45.681631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94aaca3-2fe8-4ad4-a53e-fa80545dfbb5 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.693016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 793/1580] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:45.693016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb65451-bb01-4a2d-9e57-70701e9d4a6c admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.760329 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94aaca3-2fe8-4ad4-a53e-fa80545dfbb5 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.772814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7fba5-1cd3-49cb-a11e-dcfa35677b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.773064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb65451-bb01-4a2d-9e57-70701e9d4a6c admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.773626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7fba5-1cd3-49cb-a11e-dcfa35677b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.773907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7fba5-1cd3-49cb-a11e-dcfa35677b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.774237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7fba5-1cd3-49cb-a11e-dcfa35677b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.775048 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7fba5-1cd3-49cb-a11e-dcfa35677b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.779381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7f123-df2d-4c7c-b1dc-6c0a8e7e6e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.780002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7f123-df2d-4c7c-b1dc-6c0a8e7e6e70 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.780320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7f123-df2d-4c7c-b1dc-6c0a8e7e6e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.780578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7f123-df2d-4c7c-b1dc-6c0a8e7e6e70 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.781271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7f123-df2d-4c7c-b1dc-6c0a8e7e6e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.782066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7fba5-1cd3-49cb-a11e-dcfa35677b2a admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.782301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: WARNING py.warnings [None req-1ef7f123-df2d-4c7c-b1dc-6c0a8e7e6e70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:45.782301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: warnings.warn(msg) Aug 31 00:15:45.782301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: Aug 31 00:15:45.783489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7f123-df2d-4c7c-b1dc-6c0a8e7e6e70 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.795079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 788/1581] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:45.795956 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7fba5-1cd3-49cb-a11e-dcfa35677b2a admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.808218 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7fba5-1cd3-49cb-a11e-dcfa35677b2a admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.813912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaba4e3-c42f-4a41-bed5-d6c5d67f60cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.814537 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaba4e3-c42f-4a41-bed5-d6c5d67f60cc admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.814823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaba4e3-c42f-4a41-bed5-d6c5d67f60cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.815078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaba4e3-c42f-4a41-bed5-d6c5d67f60cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.815772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaba4e3-c42f-4a41-bed5-d6c5d67f60cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.817767 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaba4e3-c42f-4a41-bed5-d6c5d67f60cc admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.823573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 794/1582] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:45.823573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7f123-df2d-4c7c-b1dc-6c0a8e7e6e70 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.836112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7f123-df2d-4c7c-b1dc-6c0a8e7e6e70 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.842682 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72658c3-bf65-49c3-af51-e103e6f6fc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.843820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72658c3-bf65-49c3-af51-e103e6f6fc6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.844096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72658c3-bf65-49c3-af51-e103e6f6fc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.844368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72658c3-bf65-49c3-af51-e103e6f6fc6b admin admin] PATH_INFO: `/v3/projects/8a005352f6ff4639b4a651aedca77541/users/30a43f66db08456fb272d7e13a1c9256/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.864731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 789/1583] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:45.866035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaba4e3-c42f-4a41-bed5-d6c5d67f60cc admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.870400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72658c3-bf65-49c3-af51-e103e6f6fc6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a005352f6ff4639b4a651aedca77541, user_id=30a43f66db08456fb272d7e13a1c9256, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.873416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72658c3-bf65-49c3-af51-e103e6f6fc6b admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.892769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 795/1584] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:45 2022] PUT /identity/v3/projects/8a005352f6ff4639b4a651aedca77541/users/30a43f66db08456fb272d7e13a1c9256/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:45.893778 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72658c3-bf65-49c3-af51-e103e6f6fc6b admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.943959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.950451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaba4e3-c42f-4a41-bed5-d6c5d67f60cc admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.970535 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72658c3-bf65-49c3-af51-e103e6f6fc6b admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.982436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebaf3f-27aa-4b41-aac0-bc40015c1913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.983081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebaf3f-27aa-4b41-aac0-bc40015c1913 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.983358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebaf3f-27aa-4b41-aac0-bc40015c1913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.983649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebaf3f-27aa-4b41-aac0-bc40015c1913 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.984272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebaf3f-27aa-4b41-aac0-bc40015c1913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.986498 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebaf3f-27aa-4b41-aac0-bc40015c1913 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.019879 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 796/1585] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:46.024120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebaf3f-27aa-4b41-aac0-bc40015c1913 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.029181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73659ca3-17fa-4057-8876-70cbb88a742e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.029747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659ca3-17fa-4057-8876-70cbb88a742e admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.030024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659ca3-17fa-4057-8876-70cbb88a742e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.030419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659ca3-17fa-4057-8876-70cbb88a742e admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.031073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73659ca3-17fa-4057-8876-70cbb88a742e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.033646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73659ca3-17fa-4057-8876-70cbb88a742e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.034746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebaf3f-27aa-4b41-aac0-bc40015c1913 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.039723 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17b564-cc3b-4ddb-8ca8-77780b3fb65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.040329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17b564-cc3b-4ddb-8ca8-77780b3fb65b admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.040597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17b564-cc3b-4ddb-8ca8-77780b3fb65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.040858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17b564-cc3b-4ddb-8ca8-77780b3fb65b admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.041520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17b564-cc3b-4ddb-8ca8-77780b3fb65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.044022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17b564-cc3b-4ddb-8ca8-77780b3fb65b admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.064936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 790/1586] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:46.066295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73659ca3-17fa-4057-8876-70cbb88a742e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.072277 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 797/1587] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:46 2022] POST /identity/v3/users => generated 283 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:46.073413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17b564-cc3b-4ddb-8ca8-77780b3fb65b admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.086939 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17b564-cc3b-4ddb-8ca8-77780b3fb65b admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.116275 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:46.147523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73659ca3-17fa-4057-8876-70cbb88a742e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.153412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89679a99-f26a-4419-8e70-0214b2ded66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.154298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89679a99-f26a-4419-8e70-0214b2ded66e admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.154632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89679a99-f26a-4419-8e70-0214b2ded66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.155050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89679a99-f26a-4419-8e70-0214b2ded66e admin admin] PATH_INFO: `/v3/projects/e25f948ac1c74a2da7b5fdd5ac581e4c/users/9e0f8ddd56924376af44629aae5cc532/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.164552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157f0d5-206c-4fec-9e93-cfe9f2a4e784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.165249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f0d5-206c-4fec-9e93-cfe9f2a4e784 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.165722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f0d5-206c-4fec-9e93-cfe9f2a4e784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.165722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f0d5-206c-4fec-9e93-cfe9f2a4e784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.166448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157f0d5-206c-4fec-9e93-cfe9f2a4e784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.167974 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157f0d5-206c-4fec-9e93-cfe9f2a4e784 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.174153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89679a99-f26a-4419-8e70-0214b2ded66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25f948ac1c74a2da7b5fdd5ac581e4c, user_id=9e0f8ddd56924376af44629aae5cc532, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.177175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89679a99-f26a-4419-8e70-0214b2ded66e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.181320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 798/1588] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:46.182180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157f0d5-206c-4fec-9e93-cfe9f2a4e784 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.193481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157f0d5-206c-4fec-9e93-cfe9f2a4e784 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.213033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 791/1589] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:46 2022] PUT /identity/v3/projects/e25f948ac1c74a2da7b5fdd5ac581e4c/users/9e0f8ddd56924376af44629aae5cc532/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:46.214732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d73c6c-40f6-44e1-897f-e4b80aac28c8 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.215018 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d73c6c-40f6-44e1-897f-e4b80aac28c8 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.215354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d73c6c-40f6-44e1-897f-e4b80aac28c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.244419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-80d73c6c-40f6-44e1-897f-e4b80aac28c8 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:46.246367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-80d73c6c-40f6-44e1-897f-e4b80aac28c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:46.276618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c277345-0110-40ef-91a5-d54da60ab87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.277303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c277345-0110-40ef-91a5-d54da60ab87f admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.277579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c277345-0110-40ef-91a5-d54da60ab87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.278363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c277345-0110-40ef-91a5-d54da60ab87f admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.279382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c277345-0110-40ef-91a5-d54da60ab87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.281359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c277345-0110-40ef-91a5-d54da60ab87f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.329285 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 792/1590] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:46.330589 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d73c6c-40f6-44e1-897f-e4b80aac28c8 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.337602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 799/1591] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:46 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:46.339939 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c277345-0110-40ef-91a5-d54da60ab87f admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.343491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d73c6c-40f6-44e1-897f-e4b80aac28c8 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.350132 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28587ad8-8466-4215-ba2a-7e92edaaa113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.350866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28587ad8-8466-4215-ba2a-7e92edaaa113 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.351240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28587ad8-8466-4215-ba2a-7e92edaaa113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.351606 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28587ad8-8466-4215-ba2a-7e92edaaa113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.352472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28587ad8-8466-4215-ba2a-7e92edaaa113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.352726 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c277345-0110-40ef-91a5-d54da60ab87f admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.354496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28587ad8-8466-4215-ba2a-7e92edaaa113 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.359713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e6d8c-3f24-4067-97e7-8ed1cce02e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.360385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e6d8c-3f24-4067-97e7-8ed1cce02e9f admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.360663 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e6d8c-3f24-4067-97e7-8ed1cce02e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.360943 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e6d8c-3f24-4067-97e7-8ed1cce02e9f admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.362576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:46.362963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e6d8c-3f24-4067-97e7-8ed1cce02e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.366027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e6d8c-3f24-4067-97e7-8ed1cce02e9f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.373665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 793/1592] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:46.373665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28587ad8-8466-4215-ba2a-7e92edaaa113 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.390291 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28587ad8-8466-4215-ba2a-7e92edaaa113 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.395834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef43363-960a-4334-95a8-2b0d203c2a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.397126 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef43363-960a-4334-95a8-2b0d203c2a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.397496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef43363-960a-4334-95a8-2b0d203c2a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.397906 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef43363-960a-4334-95a8-2b0d203c2a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.398568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef43363-960a-4334-95a8-2b0d203c2a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.404920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 800/1593] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:46 2022] POST /identity/v3/users => generated 292 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:46.405176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef43363-960a-4334-95a8-2b0d203c2a12 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.405407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e6d8c-3f24-4067-97e7-8ed1cce02e9f admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.413998 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 794/1594] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:46.418795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a253ac8-91c2-49b2-9d87-4610305bf213 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.418795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a253ac8-91c2-49b2-9d87-4610305bf213 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.418795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a253ac8-91c2-49b2-9d87-4610305bf213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.429547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e6d8c-3f24-4067-97e7-8ed1cce02e9f admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.438384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd55ab2-e8bc-4308-8f0d-f9eef0a4aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.438384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd55ab2-e8bc-4308-8f0d-f9eef0a4aea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.438384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd55ab2-e8bc-4308-8f0d-f9eef0a4aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.438384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd55ab2-e8bc-4308-8f0d-f9eef0a4aea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.439090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd55ab2-e8bc-4308-8f0d-f9eef0a4aea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.440000 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd55ab2-e8bc-4308-8f0d-f9eef0a4aea1 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.455086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 801/1595] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:46.455322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-0a253ac8-91c2-49b2-9d87-4610305bf213 None None] MFA Rules not processed for user `9e0f8ddd56924376af44629aae5cc532`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:46.455438 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd55ab2-e8bc-4308-8f0d-f9eef0a4aea1 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.455553 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0a253ac8-91c2-49b2-9d87-4610305bf213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:46.467401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd55ab2-e8bc-4308-8f0d-f9eef0a4aea1 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.473072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b95ac0-ca6e-40c0-aa25-12eb91cf8515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.474028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b95ac0-ca6e-40c0-aa25-12eb91cf8515 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.474541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b95ac0-ca6e-40c0-aa25-12eb91cf8515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.475126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b95ac0-ca6e-40c0-aa25-12eb91cf8515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.475879 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b95ac0-ca6e-40c0-aa25-12eb91cf8515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.477723 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b95ac0-ca6e-40c0-aa25-12eb91cf8515 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.496656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 802/1596] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:46.498015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b95ac0-ca6e-40c0-aa25-12eb91cf8515 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.546209 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 795/1597] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:46.546209 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a253ac8-91c2-49b2-9d87-4610305bf213 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.561049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a253ac8-91c2-49b2-9d87-4610305bf213 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.568474 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8582e-4e79-4671-a0ab-f51e7f408ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.569118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8582e-4e79-4671-a0ab-f51e7f408ada admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.569425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8582e-4e79-4671-a0ab-f51e7f408ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.569793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8582e-4e79-4671-a0ab-f51e7f408ada admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.570447 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8582e-4e79-4671-a0ab-f51e7f408ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.570900 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b95ac0-ca6e-40c0-aa25-12eb91cf8515 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.572930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8582e-4e79-4671-a0ab-f51e7f408ada admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.575043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c916d-e1e3-454e-a4c0-efdd3d2bce6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.576161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c916d-e1e3-454e-a4c0-efdd3d2bce6c service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.576533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c916d-e1e3-454e-a4c0-efdd3d2bce6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.576901 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c916d-e1e3-454e-a4c0-efdd3d2bce6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.588588 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c916d-e1e3-454e-a4c0-efdd3d2bce6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.590332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c916d-e1e3-454e-a4c0-efdd3d2bce6c service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.592720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 796/1598] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:46.593775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8582e-4e79-4671-a0ab-f51e7f408ada admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.602049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 803/1599] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:46.603200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c916d-e1e3-454e-a4c0-efdd3d2bce6c service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.608798 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8582e-4e79-4671-a0ab-f51e7f408ada admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.613408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c916d-e1e3-454e-a4c0-efdd3d2bce6c service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.616872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d51637-c812-49a5-ab84-a8517fa27598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.617786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d51637-c812-49a5-ab84-a8517fa27598 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.618061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d51637-c812-49a5-ab84-a8517fa27598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.618327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d51637-c812-49a5-ab84-a8517fa27598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.618674 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b002f-08bb-48b8-beb7-3647b3ee30f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.619376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b002f-08bb-48b8-beb7-3647b3ee30f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.619509 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d51637-c812-49a5-ab84-a8517fa27598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.619835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b002f-08bb-48b8-beb7-3647b3ee30f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.620196 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b002f-08bb-48b8-beb7-3647b3ee30f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.620931 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b002f-08bb-48b8-beb7-3647b3ee30f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.622176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d51637-c812-49a5-ab84-a8517fa27598 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.623058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b002f-08bb-48b8-beb7-3647b3ee30f7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.637386 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 804/1600] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:46.637386 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b002f-08bb-48b8-beb7-3647b3ee30f7 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.642129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 797/1601] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:46.642129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d51637-c812-49a5-ab84-a8517fa27598 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.648898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:46.653569 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b002f-08bb-48b8-beb7-3647b3ee30f7 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.656199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d51637-c812-49a5-ab84-a8517fa27598 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.660370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67105c-bd55-4d4f-8392-843f55515ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.661358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67105c-bd55-4d4f-8392-843f55515ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.661799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67105c-bd55-4d4f-8392-843f55515ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.662303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67105c-bd55-4d4f-8392-843f55515ad1 admin admin] PATH_INFO: `/v3/projects/c73042a79e92414aa8af1f7483a68884/users/8b0b97cdcb0d4f2ea660bd04ae305f73/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.666574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927280b0-1cac-4856-9658-065afec0125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.667213 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927280b0-1cac-4856-9658-065afec0125d admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.667496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927280b0-1cac-4856-9658-065afec0125d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.667769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927280b0-1cac-4856-9658-065afec0125d admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.668612 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927280b0-1cac-4856-9658-065afec0125d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.670764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927280b0-1cac-4856-9658-065afec0125d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.682657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 798/1602] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:46.683325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67105c-bd55-4d4f-8392-843f55515ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73042a79e92414aa8af1f7483a68884, user_id=8b0b97cdcb0d4f2ea660bd04ae305f73, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.683948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927280b0-1cac-4856-9658-065afec0125d admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.686850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67105c-bd55-4d4f-8392-843f55515ad1 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.699887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927280b0-1cac-4856-9658-065afec0125d admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.706260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 805/1603] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:46 2022] PUT /identity/v3/projects/c73042a79e92414aa8af1f7483a68884/users/8b0b97cdcb0d4f2ea660bd04ae305f73/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:46.707369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67105c-bd55-4d4f-8392-843f55515ad1 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.766573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8d6f0-195a-4309-a899-40b3fd2bf19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.767662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8d6f0-195a-4309-a899-40b3fd2bf19b admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.768103 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8d6f0-195a-4309-a899-40b3fd2bf19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.768651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8d6f0-195a-4309-a899-40b3fd2bf19b admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.770101 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8d6f0-195a-4309-a899-40b3fd2bf19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.773056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8d6f0-195a-4309-a899-40b3fd2bf19b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.791255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67105c-bd55-4d4f-8392-843f55515ad1 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.797649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eec8e4-056a-40ff-93d9-290cf02a9faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.798645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eec8e4-056a-40ff-93d9-290cf02a9faa admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.799018 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eec8e4-056a-40ff-93d9-290cf02a9faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.799413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eec8e4-056a-40ff-93d9-290cf02a9faa admin admin] PATH_INFO: `/v3/projects/5f56e405a5b24c00a21c6153a95894c1/users/fdbdf25ff2bb4c8fa90433446131fc96/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.811980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 799/1604] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:46 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:46.812663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8d6f0-195a-4309-a899-40b3fd2bf19b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.818169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eec8e4-056a-40ff-93d9-290cf02a9faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f56e405a5b24c00a21c6153a95894c1, user_id=fdbdf25ff2bb4c8fa90433446131fc96, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.820774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eec8e4-056a-40ff-93d9-290cf02a9faa admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.856352 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 806/1605] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:46 2022] PUT /identity/v3/projects/5f56e405a5b24c00a21c6153a95894c1/users/fdbdf25ff2bb4c8fa90433446131fc96/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:46.869385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eec8e4-056a-40ff-93d9-290cf02a9faa admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.892887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:46.956995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8d6f0-195a-4309-a899-40b3fd2bf19b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:47.010370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eec8e4-056a-40ff-93d9-290cf02a9faa admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:47.024110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ec36e-950d-43ba-b910-8638a4d3beea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:47.024746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ec36e-950d-43ba-b910-8638a4d3beea admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.025021 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ec36e-950d-43ba-b910-8638a4d3beea admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.025402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ec36e-950d-43ba-b910-8638a4d3beea admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.026058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ec36e-950d-43ba-b910-8638a4d3beea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:47.027696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ec36e-950d-43ba-b910-8638a4d3beea admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:47.052614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933adc6-05c1-4454-bb72-7f38ebd6fcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:47.056655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 807/1606] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:47.057361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933adc6-05c1-4454-bb72-7f38ebd6fcc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.057769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933adc6-05c1-4454-bb72-7f38ebd6fcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.058471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933adc6-05c1-4454-bb72-7f38ebd6fcc2 admin admin] PATH_INFO: `/v3/projects/b2bd740fd2724e289670f2b2701ec6c6/users/e764f5d718dc4620aafe3119c54b672c/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.062084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ec36e-950d-43ba-b910-8638a4d3beea admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:47.087791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ec36e-950d-43ba-b910-8638a4d3beea admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:47.096744 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933adc6-05c1-4454-bb72-7f38ebd6fcc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2bd740fd2724e289670f2b2701ec6c6, user_id=e764f5d718dc4620aafe3119c54b672c, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:47.100113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933adc6-05c1-4454-bb72-7f38ebd6fcc2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:47.102260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6407c51-04cc-4d5e-a907-5baaf3244618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:47.103094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6407c51-04cc-4d5e-a907-5baaf3244618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.103428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6407c51-04cc-4d5e-a907-5baaf3244618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.103758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6407c51-04cc-4d5e-a907-5baaf3244618 admin admin] PATH_INFO: `/v3/projects/aaefff1523174e98b85f2273d1c55168/users/e1864d214d7349eb9aa19afc586ebee8/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.127796 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6407c51-04cc-4d5e-a907-5baaf3244618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaefff1523174e98b85f2273d1c55168, user_id=e1864d214d7349eb9aa19afc586ebee8, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:47.130848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6407c51-04cc-4d5e-a907-5baaf3244618 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:47.133081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 800/1607] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:46 2022] PUT /identity/v3/projects/b2bd740fd2724e289670f2b2701ec6c6/users/e764f5d718dc4620aafe3119c54b672c/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:47.137384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b81055-cf8f-48c5-8a37-42c06ff42fec None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.137896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b81055-cf8f-48c5-8a37-42c06ff42fec None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.138356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b81055-cf8f-48c5-8a37-42c06ff42fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.161349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 808/1608] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:47 2022] PUT /identity/v3/projects/aaefff1523174e98b85f2273d1c55168/users/e1864d214d7349eb9aa19afc586ebee8/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:47.163231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6407c51-04cc-4d5e-a907-5baaf3244618 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:47.164149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-b6b81055-cf8f-48c5-8a37-42c06ff42fec None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:47.165646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b6b81055-cf8f-48c5-8a37-42c06ff42fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:47.245401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:47.276903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 801/1609] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:47.277603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6407c51-04cc-4d5e-a907-5baaf3244618 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:47.279263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06600af7-3b23-4a07-9d8a-4bbf2dae725e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.279697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06600af7-3b23-4a07-9d8a-4bbf2dae725e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.280100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06600af7-3b23-4a07-9d8a-4bbf2dae725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.286991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84062d4d-3cd2-44d4-a33b-7a9843ee5f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:47.287747 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84062d4d-3cd2-44d4-a33b-7a9843ee5f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.288155 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84062d4d-3cd2-44d4-a33b-7a9843ee5f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.288528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84062d4d-3cd2-44d4-a33b-7a9843ee5f95 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.289319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84062d4d-3cd2-44d4-a33b-7a9843ee5f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:47.291774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84062d4d-3cd2-44d4-a33b-7a9843ee5f95 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:47.335013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 809/1610] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:47 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:47.336260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84062d4d-3cd2-44d4-a33b-7a9843ee5f95 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:47.349838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84062d4d-3cd2-44d4-a33b-7a9843ee5f95 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:47.351514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-06600af7-3b23-4a07-9d8a-4bbf2dae725e None None] MFA Rules not processed for user `fdbdf25ff2bb4c8fa90433446131fc96`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:47.352731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-06600af7-3b23-4a07-9d8a-4bbf2dae725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:47.355269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7ae27-5d47-4e45-96a4-351e34cad099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:47.357416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ae27-5d47-4e45-96a4-351e34cad099 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.357603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ae27-5d47-4e45-96a4-351e34cad099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.357972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ae27-5d47-4e45-96a4-351e34cad099 admin admin] PATH_INFO: `/v3/projects/7eb9f2afc1a34e62874b87b7e5f90483/users/a899638fd4f44d738d98fed19c35babc/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.386781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7ae27-5d47-4e45-96a4-351e34cad099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb9f2afc1a34e62874b87b7e5f90483, user_id=a899638fd4f44d738d98fed19c35babc, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:47.392821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7ae27-5d47-4e45-96a4-351e34cad099 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:47.421014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:47.427826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 810/1611] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:47 2022] PUT /identity/v3/projects/7eb9f2afc1a34e62874b87b7e5f90483/users/a899638fd4f44d738d98fed19c35babc/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:47.431784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631ef20-d434-4443-9e51-873a2a4886ca None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.433961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631ef20-d434-4443-9e51-873a2a4886ca None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.434491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631ef20-d434-4443-9e51-873a2a4886ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.450945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 802/1612] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:47.456122 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb27361-bdf7-4d0b-9a6b-92e9b6d0331b None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.456403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb27361-bdf7-4d0b-9a6b-92e9b6d0331b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.456823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb27361-bdf7-4d0b-9a6b-92e9b6d0331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.483780 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a631ef20-d434-4443-9e51-873a2a4886ca None None] MFA Rules not processed for user `e764f5d718dc4620aafe3119c54b672c`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:47.485153 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a631ef20-d434-4443-9e51-873a2a4886ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:47.611663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-eeb27361-bdf7-4d0b-9a6b-92e9b6d0331b None None] MFA Rules not processed for user `e1864d214d7349eb9aa19afc586ebee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:47.611663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-eeb27361-bdf7-4d0b-9a6b-92e9b6d0331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:47.653801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 811/1613] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:47.655001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631ef20-d434-4443-9e51-873a2a4886ca None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:47.701010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 803/1614] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:47.701944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb27361-bdf7-4d0b-9a6b-92e9b6d0331b None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:47.782499 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631ef20-d434-4443-9e51-873a2a4886ca None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:47.789689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb27361-bdf7-4d0b-9a6b-92e9b6d0331b None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:47.793723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c670eee-ae6d-4812-899e-f852efd91730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:47.794822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c670eee-ae6d-4812-899e-f852efd91730 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.794822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c670eee-ae6d-4812-899e-f852efd91730 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.795099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c670eee-ae6d-4812-899e-f852efd91730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.795835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe097f7-2ed0-422d-8ae6-d45e3f7f8170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:47.796757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe097f7-2ed0-422d-8ae6-d45e3f7f8170 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.797192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe097f7-2ed0-422d-8ae6-d45e3f7f8170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.797720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe097f7-2ed0-422d-8ae6-d45e3f7f8170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.798850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe097f7-2ed0-422d-8ae6-d45e3f7f8170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:47.800710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe097f7-2ed0-422d-8ae6-d45e3f7f8170 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:47.806430 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c670eee-ae6d-4812-899e-f852efd91730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:47.808547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c670eee-ae6d-4812-899e-f852efd91730 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:47.813876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 812/1615] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:47.815396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514bbf1-0832-4d8b-a754-1e730f37b802 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.815879 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514bbf1-0832-4d8b-a754-1e730f37b802 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.816383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514bbf1-0832-4d8b-a754-1e730f37b802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.820258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 804/1616] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:47.821689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2613-9a4c-4d9f-9cac-0ed79c9a38c1 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.822072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2613-9a4c-4d9f-9cac-0ed79c9a38c1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.822452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2613-9a4c-4d9f-9cac-0ed79c9a38c1 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.824005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 805/1617] 10.222.0.60 () {54 vars in 962 bytes} [Wed Aug 31 00:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:47.831003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c2613-9a4c-4d9f-9cac-0ed79c9a38c1 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:47.846249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-b514bbf1-0832-4d8b-a754-1e730f37b802 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:47.847863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b514bbf1-0832-4d8b-a754-1e730f37b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:47.856460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c2613-9a4c-4d9f-9cac-0ed79c9a38c1 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:47.860064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 813/1618] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:47.862121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed875d-8ce3-4a26-9cf9-2103ff3d5d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:47.862869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed875d-8ce3-4a26-9cf9-2103ff3d5d41 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.863486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed875d-8ce3-4a26-9cf9-2103ff3d5d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.863673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed875d-8ce3-4a26-9cf9-2103ff3d5d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.864433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed875d-8ce3-4a26-9cf9-2103ff3d5d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:47.865857 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faddd8-214e-4ef5-8e0c-fc55026e57fc None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.866710 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed875d-8ce3-4a26-9cf9-2103ff3d5d41 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:47.866897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faddd8-214e-4ef5-8e0c-fc55026e57fc None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.867540 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faddd8-214e-4ef5-8e0c-fc55026e57fc None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.870378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 814/1619] 10.222.0.60 () {54 vars in 962 bytes} [Wed Aug 31 00:15:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:47.872837 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21faddd8-214e-4ef5-8e0c-fc55026e57fc None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:47.893594 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21faddd8-214e-4ef5-8e0c-fc55026e57fc None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:47.903129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c8744-768f-4beb-a70f-eaca9c523e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:47.904346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8744-768f-4beb-a70f-eaca9c523e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.904792 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8744-768f-4beb-a70f-eaca9c523e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.905279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8744-768f-4beb-a70f-eaca9c523e2b admin admin] PATH_INFO: `/v3/projects/aea66817f6604959946a236d3a7445d5/users/f668f76a16994eaa916bd0a68b953d81/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.909781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 806/1620] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:47 2022] POST /identity/v3/projects => generated 363 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:47.911422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e27f-c69f-43a3-9402-33b829464aa1 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.911800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e27f-c69f-43a3-9402-33b829464aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.912164 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e27f-c69f-43a3-9402-33b829464aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.931260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c8744-768f-4beb-a70f-eaca9c523e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea66817f6604959946a236d3a7445d5, user_id=f668f76a16994eaa916bd0a68b953d81, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:47.934634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c8744-768f-4beb-a70f-eaca9c523e2b admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:47.939494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:47.963073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-ab42e27f-c69f-43a3-9402-33b829464aa1 None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:47.963718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 815/1621] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:47 2022] PUT /identity/v3/projects/aea66817f6604959946a236d3a7445d5/users/f668f76a16994eaa916bd0a68b953d81/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:47.964645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c8744-768f-4beb-a70f-eaca9c523e2b admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:47.965980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ab42e27f-c69f-43a3-9402-33b829464aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:48.042097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:48.056591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c8744-768f-4beb-a70f-eaca9c523e2b admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:48.061539 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037e198-0fa0-4772-a1dd-944c9623b28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:48.062157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037e198-0fa0-4772-a1dd-944c9623b28b service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:48.062809 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037e198-0fa0-4772-a1dd-944c9623b28b service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:48.062809 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037e198-0fa0-4772-a1dd-944c9623b28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:48.081348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 807/1622] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Aug 31 00:15:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:48.083103 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9537d2-25cc-4358-ab6c-93ea3377f13d None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:48.083457 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9537d2-25cc-4358-ab6c-93ea3377f13d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:48.084205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9537d2-25cc-4358-ab6c-93ea3377f13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:48.115841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-ef9537d2-25cc-4358-ab6c-93ea3377f13d None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:48.117367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ef9537d2-25cc-4358-ab6c-93ea3377f13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:48.129759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 808/1623] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Aug 31 00:15:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:48.130709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9537d2-25cc-4358-ab6c-93ea3377f13d None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:48.150953 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037e198-0fa0-4772-a1dd-944c9623b28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:48.152776 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037e198-0fa0-4772-a1dd-944c9623b28b service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:48.165455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 816/1624] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:48.166950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037e198-0fa0-4772-a1dd-944c9623b28b service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:48.210823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037e198-0fa0-4772-a1dd-944c9623b28b service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:48.224948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e3771-fc93-48c8-afc4-bd68b33d9ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:48.226994 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e3771-fc93-48c8-afc4-bd68b33d9ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:48.227744 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9537d2-25cc-4358-ab6c-93ea3377f13d None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:48.228490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e3771-fc93-48c8-afc4-bd68b33d9ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:48.229590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e3771-fc93-48c8-afc4-bd68b33d9ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:48.232549 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e3771-fc93-48c8-afc4-bd68b33d9ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:48.234757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e3771-fc93-48c8-afc4-bd68b33d9ed5 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:48.250690 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf313bee-4397-4456-8932-32f7588e3edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:48.251811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf313bee-4397-4456-8932-32f7588e3edf admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:48.252247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf313bee-4397-4456-8932-32f7588e3edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:48.252668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf313bee-4397-4456-8932-32f7588e3edf admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:48.257033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf313bee-4397-4456-8932-32f7588e3edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:48.261180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf313bee-4397-4456-8932-32f7588e3edf admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:48.270136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 817/1625] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:48.272322 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e3771-fc93-48c8-afc4-bd68b33d9ed5 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:48.300045 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e3771-fc93-48c8-afc4-bd68b33d9ed5 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:48.306973 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70f245-edf8-49ba-9969-1bc62324cb91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:48.308505 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70f245-edf8-49ba-9969-1bc62324cb91 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:48.309011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70f245-edf8-49ba-9969-1bc62324cb91 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:48.309931 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70f245-edf8-49ba-9969-1bc62324cb91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:48.320027 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 809/1626] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:48 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:48.323867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf313bee-4397-4456-8932-32f7588e3edf admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:48.360826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf313bee-4397-4456-8932-32f7588e3edf admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:48.374446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8755b40-5532-4d30-af40-efde94df0f03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:48.378007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8755b40-5532-4d30-af40-efde94df0f03 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:48.378303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8755b40-5532-4d30-af40-efde94df0f03 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:48.378656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8755b40-5532-4d30-af40-efde94df0f03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:48.445091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70f245-edf8-49ba-9969-1bc62324cb91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:48.446821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70f245-edf8-49ba-9969-1bc62324cb91 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:48.457600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 818/1627] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:48.458506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70f245-edf8-49ba-9969-1bc62324cb91 service nova] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:48.471141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70f245-edf8-49ba-9969-1bc62324cb91 service nova] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:48.476351 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6babd4-675a-4cde-ac8d-810602868f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:48.477231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6babd4-675a-4cde-ac8d-810602868f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:48.477505 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6babd4-675a-4cde-ac8d-810602868f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:48.477770 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6babd4-675a-4cde-ac8d-810602868f65 admin admin] PATH_INFO: `/v3/projects/aea66817f6604959946a236d3a7445d5/users/f668f76a16994eaa916bd0a68b953d81/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:48.480122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6babd4-675a-4cde-ac8d-810602868f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea66817f6604959946a236d3a7445d5, user_id=f668f76a16994eaa916bd0a68b953d81, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:48.482905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6babd4-675a-4cde-ac8d-810602868f65 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:48.501994 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 819/1628] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:48 2022] PUT /identity/v3/projects/aea66817f6604959946a236d3a7445d5/users/f668f76a16994eaa916bd0a68b953d81/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:48.502998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6babd4-675a-4cde-ac8d-810602868f65 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:48.513367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8755b40-5532-4d30-af40-efde94df0f03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:48.518615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8755b40-5532-4d30-af40-efde94df0f03 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:48.551021 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 810/1629] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:48.554158 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6fb1d-e774-497f-bea5-6159420ccd9f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:48.554442 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6fb1d-e774-497f-bea5-6159420ccd9f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:48.556876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:48.557160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6fb1d-e774-497f-bea5-6159420ccd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:48.639567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-12f6fb1d-e774-497f-bea5-6159420ccd9f None None] MFA Rules not processed for user `f668f76a16994eaa916bd0a68b953d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:48.639870 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6babd4-675a-4cde-ac8d-810602868f65 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:48.646513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-12f6fb1d-e774-497f-bea5-6159420ccd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:48.654846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0c628-67aa-48c2-8c1b-622f0de3035e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:48.655325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0c628-67aa-48c2-8c1b-622f0de3035e admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:48.655597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0c628-67aa-48c2-8c1b-622f0de3035e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:48.655866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0c628-67aa-48c2-8c1b-622f0de3035e admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:48.656669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0c628-67aa-48c2-8c1b-622f0de3035e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:48.658326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0c628-67aa-48c2-8c1b-622f0de3035e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:48.687179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 820/1630] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:48.690909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0c628-67aa-48c2-8c1b-622f0de3035e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:48.710743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0c628-67aa-48c2-8c1b-622f0de3035e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:48.723228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff5dd5-aa22-404a-9750-b034fc3fcd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:48.723913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff5dd5-aa22-404a-9750-b034fc3fcd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:48.724184 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff5dd5-aa22-404a-9750-b034fc3fcd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:48.724453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff5dd5-aa22-404a-9750-b034fc3fcd6c admin admin] PATH_INFO: `/v3/projects/795dbc964aff45759c8a892b50ca9457/users/1ab935aa5f41413cbe30a87d6e9beafa/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:48.755194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff5dd5-aa22-404a-9750-b034fc3fcd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=795dbc964aff45759c8a892b50ca9457, user_id=1ab935aa5f41413cbe30a87d6e9beafa, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:48.758909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff5dd5-aa22-404a-9750-b034fc3fcd6c admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:48.800725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:48.803524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 821/1631] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:48 2022] PUT /identity/v3/projects/795dbc964aff45759c8a892b50ca9457/users/1ab935aa5f41413cbe30a87d6e9beafa/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:15:48.807895 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff5dd5-aa22-404a-9750-b034fc3fcd6c admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:48.857491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 811/1632] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:48.871180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6fb1d-e774-497f-bea5-6159420ccd9f None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:49.004808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff5dd5-aa22-404a-9750-b034fc3fcd6c admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:49.022232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1a8d9-a12f-4aeb-b25a-2f78a52f0390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:49.026582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1a8d9-a12f-4aeb-b25a-2f78a52f0390 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:49.026582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1a8d9-a12f-4aeb-b25a-2f78a52f0390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:49.027983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1a8d9-a12f-4aeb-b25a-2f78a52f0390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:49.028226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1a8d9-a12f-4aeb-b25a-2f78a52f0390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:49.030022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1a8d9-a12f-4aeb-b25a-2f78a52f0390 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:49.058446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6fb1d-e774-497f-bea5-6159420ccd9f None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:49.066650 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 822/1633] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:49.069432 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9357b7-8fe8-48c8-8cf5-c0c1b0938e5f None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:49.069713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9357b7-8fe8-48c8-8cf5-c0c1b0938e5f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:49.069991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9357b7-8fe8-48c8-8cf5-c0c1b0938e5f None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:49.082616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 823/1634] 10.222.0.60 () {54 vars in 912 bytes} [Wed Aug 31 00:15:49 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:49.082616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9357b7-8fe8-48c8-8cf5-c0c1b0938e5f None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:49.123936 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9357b7-8fe8-48c8-8cf5-c0c1b0938e5f None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:49.137086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b039f42-0ae7-4dfb-9ae7-469341a1d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:49.137809 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b039f42-0ae7-4dfb-9ae7-469341a1d165 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:49.138083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b039f42-0ae7-4dfb-9ae7-469341a1d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:49.138352 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b039f42-0ae7-4dfb-9ae7-469341a1d165 admin admin] PATH_INFO: `/v3/projects/795dbc964aff45759c8a892b50ca9457/users/1ab935aa5f41413cbe30a87d6e9beafa/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:49.141226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b039f42-0ae7-4dfb-9ae7-469341a1d165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=795dbc964aff45759c8a892b50ca9457, user_id=1ab935aa5f41413cbe30a87d6e9beafa, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:49.149488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b039f42-0ae7-4dfb-9ae7-469341a1d165 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:49.153241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc8424-8e47-42f4-a225-e73aa53ba693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:49.153981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc8424-8e47-42f4-a225-e73aa53ba693 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:49.154381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc8424-8e47-42f4-a225-e73aa53ba693 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:49.155429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc8424-8e47-42f4-a225-e73aa53ba693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:49.188139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 824/1635] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:49 2022] PUT /identity/v3/projects/795dbc964aff45759c8a892b50ca9457/users/1ab935aa5f41413cbe30a87d6e9beafa/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:49.188139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e0f4-2fe7-4d6c-ac9e-1f4010bcab3f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:49.188139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e0f4-2fe7-4d6c-ac9e-1f4010bcab3f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:49.188139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e0f4-2fe7-4d6c-ac9e-1f4010bcab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:49.220481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-c459e0f4-2fe7-4d6c-ac9e-1f4010bcab3f None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:49.221820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c459e0f4-2fe7-4d6c-ac9e-1f4010bcab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:49.279662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc8424-8e47-42f4-a225-e73aa53ba693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:49.281746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc8424-8e47-42f4-a225-e73aa53ba693 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:49.295003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 812/1636] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:49.297233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1421fe2-47fd-45ee-a51e-b1f372b33020 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:49.297658 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1421fe2-47fd-45ee-a51e-b1f372b33020 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:49.297979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1421fe2-47fd-45ee-a51e-b1f372b33020 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:49.299524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 813/1637] 10.222.0.60 () {54 vars in 912 bytes} [Wed Aug 31 00:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:49.301793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc881700-bfbd-45a2-9759-31ea20fd2e3f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:49.302154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc881700-bfbd-45a2-9759-31ea20fd2e3f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:49.302573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc881700-bfbd-45a2-9759-31ea20fd2e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:49.340546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-dc881700-bfbd-45a2-9759-31ea20fd2e3f None None] MFA Rules not processed for user `1ab935aa5f41413cbe30a87d6e9beafa`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:49.342400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-dc881700-bfbd-45a2-9759-31ea20fd2e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:49.399827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 825/1638] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:15:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:49.410139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecb02f-e106-4aed-b553-c908b712af76 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:49.410430 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecb02f-e106-4aed-b553-c908b712af76 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:49.410711 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecb02f-e106-4aed-b553-c908b712af76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:49.416864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:49.442934 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:49.469091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-aaecb02f-e106-4aed-b553-c908b712af76 None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:49.470706 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-aaecb02f-e106-4aed-b553-c908b712af76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:49.503823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 826/1639] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:15:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:49.505239 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecb02f-e106-4aed-b553-c908b712af76 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:49.507748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 814/1640] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:49.529096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc881700-bfbd-45a2-9759-31ea20fd2e3f None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:49.623231 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc881700-bfbd-45a2-9759-31ea20fd2e3f None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:49.627022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecb02f-e106-4aed-b553-c908b712af76 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:49.633056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35b720-ec53-4496-b9f7-02a45864f658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:49.634302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35b720-ec53-4496-b9f7-02a45864f658 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:49.635396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35b720-ec53-4496-b9f7-02a45864f658 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:49.636405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35b720-ec53-4496-b9f7-02a45864f658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:49.640561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344526e-8da0-42e1-9528-bc89f9cdcaa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:49.641928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344526e-8da0-42e1-9528-bc89f9cdcaa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:49.642398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344526e-8da0-42e1-9528-bc89f9cdcaa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:49.642859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344526e-8da0-42e1-9528-bc89f9cdcaa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:49.652142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35b720-ec53-4496-b9f7-02a45864f658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:49.653752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35b720-ec53-4496-b9f7-02a45864f658 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:49.657345 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344526e-8da0-42e1-9528-bc89f9cdcaa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:49.659772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344526e-8da0-42e1-9528-bc89f9cdcaa7 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:49.671558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 815/1641] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:49.689765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 827/1642] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:49.742149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35b720-ec53-4496-b9f7-02a45864f658 service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:49.752331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35b720-ec53-4496-b9f7-02a45864f658 service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:49.765864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c56239-4eda-4b0d-9236-546b1da4286e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:49.766502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c56239-4eda-4b0d-9236-546b1da4286e service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:49.766780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c56239-4eda-4b0d-9236-546b1da4286e service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:49.767734 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c56239-4eda-4b0d-9236-546b1da4286e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:49.794527 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c56239-4eda-4b0d-9236-546b1da4286e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:49.800549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c56239-4eda-4b0d-9236-546b1da4286e service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:49.825786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 816/1643] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:50.188598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344526e-8da0-42e1-9528-bc89f9cdcaa7 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:50.200337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344526e-8da0-42e1-9528-bc89f9cdcaa7 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:50.206076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394465d-66ec-4fb3-be6f-15d36c0f70fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:50.206860 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394465d-66ec-4fb3-be6f-15d36c0f70fb service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:50.207273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394465d-66ec-4fb3-be6f-15d36c0f70fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:50.207637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394465d-66ec-4fb3-be6f-15d36c0f70fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:50.298812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394465d-66ec-4fb3-be6f-15d36c0f70fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:50.301451 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394465d-66ec-4fb3-be6f-15d36c0f70fb service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:50.331536 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 828/1644] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:50.566502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c56239-4eda-4b0d-9236-546b1da4286e service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:50.768945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c56239-4eda-4b0d-9236-546b1da4286e service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:50.768945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:50.768945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:50.768945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:50.773439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] PATH_INFO: `/v3/users/e1864d214d7349eb9aa19afc586ebee8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:50.774526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1864d214d7349eb9aa19afc586ebee8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:50.777801 dv-cinder-852209-8-smb devstack@keystone.service[81709]: WARNING py.warnings [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:50.777801 dv-cinder-852209-8-smb devstack@keystone.service[81709]: warnings.warn(msg) Aug 31 00:15:50.777801 dv-cinder-852209-8-smb devstack@keystone.service[81709]: Aug 31 00:15:50.780893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:50.991043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1864d214d7349eb9aa19afc586ebee8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:51.015284 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1864d214d7349eb9aa19afc586ebee8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:51.016064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1864d214d7349eb9aa19afc586ebee8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:51.035882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1864d214d7349eb9aa19afc586ebee8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:51.071645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:51.116838 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1864d214d7349eb9aa19afc586ebee8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:51.128562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 817/1645] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:15:50 2022] DELETE /identity/v3/users/e1864d214d7349eb9aa19afc586ebee8 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:51.132946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ccd1a-5a53-448b-af7f-15afbaef0767 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.133502 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ccd1a-5a53-448b-af7f-15afbaef0767 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.133568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ccd1a-5a53-448b-af7f-15afbaef0767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.174997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ef8ccd1a-5a53-448b-af7f-15afbaef0767 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:51.178487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ef8ccd1a-5a53-448b-af7f-15afbaef0767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:51.255966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:51.258074 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:51.354944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 829/1646] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:51.426408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500519c-71ae-4bcf-a864-40e101615475 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:51.436868 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38173add-32cc-471e-91a9-baf722338d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:51.437605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38173add-32cc-471e-91a9-baf722338d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.437883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38173add-32cc-471e-91a9-baf722338d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.438216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38173add-32cc-471e-91a9-baf722338d29 admin admin] PATH_INFO: `/v3/users/9e0f8ddd56924376af44629aae5cc532` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.439379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38173add-32cc-471e-91a9-baf722338d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0f8ddd56924376af44629aae5cc532)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:51.444038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38173add-32cc-471e-91a9-baf722338d29 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:51.492512 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ccd1a-5a53-448b-af7f-15afbaef0767 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:51.494631 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ef8ccd1a-5a53-448b-af7f-15afbaef0767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:51.548599 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-38173add-32cc-471e-91a9-baf722338d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0f8ddd56924376af44629aae5cc532'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:51.569256 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-38173add-32cc-471e-91a9-baf722338d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0f8ddd56924376af44629aae5cc532'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:51.570397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-38173add-32cc-471e-91a9-baf722338d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0f8ddd56924376af44629aae5cc532'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:51.583138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-38173add-32cc-471e-91a9-baf722338d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0f8ddd56924376af44629aae5cc532'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:51.592980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:51.613044 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-38173add-32cc-471e-91a9-baf722338d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0f8ddd56924376af44629aae5cc532'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:51.627152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 818/1647] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:15:51 2022] DELETE /identity/v3/users/9e0f8ddd56924376af44629aae5cc532 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:15:51.628127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ccd1a-5a53-448b-af7f-15afbaef0767 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:51.628994 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4b9e1-d0eb-4ae7-8a09-3f974d8802b5 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.629484 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4b9e1-d0eb-4ae7-8a09-3f974d8802b5 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.629776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4b9e1-d0eb-4ae7-8a09-3f974d8802b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.665452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-cec4b9e1-d0eb-4ae7-8a09-3f974d8802b5 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:51.667370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-cec4b9e1-d0eb-4ae7-8a09-3f974d8802b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:51.743058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063009a-be24-49ed-8667-83f32a432d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:51.743424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063009a-be24-49ed-8667-83f32a432d5c service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.743685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063009a-be24-49ed-8667-83f32a432d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.743953 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063009a-be24-49ed-8667-83f32a432d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.745784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3063009a-be24-49ed-8667-83f32a432d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:51.776092 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 819/1648] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:51.835303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063009a-be24-49ed-8667-83f32a432d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:51.836848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063009a-be24-49ed-8667-83f32a432d5c service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:51.853910 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 830/1649] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:51.952356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4b9e1-d0eb-4ae7-8a09-3f974d8802b5 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:51.954173 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-cec4b9e1-d0eb-4ae7-8a09-3f974d8802b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:51.987378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4b9e1-d0eb-4ae7-8a09-3f974d8802b5 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:52.001728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1611efa-3675-4ec0-876e-b30212796f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:52.004297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611efa-3675-4ec0-876e-b30212796f49 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:52.005223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611efa-3675-4ec0-876e-b30212796f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:52.006174 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611efa-3675-4ec0-876e-b30212796f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:52.026597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:52.036211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1611efa-3675-4ec0-876e-b30212796f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:52.040134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1611efa-3675-4ec0-876e-b30212796f49 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:52.072965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 820/1650] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:53.743295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063009a-be24-49ed-8667-83f32a432d5c service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:53.744987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3063009a-be24-49ed-8667-83f32a432d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:53.770790 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063009a-be24-49ed-8667-83f32a432d5c service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:53.786401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:53.787904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:53.788451 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:53.788868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8 admin admin] PATH_INFO: `/v3/projects/aaefff1523174e98b85f2273d1c55168` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:53.793699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaefff1523174e98b85f2273d1c55168)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:53.795520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: WARNING py.warnings [None req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:53.795520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: warnings.warn(msg) Aug 31 00:15:53.795520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: Aug 31 00:15:53.800500 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:54.004036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaefff1523174e98b85f2273d1c55168', 'request_id': 'req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:54.032538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaefff1523174e98b85f2273d1c55168', 'request_id': 'req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:54.068213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaefff1523174e98b85f2273d1c55168', 'request_id': 'req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:54.091624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8 admin admin] The token cache is being invalidate because project aaefff1523174e98b85f2273d1c55168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:15:54.091922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:54.092618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f856a8ce-269f-4920-bdcd-e33ecc2be2e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:54.100320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 831/1651] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:15:53 2022] DELETE /identity/v3/projects/aaefff1523174e98b85f2273d1c55168 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:54.106203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb430e7-2c4d-4a31-aaa7-d37c4c4ad2e0 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.106744 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb430e7-2c4d-4a31-aaa7-d37c4c4ad2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.107098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb430e7-2c4d-4a31-aaa7-d37c4c4ad2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.160940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-deb430e7-2c4d-4a31-aaa7-d37c4c4ad2e0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:54.162243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-deb430e7-2c4d-4a31-aaa7-d37c4c4ad2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:54.353189 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 821/1652] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:54.361812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b23bfc-158d-4615-86c5-af7863bdbdd3 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.362330 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b23bfc-158d-4615-86c5-af7863bdbdd3 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.363149 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b23bfc-158d-4615-86c5-af7863bdbdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.437629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a6b23bfc-158d-4615-86c5-af7863bdbdd3 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:54.453504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a6b23bfc-158d-4615-86c5-af7863bdbdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:54.469354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 832/1653] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:54.473405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb430e7-2c4d-4a31-aaa7-d37c4c4ad2e0 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:54.501638 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb430e7-2c4d-4a31-aaa7-d37c4c4ad2e0 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:54.510990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac986ce-9c63-43f2-9fdb-09c936d76cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:54.511637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac986ce-9c63-43f2-9fdb-09c936d76cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.511918 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac986ce-9c63-43f2-9fdb-09c936d76cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.513019 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac986ce-9c63-43f2-9fdb-09c936d76cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.513749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac986ce-9c63-43f2-9fdb-09c936d76cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:54.514161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac986ce-9c63-43f2-9fdb-09c936d76cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:54.515985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac986ce-9c63-43f2-9fdb-09c936d76cd0 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:54.547663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 822/1654] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:54.552039 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b23bfc-158d-4615-86c5-af7863bdbdd3 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:54.567832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b23bfc-158d-4615-86c5-af7863bdbdd3 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:54.582222 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff59617-3df2-415f-9ce9-2ba3d9be0d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:54.583171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff59617-3df2-415f-9ce9-2ba3d9be0d7a admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.583553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff59617-3df2-415f-9ce9-2ba3d9be0d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.583920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff59617-3df2-415f-9ce9-2ba3d9be0d7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.584961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff59617-3df2-415f-9ce9-2ba3d9be0d7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:54.587385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff59617-3df2-415f-9ce9-2ba3d9be0d7a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:54.655934 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 833/1655] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:54 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:54.660555 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac986ce-9c63-43f2-9fdb-09c936d76cd0 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:54.681671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac986ce-9c63-43f2-9fdb-09c936d76cd0 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:54.833042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614439a-cf43-4fc6-837d-1b81d750067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:54.833711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614439a-cf43-4fc6-837d-1b81d750067e admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.833989 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614439a-cf43-4fc6-837d-1b81d750067e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.834259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614439a-cf43-4fc6-837d-1b81d750067e admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.834908 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614439a-cf43-4fc6-837d-1b81d750067e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:54.841627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614439a-cf43-4fc6-837d-1b81d750067e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:54.907831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 823/1656] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:54 2022] POST /identity/v3/users => generated 303 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:54.911777 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff59617-3df2-415f-9ce9-2ba3d9be0d7a admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:54.918020 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:54.924260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff59617-3df2-415f-9ce9-2ba3d9be0d7a admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:54.950712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dffc7-b1f3-46af-a22e-1dc9a8967b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:54.955505 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dffc7-b1f3-46af-a22e-1dc9a8967b1e admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.955853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dffc7-b1f3-46af-a22e-1dc9a8967b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.956135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dffc7-b1f3-46af-a22e-1dc9a8967b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.958100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dffc7-b1f3-46af-a22e-1dc9a8967b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:54.967485 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dffc7-b1f3-46af-a22e-1dc9a8967b1e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:54.992490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 834/1657] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:54.996633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614439a-cf43-4fc6-837d-1b81d750067e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:55.016286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614439a-cf43-4fc6-837d-1b81d750067e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:55.026987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d28efa-b55f-4364-9956-28c2f827dbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:55.027726 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d28efa-b55f-4364-9956-28c2f827dbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.028007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d28efa-b55f-4364-9956-28c2f827dbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.028276 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d28efa-b55f-4364-9956-28c2f827dbc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.032336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d28efa-b55f-4364-9956-28c2f827dbc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:55.045550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d28efa-b55f-4364-9956-28c2f827dbc2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:55.057689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 824/1658] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:15:55.061936 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dffc7-b1f3-46af-a22e-1dc9a8967b1e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:55.073411 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dffc7-b1f3-46af-a22e-1dc9a8967b1e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:55.084576 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cdecf-7486-4c60-aa72-e5e605bbcabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:55.085560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cdecf-7486-4c60-aa72-e5e605bbcabb admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.085974 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cdecf-7486-4c60-aa72-e5e605bbcabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.086382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cdecf-7486-4c60-aa72-e5e605bbcabb admin admin] PATH_INFO: `/v3/projects/cf213afa28974d20b489514343439b87/users/f71879bcda694171823b8a3ee8d08285/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.119713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cdecf-7486-4c60-aa72-e5e605bbcabb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf213afa28974d20b489514343439b87, user_id=f71879bcda694171823b8a3ee8d08285, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:55.123099 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cdecf-7486-4c60-aa72-e5e605bbcabb admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:55.161766 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 835/1659] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:55 2022] PUT /identity/v3/projects/cf213afa28974d20b489514343439b87/users/f71879bcda694171823b8a3ee8d08285/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:55.167092 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ba07-4dee-4d0f-83f3-efa75ad72366 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.168263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ba07-4dee-4d0f-83f3-efa75ad72366 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.169023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ba07-4dee-4d0f-83f3-efa75ad72366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.255300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c453ba07-4dee-4d0f-83f3-efa75ad72366 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:55.256707 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c453ba07-4dee-4d0f-83f3-efa75ad72366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:55.360677 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:55.385259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 825/1660] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:55.646735 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cdecf-7486-4c60-aa72-e5e605bbcabb admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:55.655091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c21cdecf-7486-4c60-aa72-e5e605bbcabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:55.834890 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cdecf-7486-4c60-aa72-e5e605bbcabb admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:55.838833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02697b24-2d4e-4d19-8835-b32ca75509a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:55.839738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02697b24-2d4e-4d19-8835-b32ca75509a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.839738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02697b24-2d4e-4d19-8835-b32ca75509a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.840358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02697b24-2d4e-4d19-8835-b32ca75509a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.859314 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02697b24-2d4e-4d19-8835-b32ca75509a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:55.867020 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02697b24-2d4e-4d19-8835-b32ca75509a7 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:55.882654 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 836/1661] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:15:56.863519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453ba07-4dee-4d0f-83f3-efa75ad72366 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:56.865302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c453ba07-4dee-4d0f-83f3-efa75ad72366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:56.885678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453ba07-4dee-4d0f-83f3-efa75ad72366 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:56.900815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:56.901669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:56.902101 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:56.902580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] PATH_INFO: `/v3/projects/e25f948ac1c74a2da7b5fdd5ac581e4c` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:56.919746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25f948ac1c74a2da7b5fdd5ac581e4c)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:56.922246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:57.067188 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02697b24-2d4e-4d19-8835-b32ca75509a7 service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.069056 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-02697b24-2d4e-4d19-8835-b32ca75509a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:57.075132 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25f948ac1c74a2da7b5fdd5ac581e4c', 'request_id': 'req-adb0aaef-7dc2-413c-9671-860ea4d0f02b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.097973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25f948ac1c74a2da7b5fdd5ac581e4c', 'request_id': 'req-adb0aaef-7dc2-413c-9671-860ea4d0f02b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.106482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25f948ac1c74a2da7b5fdd5ac581e4c', 'request_id': 'req-adb0aaef-7dc2-413c-9671-860ea4d0f02b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.106983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02697b24-2d4e-4d19-8835-b32ca75509a7 service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:57.128631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] The token cache is being invalidate because project e25f948ac1c74a2da7b5fdd5ac581e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:15:57.129723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.135142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.137067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 826/1662] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:15:56 2022] DELETE /identity/v3/projects/e25f948ac1c74a2da7b5fdd5ac581e4c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:57.141398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.143832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:57.255157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4fede-f217-4fb5-a870-49db94eff638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:57.258072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4fede-f217-4fb5-a870-49db94eff638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.258581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4fede-f217-4fb5-a870-49db94eff638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.259124 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4fede-f217-4fb5-a870-49db94eff638 admin admin] PATH_INFO: `/v3/users/fdbdf25ff2bb4c8fa90433446131fc96` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:57.262602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4fede-f217-4fb5-a870-49db94eff638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdbdf25ff2bb4c8fa90433446131fc96)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:57.266391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4fede-f217-4fb5-a870-49db94eff638 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:57.347513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0aaef-7dc2-413c-9671-860ea4d0f02b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:57.359292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:57.362314 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.363331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.363924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] PATH_INFO: `/v3/users/f668f76a16994eaa916bd0a68b953d81` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:57.367522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f668f76a16994eaa916bd0a68b953d81)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:57.376646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:57.424561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-5ba4fede-f217-4fb5-a870-49db94eff638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdbdf25ff2bb4c8fa90433446131fc96'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.454982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-5ba4fede-f217-4fb5-a870-49db94eff638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdbdf25ff2bb4c8fa90433446131fc96'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.455751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-5ba4fede-f217-4fb5-a870-49db94eff638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdbdf25ff2bb4c8fa90433446131fc96'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.456969 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-5ba4fede-f217-4fb5-a870-49db94eff638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdbdf25ff2bb4c8fa90433446131fc96'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.480830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-5ba4fede-f217-4fb5-a870-49db94eff638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdbdf25ff2bb4c8fa90433446131fc96'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.485513 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:57.498633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f668f76a16994eaa916bd0a68b953d81'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.507165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 837/1663] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:15:57 2022] DELETE /identity/v3/users/fdbdf25ff2bb4c8fa90433446131fc96 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:57.511587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2632de-5086-48df-99a2-b01a8387562d None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.512158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2632de-5086-48df-99a2-b01a8387562d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.512158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2632de-5086-48df-99a2-b01a8387562d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:57.517242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f668f76a16994eaa916bd0a68b953d81'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.517880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f668f76a16994eaa916bd0a68b953d81'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.531581 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f668f76a16994eaa916bd0a68b953d81'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.551613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-1e2632de-5086-48df-99a2-b01a8387562d None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:57.553956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1e2632de-5086-48df-99a2-b01a8387562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:57.568358 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f668f76a16994eaa916bd0a68b953d81'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:57.579862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 827/1664] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:15:57 2022] DELETE /identity/v3/users/f668f76a16994eaa916bd0a68b953d81 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:57.745536 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 838/1665] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:15:57.785750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.787381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:57.796232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:57.913677 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d1930-d223-4fb2-95aa-33fc73f5a1a9 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:57.919426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832f501-92a0-4846-ae2e-3320918a1071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:57.920238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832f501-92a0-4846-ae2e-3320918a1071 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.920765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832f501-92a0-4846-ae2e-3320918a1071 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.921106 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832f501-92a0-4846-ae2e-3320918a1071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.073155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832f501-92a0-4846-ae2e-3320918a1071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.075073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832f501-92a0-4846-ae2e-3320918a1071 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.103536 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 828/1666] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:58.426067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf66a7-b17a-4460-90e6-63b0dcc8be2d None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.426749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf66a7-b17a-4460-90e6-63b0dcc8be2d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.426749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf66a7-b17a-4460-90e6-63b0dcc8be2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.482808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-0abf66a7-b17a-4460-90e6-63b0dcc8be2d None None] MFA Rules not processed for user `f71879bcda694171823b8a3ee8d08285`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:58.484080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0abf66a7-b17a-4460-90e6-63b0dcc8be2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:58.570761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 839/1667] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:58 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:58.575583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832f501-92a0-4846-ae2e-3320918a1071 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.577513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d832f501-92a0-4846-ae2e-3320918a1071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:58.595481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832f501-92a0-4846-ae2e-3320918a1071 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:58.602170 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b5a8-14da-4e62-b0e9-14ab913c5b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:58.603862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b5a8-14da-4e62-b0e9-14ab913c5b7f admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.604201 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b5a8-14da-4e62-b0e9-14ab913c5b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.604556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b5a8-14da-4e62-b0e9-14ab913c5b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.605391 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4b5a8-14da-4e62-b0e9-14ab913c5b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.608368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4b5a8-14da-4e62-b0e9-14ab913c5b7f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.664160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 829/1668] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:58 2022] POST /identity/v3/projects => generated 403 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:58.664993 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf66a7-b17a-4460-90e6-63b0dcc8be2d None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.680427 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf66a7-b17a-4460-90e6-63b0dcc8be2d None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:58.822841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ed012-ae09-4bc7-a3ba-faae2a25fce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:58.823519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ed012-ae09-4bc7-a3ba-faae2a25fce2 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.823746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ed012-ae09-4bc7-a3ba-faae2a25fce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.824012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ed012-ae09-4bc7-a3ba-faae2a25fce2 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.825332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ed012-ae09-4bc7-a3ba-faae2a25fce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.827130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ed012-ae09-4bc7-a3ba-faae2a25fce2 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.880396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b5a8-14da-4e62-b0e9-14ab913c5b7f admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.883041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-bdd4b5a8-14da-4e62-b0e9-14ab913c5b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:58.887696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 840/1669] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:58 2022] POST /identity/v3/users => generated 308 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:58.895681 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ed012-ae09-4bc7-a3ba-faae2a25fce2 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.917050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ed012-ae09-4bc7-a3ba-faae2a25fce2 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:58.920990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b5a8-14da-4e62-b0e9-14ab913c5b7f admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:58.933529 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b00253-db4d-43f6-8020-dccb9e332bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:58.934526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b00253-db4d-43f6-8020-dccb9e332bbc admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.934655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd6a71-45ea-4394-84d7-a382defbb1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:58.934873 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b00253-db4d-43f6-8020-dccb9e332bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.935363 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd6a71-45ea-4394-84d7-a382defbb1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.935506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b00253-db4d-43f6-8020-dccb9e332bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.936066 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b00253-db4d-43f6-8020-dccb9e332bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.937177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd6a71-45ea-4394-84d7-a382defbb1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.938554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd6a71-45ea-4394-84d7-a382defbb1f7 admin admin] PATH_INFO: `/v3/projects/aea66817f6604959946a236d3a7445d5` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.941025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b00253-db4d-43f6-8020-dccb9e332bbc admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.941628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd6a71-45ea-4394-84d7-a382defbb1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea66817f6604959946a236d3a7445d5)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.944322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd6a71-45ea-4394-84d7-a382defbb1f7 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.946042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:58.967653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 841/1670] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:58.968625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b00253-db4d-43f6-8020-dccb9e332bbc admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.997910 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b00253-db4d-43f6-8020-dccb9e332bbc admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.030168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751382a5-fe1c-485a-8dc3-3237fcf963c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.030877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751382a5-fe1c-485a-8dc3-3237fcf963c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.031157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751382a5-fe1c-485a-8dc3-3237fcf963c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.031434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751382a5-fe1c-485a-8dc3-3237fcf963c6 admin admin] PATH_INFO: `/v3/projects/c3a313415ad548ac89d21cbc00e4c3c9/users/eee58b02fef045a3b7d7a53cf8c4d140/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.075690 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751382a5-fe1c-485a-8dc3-3237fcf963c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a313415ad548ac89d21cbc00e4c3c9, user_id=eee58b02fef045a3b7d7a53cf8c4d140, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.078952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751382a5-fe1c-485a-8dc3-3237fcf963c6 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.107162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6cfd6a71-45ea-4394-84d7-a382defbb1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea66817f6604959946a236d3a7445d5', 'request_id': 'req-6cfd6a71-45ea-4394-84d7-a382defbb1f7'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:59.111145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 842/1671] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:58 2022] PUT /identity/v3/projects/c3a313415ad548ac89d21cbc00e4c3c9/users/eee58b02fef045a3b7d7a53cf8c4d140/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:59.115191 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751382a5-fe1c-485a-8dc3-3237fcf963c6 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:59.133011 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6cfd6a71-45ea-4394-84d7-a382defbb1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea66817f6604959946a236d3a7445d5', 'request_id': 'req-6cfd6a71-45ea-4394-84d7-a382defbb1f7'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:59.142561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6cfd6a71-45ea-4394-84d7-a382defbb1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea66817f6604959946a236d3a7445d5', 'request_id': 'req-6cfd6a71-45ea-4394-84d7-a382defbb1f7'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:59.172493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6cfd6a71-45ea-4394-84d7-a382defbb1f7 admin admin] The token cache is being invalidate because project aea66817f6604959946a236d3a7445d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:15:59.172703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6cfd6a71-45ea-4394-84d7-a382defbb1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:59.174222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6cfd6a71-45ea-4394-84d7-a382defbb1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:59.177387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 830/1672] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:15:58 2022] DELETE /identity/v3/projects/aea66817f6604959946a236d3a7445d5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:59.182463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579a2b3-cd8f-4c2f-a76f-795350d8e361 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.182925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579a2b3-cd8f-4c2f-a76f-795350d8e361 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.183331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579a2b3-cd8f-4c2f-a76f-795350d8e361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.212104 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-0579a2b3-cd8f-4c2f-a76f-795350d8e361 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:59.213716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0579a2b3-cd8f-4c2f-a76f-795350d8e361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:59.227397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:59.297978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751382a5-fe1c-485a-8dc3-3237fcf963c6 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.314181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d364c-7679-4b78-b7fa-d41cce932022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.317797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d364c-7679-4b78-b7fa-d41cce932022 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.318015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d364c-7679-4b78-b7fa-d41cce932022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.318286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d364c-7679-4b78-b7fa-d41cce932022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.320379 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d364c-7679-4b78-b7fa-d41cce932022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.323456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d364c-7679-4b78-b7fa-d41cce932022 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.329941 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 831/1673] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:59.342060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29e5c3-46da-4f7f-ae6b-55534123b998 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.342342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29e5c3-46da-4f7f-ae6b-55534123b998 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.342727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29e5c3-46da-4f7f-ae6b-55534123b998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.363743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 843/1674] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:59.370772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d364c-7679-4b78-b7fa-d41cce932022 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:59.374723 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d47d364c-7679-4b78-b7fa-d41cce932022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:59.398484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d364c-7679-4b78-b7fa-d41cce932022 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.398697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-fe29e5c3-46da-4f7f-ae6b-55534123b998 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:59.400771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-fe29e5c3-46da-4f7f-ae6b-55534123b998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:59.408064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2b391-3813-46b1-81ab-959e2417ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.409176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2b391-3813-46b1-81ab-959e2417ac51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.409751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2b391-3813-46b1-81ab-959e2417ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.410265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2b391-3813-46b1-81ab-959e2417ac51 admin admin] PATH_INFO: `/v3/projects/c3a313415ad548ac89d21cbc00e4c3c9/users/eee58b02fef045a3b7d7a53cf8c4d140/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.412829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2b391-3813-46b1-81ab-959e2417ac51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a313415ad548ac89d21cbc00e4c3c9, user_id=eee58b02fef045a3b7d7a53cf8c4d140, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.417401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2b391-3813-46b1-81ab-959e2417ac51 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.439432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 832/1675] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:59.441790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29e5c3-46da-4f7f-ae6b-55534123b998 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:59.455193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29e5c3-46da-4f7f-ae6b-55534123b998 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.469344 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 844/1676] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:59 2022] PUT /identity/v3/projects/c3a313415ad548ac89d21cbc00e4c3c9/users/eee58b02fef045a3b7d7a53cf8c4d140/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:59.547719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ee079-985c-46e2-9c2e-92bcc3af9e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.548974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ee079-985c-46e2-9c2e-92bcc3af9e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.549282 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ee079-985c-46e2-9c2e-92bcc3af9e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.549566 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ee079-985c-46e2-9c2e-92bcc3af9e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.550676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ee079-985c-46e2-9c2e-92bcc3af9e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:59.551048 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ee079-985c-46e2-9c2e-92bcc3af9e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.552834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ee079-985c-46e2-9c2e-92bcc3af9e45 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.591863 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 833/1677] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:59.596342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2b391-3813-46b1-81ab-959e2417ac51 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:59.612348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2b391-3813-46b1-81ab-959e2417ac51 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.631503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf949-f4b4-4e89-84d5-7b6c3e55ef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.632276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf949-f4b4-4e89-84d5-7b6c3e55ef15 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.632988 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf949-f4b4-4e89-84d5-7b6c3e55ef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.633388 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf949-f4b4-4e89-84d5-7b6c3e55ef15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.636199 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daf949-f4b4-4e89-84d5-7b6c3e55ef15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.642208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daf949-f4b4-4e89-84d5-7b6c3e55ef15 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.725685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 845/1678] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:59 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:15:59.726683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ee079-985c-46e2-9c2e-92bcc3af9e45 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:59.753457 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ee079-985c-46e2-9c2e-92bcc3af9e45 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.902423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb1bb2-0896-44ff-be3b-b3428f4d2b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.903834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb1bb2-0896-44ff-be3b-b3428f4d2b4e admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.904573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb1bb2-0896-44ff-be3b-b3428f4d2b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.905032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb1bb2-0896-44ff-be3b-b3428f4d2b4e admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.906503 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb1bb2-0896-44ff-be3b-b3428f4d2b4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.909781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb1bb2-0896-44ff-be3b-b3428f4d2b4e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.992248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 834/1679] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:59 2022] POST /identity/v3/users => generated 284 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:15:59.996302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf949-f4b4-4e89-84d5-7b6c3e55ef15 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:00.029502 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf949-f4b4-4e89-84d5-7b6c3e55ef15 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:00.047899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71843f27-52c6-46d2-8a0f-5acfe72055b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:00.064337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71843f27-52c6-46d2-8a0f-5acfe72055b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:00.064878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71843f27-52c6-46d2-8a0f-5acfe72055b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:00.066621 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71843f27-52c6-46d2-8a0f-5acfe72055b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:00.072639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71843f27-52c6-46d2-8a0f-5acfe72055b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:00.077592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71843f27-52c6-46d2-8a0f-5acfe72055b7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:00.097259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 846/1680] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:16:00.106471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb1bb2-0896-44ff-be3b-b3428f4d2b4e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:00.129481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb1bb2-0896-44ff-be3b-b3428f4d2b4e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:00.136151 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3346f7a-c4c4-42f5-b8d4-7f8cfce0b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:00.137691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3346f7a-c4c4-42f5-b8d4-7f8cfce0b539 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:00.138585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3346f7a-c4c4-42f5-b8d4-7f8cfce0b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:00.139100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3346f7a-c4c4-42f5-b8d4-7f8cfce0b539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:00.140123 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3346f7a-c4c4-42f5-b8d4-7f8cfce0b539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:00.142659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3346f7a-c4c4-42f5-b8d4-7f8cfce0b539 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:00.173270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 835/1681] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:16:00.177568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71843f27-52c6-46d2-8a0f-5acfe72055b7 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:00.193251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71843f27-52c6-46d2-8a0f-5acfe72055b7 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:00.200093 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd455b61-26e6-41f0-a8d3-a03536bfd90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:00.201032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd455b61-26e6-41f0-a8d3-a03536bfd90d admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:00.201533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd455b61-26e6-41f0-a8d3-a03536bfd90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:00.202187 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd455b61-26e6-41f0-a8d3-a03536bfd90d admin admin] PATH_INFO: `/v3/projects/76597078b87d4b888dddb78a993f2868/users/4f10a2df62974853bbcb1df93c20d2c0/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:00.223721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd455b61-26e6-41f0-a8d3-a03536bfd90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76597078b87d4b888dddb78a993f2868, user_id=4f10a2df62974853bbcb1df93c20d2c0, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:00.227164 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd455b61-26e6-41f0-a8d3-a03536bfd90d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:00.250686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 847/1682] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:00 2022] PUT /identity/v3/projects/76597078b87d4b888dddb78a993f2868/users/4f10a2df62974853bbcb1df93c20d2c0/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:00.261071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9485fea-c733-4c33-aa25-ec0c91b84779 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:00.261944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9485fea-c733-4c33-aa25-ec0c91b84779 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:00.262487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9485fea-c733-4c33-aa25-ec0c91b84779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:00.317259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd455b61-26e6-41f0-a8d3-a03536bfd90d admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:00.323592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-dd455b61-26e6-41f0-a8d3-a03536bfd90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:00.337138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-b9485fea-c733-4c33-aa25-ec0c91b84779 None None] MFA Rules not processed for user `4f10a2df62974853bbcb1df93c20d2c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:00.338729 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b9485fea-c733-4c33-aa25-ec0c91b84779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:00.361962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:00.534157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 836/1683] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:00.539367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985e14d-3362-4f60-9998-bd4095cd4d56 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:00.539927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985e14d-3362-4f60-9998-bd4095cd4d56 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:00.541610 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985e14d-3362-4f60-9998-bd4095cd4d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:00.575472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd455b61-26e6-41f0-a8d3-a03536bfd90d admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:00.584631 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:00.585757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:00.585896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:00.586325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] PATH_INFO: `/v3/projects/5f56e405a5b24c00a21c6153a95894c1` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:00.591660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f56e405a5b24c00a21c6153a95894c1)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:00.608789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:00.611779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:00.627000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-b985e14d-3362-4f60-9998-bd4095cd4d56 None None] MFA Rules not processed for user `30a43f66db08456fb272d7e13a1c9256`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:00.632347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b985e14d-3362-4f60-9998-bd4095cd4d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:00.753185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f56e405a5b24c00a21c6153a95894c1', 'request_id': 'req-517a35b5-767c-4504-9b76-a746bfd415c0'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:00.768074 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f56e405a5b24c00a21c6153a95894c1', 'request_id': 'req-517a35b5-767c-4504-9b76-a746bfd415c0'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:00.783873 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 837/1684] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:00.792232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985e14d-3362-4f60-9998-bd4095cd4d56 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:00.792324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f56e405a5b24c00a21c6153a95894c1', 'request_id': 'req-517a35b5-767c-4504-9b76-a746bfd415c0'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:00.817026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] The token cache is being invalidate because project 5f56e405a5b24c00a21c6153a95894c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:00.817026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:00.819917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:00.827508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985e14d-3362-4f60-9998-bd4095cd4d56 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:00.828705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 848/1685] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:00 2022] DELETE /identity/v3/projects/5f56e405a5b24c00a21c6153a95894c1 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:00.829871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:00.838954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:01.033527 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb6191-b2fe-4762-a526-86cf84bbdedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:01.034221 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb6191-b2fe-4762-a526-86cf84bbdedd admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:01.034504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb6191-b2fe-4762-a526-86cf84bbdedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:01.034775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb6191-b2fe-4762-a526-86cf84bbdedd admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:01.038070 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb6191-b2fe-4762-a526-86cf84bbdedd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:01.046203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb6191-b2fe-4762-a526-86cf84bbdedd admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:01.118266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 838/1686] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:00 2022] POST /identity/v3/projects => generated 367 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:01.118266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184738d-e580-4dfd-974c-672f16770f9c None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:01.118266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184738d-e580-4dfd-974c-672f16770f9c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:01.118266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184738d-e580-4dfd-974c-672f16770f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:01.131230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a35b5-767c-4504-9b76-a746bfd415c0 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:01.205261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-5184738d-e580-4dfd-974c-672f16770f9c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:01.210710 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-5184738d-e580-4dfd-974c-672f16770f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:01.262949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:01.388100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 839/1687] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:01.388100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184738d-e580-4dfd-974c-672f16770f9c None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:01.391849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-5184738d-e580-4dfd-974c-672f16770f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:01.427307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184738d-e580-4dfd-974c-672f16770f9c None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:01.442937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfe407-5033-4cde-a9e1-08c75ace8b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:01.443623 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfe407-5033-4cde-a9e1-08c75ace8b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:01.443903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfe407-5033-4cde-a9e1-08c75ace8b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:01.444169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfe407-5033-4cde-a9e1-08c75ace8b8b admin admin] PATH_INFO: `/v3/users/e764f5d718dc4620aafe3119c54b672c` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:01.448536 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfe407-5033-4cde-a9e1-08c75ace8b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e764f5d718dc4620aafe3119c54b672c)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:01.452513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfe407-5033-4cde-a9e1-08c75ace8b8b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:01.453071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca0498-37c5-474b-84d8-fbfca0189015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:01.453954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca0498-37c5-474b-84d8-fbfca0189015 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:01.454368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca0498-37c5-474b-84d8-fbfca0189015 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:01.454744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca0498-37c5-474b-84d8-fbfca0189015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:01.456874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-04ca0498-37c5-474b-84d8-fbfca0189015 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:01.566655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:01.613902 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-cdcfe407-5033-4cde-a9e1-08c75ace8b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e764f5d718dc4620aafe3119c54b672c'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:01.641029 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-cdcfe407-5033-4cde-a9e1-08c75ace8b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e764f5d718dc4620aafe3119c54b672c'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:01.641971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-cdcfe407-5033-4cde-a9e1-08c75ace8b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e764f5d718dc4620aafe3119c54b672c'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:01.650822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-cdcfe407-5033-4cde-a9e1-08c75ace8b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e764f5d718dc4620aafe3119c54b672c'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:01.695284 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-cdcfe407-5033-4cde-a9e1-08c75ace8b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e764f5d718dc4620aafe3119c54b672c'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:01.697472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca0498-37c5-474b-84d8-fbfca0189015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:01.699687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca0498-37c5-474b-84d8-fbfca0189015 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:01.710875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 840/1688] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:01 2022] DELETE /identity/v3/users/e764f5d718dc4620aafe3119c54b672c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:01.712137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d62232-49b6-48c2-b59a-25537c62e80c None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:01.712420 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d62232-49b6-48c2-b59a-25537c62e80c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:01.712690 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d62232-49b6-48c2-b59a-25537c62e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:01.715257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 849/1689] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 886 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:01.716500 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca0498-37c5-474b-84d8-fbfca0189015 service nova] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:01.719892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-04ca0498-37c5-474b-84d8-fbfca0189015 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:01.757031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca0498-37c5-474b-84d8-fbfca0189015 service nova] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:01.889885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-64d62232-49b6-48c2-b59a-25537c62e80c None None] MFA Rules not processed for user `cb42eefa189049d4bdaddd776eb735e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:01.891655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-64d62232-49b6-48c2-b59a-25537c62e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:02.035143 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1315c-648e-469d-aeca-4f5b0ffaf972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.037114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1315c-648e-469d-aeca-4f5b0ffaf972 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.038463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1315c-648e-469d-aeca-4f5b0ffaf972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.044850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1315c-648e-469d-aeca-4f5b0ffaf972 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.046651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1315c-648e-469d-aeca-4f5b0ffaf972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.053308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1315c-648e-469d-aeca-4f5b0ffaf972 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.131752 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 850/1690] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:01 2022] POST /identity/v3/users => generated 290 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:02.133267 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d8e45-baca-4b2c-819e-84029df4d39f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.134906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d8e45-baca-4b2c-819e-84029df4d39f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.136026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d8e45-baca-4b2c-819e-84029df4d39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.160365 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 841/1691] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:02.162842 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ca41-9257-430c-a145-65d425743ed1 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.163126 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ca41-9257-430c-a145-65d425743ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.163398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ca41-9257-430c-a145-65d425743ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.197970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-776d8e45-baca-4b2c-819e-84029df4d39f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:02.199562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-776d8e45-baca-4b2c-819e-84029df4d39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:02.238174 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-9ce3ca41-9257-430c-a145-65d425743ed1 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:02.244856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9ce3ca41-9257-430c-a145-65d425743ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:02.245550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 851/1692] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:02.251004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d8e45-baca-4b2c-819e-84029df4d39f None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.253448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-776d8e45-baca-4b2c-819e-84029df4d39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:02.278003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 842/1693] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:02.279247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3ca41-9257-430c-a145-65d425743ed1 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.281727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9ce3ca41-9257-430c-a145-65d425743ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:02.288262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d8e45-baca-4b2c-819e-84029df4d39f None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.301399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74927d9-8fa3-4668-83d9-8038a53fa130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.302153 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74927d9-8fa3-4668-83d9-8038a53fa130 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.302428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74927d9-8fa3-4668-83d9-8038a53fa130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.303260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74927d9-8fa3-4668-83d9-8038a53fa130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.303921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74927d9-8fa3-4668-83d9-8038a53fa130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.305579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74927d9-8fa3-4668-83d9-8038a53fa130 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.335961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 852/1694] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:02.344629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:02.345036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74927d9-8fa3-4668-83d9-8038a53fa130 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.368820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74927d9-8fa3-4668-83d9-8038a53fa130 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.385744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6dbc5-5027-4dd4-be4e-12d7a19a0016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.386383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6dbc5-5027-4dd4-be4e-12d7a19a0016 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.386662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6dbc5-5027-4dd4-be4e-12d7a19a0016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.387156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6dbc5-5027-4dd4-be4e-12d7a19a0016 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.387999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6dbc5-5027-4dd4-be4e-12d7a19a0016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:02.388301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6dbc5-5027-4dd4-be4e-12d7a19a0016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.389980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6dbc5-5027-4dd4-be4e-12d7a19a0016 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.448344 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 853/1695] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:02.451209 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6dbc5-5027-4dd4-be4e-12d7a19a0016 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.452294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-49d6dbc5-5027-4dd4-be4e-12d7a19a0016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:02.489659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3ca41-9257-430c-a145-65d425743ed1 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.503432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f43eb4-19cc-46a9-9fd2-719fe081e903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.504091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f43eb4-19cc-46a9-9fd2-719fe081e903 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.504384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f43eb4-19cc-46a9-9fd2-719fe081e903 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.504657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f43eb4-19cc-46a9-9fd2-719fe081e903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.528378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f43eb4-19cc-46a9-9fd2-719fe081e903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.530887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f43eb4-19cc-46a9-9fd2-719fe081e903 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.551091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 843/1696] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:02.552085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f43eb4-19cc-46a9-9fd2-719fe081e903 service nova] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.579239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f43eb4-19cc-46a9-9fd2-719fe081e903 service nova] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.594104 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c88b4a-534c-4832-8870-2bd229425db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.594940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c88b4a-534c-4832-8870-2bd229425db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.595218 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c88b4a-534c-4832-8870-2bd229425db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.597029 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c88b4a-534c-4832-8870-2bd229425db4 admin admin] PATH_INFO: `/v3/projects/9a8fcda3ee464d85946cd95ecc77ef49/users/ab8d0897192e456f983f0ebdf86d313b/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.626268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6dbc5-5027-4dd4-be4e-12d7a19a0016 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.631628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dce9d-c75e-4333-8f7d-19481d49363e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.632449 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dce9d-c75e-4333-8f7d-19481d49363e service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.633243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dce9d-c75e-4333-8f7d-19481d49363e service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.633697 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dce9d-c75e-4333-8f7d-19481d49363e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.637026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c88b4a-534c-4832-8870-2bd229425db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8fcda3ee464d85946cd95ecc77ef49, user_id=ab8d0897192e456f983f0ebdf86d313b, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.644527 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c88b4a-534c-4832-8870-2bd229425db4 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.651343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dce9d-c75e-4333-8f7d-19481d49363e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.653664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dce9d-c75e-4333-8f7d-19481d49363e service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.691156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 844/1697] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:02 2022] PUT /identity/v3/projects/9a8fcda3ee464d85946cd95ecc77ef49/users/ab8d0897192e456f983f0ebdf86d313b/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:02.692194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c88b4a-534c-4832-8870-2bd229425db4 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.699971 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 854/1698] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:02.702372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dce9d-c75e-4333-8f7d-19481d49363e service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.717150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dce9d-c75e-4333-8f7d-19481d49363e service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.754167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:02.844429 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272b245-565c-4c0b-9a61-cf916ea5a01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.845079 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272b245-565c-4c0b-9a61-cf916ea5a01f admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.845628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272b245-565c-4c0b-9a61-cf916ea5a01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.845628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272b245-565c-4c0b-9a61-cf916ea5a01f admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.850554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272b245-565c-4c0b-9a61-cf916ea5a01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.852221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272b245-565c-4c0b-9a61-cf916ea5a01f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.874775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 855/1699] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:02.882522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272b245-565c-4c0b-9a61-cf916ea5a01f admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.892487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c88b4a-534c-4832-8870-2bd229425db4 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.899002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272b245-565c-4c0b-9a61-cf916ea5a01f admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.914365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8905fd-2b89-47c3-baa5-2a364e46bd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.915134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8905fd-2b89-47c3-baa5-2a364e46bd36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.915415 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8905fd-2b89-47c3-baa5-2a364e46bd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.915924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8905fd-2b89-47c3-baa5-2a364e46bd36 admin admin] PATH_INFO: `/v3/projects/9a8fcda3ee464d85946cd95ecc77ef49/users/ab8d0897192e456f983f0ebdf86d313b/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.918686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8905fd-2b89-47c3-baa5-2a364e46bd36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8fcda3ee464d85946cd95ecc77ef49, user_id=ab8d0897192e456f983f0ebdf86d313b, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.923627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a92a5a-7a83-4436-847f-14d91f07f9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.924273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a92a5a-7a83-4436-847f-14d91f07f9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.924730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a92a5a-7a83-4436-847f-14d91f07f9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.924833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a92a5a-7a83-4436-847f-14d91f07f9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.925480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a92a5a-7a83-4436-847f-14d91f07f9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.929443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8905fd-2b89-47c3-baa5-2a364e46bd36 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.929605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a92a5a-7a83-4436-847f-14d91f07f9c5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.950553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 856/1700] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:02 2022] PUT /identity/v3/projects/9a8fcda3ee464d85946cd95ecc77ef49/users/ab8d0897192e456f983f0ebdf86d313b/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:02.961432 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0ee4-beae-4177-b11e-6829574ae8ac None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.961762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0ee4-beae-4177-b11e-6829574ae8ac None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.962558 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0ee4-beae-4177-b11e-6829574ae8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.995963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 845/1701] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:02 2022] POST /identity/v3/projects => generated 371 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:03.002877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a92a5a-7a83-4436-847f-14d91f07f9c5 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.071775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-3fec0ee4-beae-4177-b11e-6829574ae8ac None None] MFA Rules not processed for user `ab8d0897192e456f983f0ebdf86d313b`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:03.074023 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3fec0ee4-beae-4177-b11e-6829574ae8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:03.144426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a92a5a-7a83-4436-847f-14d91f07f9c5 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.151554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc2b34-4944-4f04-b93e-c220069a345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.153193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc2b34-4944-4f04-b93e-c220069a345b admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.153792 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc2b34-4944-4f04-b93e-c220069a345b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.154267 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc2b34-4944-4f04-b93e-c220069a345b admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.156061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc2b34-4944-4f04-b93e-c220069a345b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:03.159061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc2b34-4944-4f04-b93e-c220069a345b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:03.189702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:03.256121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 846/1702] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:02 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:03.262658 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc2b34-4944-4f04-b93e-c220069a345b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.299949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc2b34-4944-4f04-b93e-c220069a345b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.302350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 857/1703] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:03.313739 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce2655-5468-44f5-ba0a-1600954828e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.314738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce2655-5468-44f5-ba0a-1600954828e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.315240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce2655-5468-44f5-ba0a-1600954828e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.316292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce2655-5468-44f5-ba0a-1600954828e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.317296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce2655-5468-44f5-ba0a-1600954828e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:03.319519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce2655-5468-44f5-ba0a-1600954828e6 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:03.323867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec0ee4-beae-4177-b11e-6829574ae8ac None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.326591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3fec0ee4-beae-4177-b11e-6829574ae8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:03.351814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 847/1704] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:03.355703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce2655-5468-44f5-ba0a-1600954828e6 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.385595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce2655-5468-44f5-ba0a-1600954828e6 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.411258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54987912-53b6-4d81-94ce-f3ccb6773c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.414099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54987912-53b6-4d81-94ce-f3ccb6773c8b admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.415325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54987912-53b6-4d81-94ce-f3ccb6773c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.416133 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54987912-53b6-4d81-94ce-f3ccb6773c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.419235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54987912-53b6-4d81-94ce-f3ccb6773c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:03.424144 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54987912-53b6-4d81-94ce-f3ccb6773c8b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:03.465135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 848/1705] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:03.471870 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54987912-53b6-4d81-94ce-f3ccb6773c8b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.503251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec0ee4-beae-4177-b11e-6829574ae8ac None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.510341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54987912-53b6-4d81-94ce-f3ccb6773c8b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.523246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca1b25-6af3-4264-a923-cae4d2dda427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.523970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca1b25-6af3-4264-a923-cae4d2dda427 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.526221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c8f2a-da64-4389-ab7e-89a75f5987f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.526807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8f2a-da64-4389-ab7e-89a75f5987f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.527134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8f2a-da64-4389-ab7e-89a75f5987f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.527492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8f2a-da64-4389-ab7e-89a75f5987f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.528391 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca1b25-6af3-4264-a923-cae4d2dda427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.528752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca1b25-6af3-4264-a923-cae4d2dda427 admin admin] PATH_INFO: `/v3/projects/81d4f12b0cb94fcdb53c378fdf57c8cf/users/7748c086051b48079fff42e0e13f0e6b/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.554984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c8f2a-da64-4389-ab7e-89a75f5987f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:03.556397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c8f2a-da64-4389-ab7e-89a75f5987f1 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:03.558574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca1b25-6af3-4264-a923-cae4d2dda427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d4f12b0cb94fcdb53c378fdf57c8cf, user_id=7748c086051b48079fff42e0e13f0e6b, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:03.565607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca1b25-6af3-4264-a923-cae4d2dda427 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:03.587908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 858/1706] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:03.593686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 849/1707] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:03 2022] PUT /identity/v3/projects/81d4f12b0cb94fcdb53c378fdf57c8cf/users/7748c086051b48079fff42e0e13f0e6b/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:03.606768 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f834b8-7756-4709-be1d-af862cc04fd7 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.607215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f834b8-7756-4709-be1d-af862cc04fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.607494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f834b8-7756-4709-be1d-af862cc04fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.666235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca1b25-6af3-4264-a923-cae4d2dda427 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.669089 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-15ca1b25-6af3-4264-a923-cae4d2dda427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:03.677156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-55f834b8-7756-4709-be1d-af862cc04fd7 None None] MFA Rules not processed for user `7748c086051b48079fff42e0e13f0e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:03.678837 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-55f834b8-7756-4709-be1d-af862cc04fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:03.714289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:03.804914 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 859/1708] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:03.806139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f834b8-7756-4709-be1d-af862cc04fd7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.817484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-55f834b8-7756-4709-be1d-af862cc04fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:03.822673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca1b25-6af3-4264-a923-cae4d2dda427 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.833416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735ff07-c3b0-4309-bfaf-539226220f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.834072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735ff07-c3b0-4309-bfaf-539226220f2c service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.834349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735ff07-c3b0-4309-bfaf-539226220f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.834619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735ff07-c3b0-4309-bfaf-539226220f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.841514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b735ff07-c3b0-4309-bfaf-539226220f2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:03.999345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735ff07-c3b0-4309-bfaf-539226220f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.002852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735ff07-c3b0-4309-bfaf-539226220f2c service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.028999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f834b8-7756-4709-be1d-af862cc04fd7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.032547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 850/1709] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:16:04.057628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa85b3-fab8-423c-9720-8b76cbc7025f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:04.058865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa85b3-fab8-423c-9720-8b76cbc7025f service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.059344 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa85b3-fab8-423c-9720-8b76cbc7025f service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.059807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa85b3-fab8-423c-9720-8b76cbc7025f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.113517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa85b3-fab8-423c-9720-8b76cbc7025f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.115257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa85b3-fab8-423c-9720-8b76cbc7025f service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.136303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 860/1710] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:04.370561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244a492-6bfc-4fe5-83b4-7bfaab0bd283 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.371453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244a492-6bfc-4fe5-83b4-7bfaab0bd283 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.371453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244a492-6bfc-4fe5-83b4-7bfaab0bd283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.469721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-b244a492-6bfc-4fe5-83b4-7bfaab0bd283 None None] MFA Rules not processed for user `8b0b97cdcb0d4f2ea660bd04ae305f73`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:04.471563 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b244a492-6bfc-4fe5-83b4-7bfaab0bd283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:04.594518 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:04.616964 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 851/1711] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:04.628040 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78a9df-a298-4919-a9f9-fbf17cc150bd None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.628330 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78a9df-a298-4919-a9f9-fbf17cc150bd None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.628587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78a9df-a298-4919-a9f9-fbf17cc150bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.698529 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-de78a9df-a298-4919-a9f9-fbf17cc150bd None None] MFA Rules not processed for user `8b0b97cdcb0d4f2ea660bd04ae305f73`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:04.700003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-de78a9df-a298-4919-a9f9-fbf17cc150bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:04.724777 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 861/1712] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:04.737934 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244a492-6bfc-4fe5-83b4-7bfaab0bd283 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:04.756682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244a492-6bfc-4fe5-83b4-7bfaab0bd283 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.802261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a8ff2-a807-4d62-88b1-45ae9d4f51bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:04.803940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a8ff2-a807-4d62-88b1-45ae9d4f51bc service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.804202 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a8ff2-a807-4d62-88b1-45ae9d4f51bc service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.805082 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a8ff2-a807-4d62-88b1-45ae9d4f51bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.818772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a8ff2-a807-4d62-88b1-45ae9d4f51bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.821534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a8ff2-a807-4d62-88b1-45ae9d4f51bc service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.845543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 852/1713] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:16:04.957922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78a9df-a298-4919-a9f9-fbf17cc150bd None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:04.961435 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-de78a9df-a298-4919-a9f9-fbf17cc150bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:05.205174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78a9df-a298-4919-a9f9-fbf17cc150bd None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:05.219140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d0393-1427-4143-b91f-be079ff19910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:05.219817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d0393-1427-4143-b91f-be079ff19910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.220094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d0393-1427-4143-b91f-be079ff19910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.220368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d0393-1427-4143-b91f-be079ff19910 admin admin] PATH_INFO: `/v3/projects/b2bd740fd2724e289670f2b2701ec6c6` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.224781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d0393-1427-4143-b91f-be079ff19910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2bd740fd2724e289670f2b2701ec6c6)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:05.227181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d0393-1427-4143-b91f-be079ff19910 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:05.334666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:05.336223 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7c1d0393-1427-4143-b91f-be079ff19910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2bd740fd2724e289670f2b2701ec6c6', 'request_id': 'req-7c1d0393-1427-4143-b91f-be079ff19910'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:05.354895 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7c1d0393-1427-4143-b91f-be079ff19910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2bd740fd2724e289670f2b2701ec6c6', 'request_id': 'req-7c1d0393-1427-4143-b91f-be079ff19910'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:05.365283 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7c1d0393-1427-4143-b91f-be079ff19910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2bd740fd2724e289670f2b2701ec6c6', 'request_id': 'req-7c1d0393-1427-4143-b91f-be079ff19910'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:05.400563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7c1d0393-1427-4143-b91f-be079ff19910 admin admin] The token cache is being invalidate because project b2bd740fd2724e289670f2b2701ec6c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:05.400906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7c1d0393-1427-4143-b91f-be079ff19910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:05.402909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7c1d0393-1427-4143-b91f-be079ff19910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:05.408945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 862/1714] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:04 2022] DELETE /identity/v3/projects/b2bd740fd2724e289670f2b2701ec6c6 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:05.413721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a8ff2-a807-4d62-88b1-45ae9d4f51bc service nova] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:05.427392 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a8ff2-a807-4d62-88b1-45ae9d4f51bc service nova] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:05.539827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7131e4-77cf-4bf5-a162-a5292791777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:05.540526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7131e4-77cf-4bf5-a162-a5292791777b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.540798 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7131e4-77cf-4bf5-a162-a5292791777b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.541061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7131e4-77cf-4bf5-a162-a5292791777b admin admin] PATH_INFO: `/v3/users/1ab935aa5f41413cbe30a87d6e9beafa` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.542410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7131e4-77cf-4bf5-a162-a5292791777b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab935aa5f41413cbe30a87d6e9beafa)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:05.544688 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7131e4-77cf-4bf5-a162-a5292791777b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:05.577685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a7b83-1898-47e7-ac5d-d65f6b17fe30 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.578437 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a7b83-1898-47e7-ac5d-d65f6b17fe30 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.578910 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a7b83-1898-47e7-ac5d-d65f6b17fe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.653332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-3d9a7b83-1898-47e7-ac5d-d65f6b17fe30 None None] MFA Rules not processed for user `a899638fd4f44d738d98fed19c35babc`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:05.654955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3d9a7b83-1898-47e7-ac5d-d65f6b17fe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:05.699754 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6c7131e4-77cf-4bf5-a162-a5292791777b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab935aa5f41413cbe30a87d6e9beafa'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:05.719120 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6c7131e4-77cf-4bf5-a162-a5292791777b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab935aa5f41413cbe30a87d6e9beafa'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:05.720481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6c7131e4-77cf-4bf5-a162-a5292791777b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab935aa5f41413cbe30a87d6e9beafa'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:05.734244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6c7131e4-77cf-4bf5-a162-a5292791777b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab935aa5f41413cbe30a87d6e9beafa'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:05.751200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6c7131e4-77cf-4bf5-a162-a5292791777b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab935aa5f41413cbe30a87d6e9beafa'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:05.766807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 853/1715] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:05 2022] DELETE /identity/v3/users/1ab935aa5f41413cbe30a87d6e9beafa => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:05.766807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633f3fb-34c4-429c-ab50-be6457709d97 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.766807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633f3fb-34c4-429c-ab50-be6457709d97 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.766807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633f3fb-34c4-429c-ab50-be6457709d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.828232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 863/1716] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:05.837071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c3caf-79f4-4f64-8b5e-e47eaca1ca1a None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.837071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c3caf-79f4-4f64-8b5e-e47eaca1ca1a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.837071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c3caf-79f4-4f64-8b5e-e47eaca1ca1a None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.837071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 864/1717] 10.222.0.60 () {54 vars in 912 bytes} [Wed Aug 31 00:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:05.841611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18460212-fee4-4ada-bbdb-41db5a2e1e54 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.842769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18460212-fee4-4ada-bbdb-41db5a2e1e54 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.843921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7633f3fb-34c4-429c-ab50-be6457709d97 None None] MFA Rules not processed for user `eee58b02fef045a3b7d7a53cf8c4d140`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:05.845719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7633f3fb-34c4-429c-ab50-be6457709d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:05.846534 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18460212-fee4-4ada-bbdb-41db5a2e1e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.983294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-18460212-fee4-4ada-bbdb-41db5a2e1e54 None None] MFA Rules not processed for user `d4f2b852544b450a86fdcb5fa18fd290`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:05.984635 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-18460212-fee4-4ada-bbdb-41db5a2e1e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:06.004066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:06.061461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 854/1718] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:05 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:06.063465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633f3fb-34c4-429c-ab50-be6457709d97 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:06.067483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7633f3fb-34c4-429c-ab50-be6457709d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:06.178391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 865/1719] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:16:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:06.354252 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633f3fb-34c4-429c-ab50-be6457709d97 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:06.368172 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573e5f2-9d63-4844-82d1-0412b9374116 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:06.368822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573e5f2-9d63-4844-82d1-0412b9374116 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:06.369098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573e5f2-9d63-4844-82d1-0412b9374116 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:06.369398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573e5f2-9d63-4844-82d1-0412b9374116 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:06.554985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573e5f2-9d63-4844-82d1-0412b9374116 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:06.556660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573e5f2-9d63-4844-82d1-0412b9374116 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:06.578561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 855/1720] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:06.770412 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18460212-fee4-4ada-bbdb-41db5a2e1e54 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:06.772762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-18460212-fee4-4ada-bbdb-41db5a2e1e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:06.791825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18460212-fee4-4ada-bbdb-41db5a2e1e54 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:06.809623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223622d7-680e-4dae-a389-7c487e3cebe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:06.812171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223622d7-680e-4dae-a389-7c487e3cebe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:06.813649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223622d7-680e-4dae-a389-7c487e3cebe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:06.814217 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223622d7-680e-4dae-a389-7c487e3cebe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:06.878821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223622d7-680e-4dae-a389-7c487e3cebe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:06.881665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223622d7-680e-4dae-a389-7c487e3cebe6 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:06.934038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 866/1721] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:16:07.719925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573e5f2-9d63-4844-82d1-0412b9374116 service nova] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:07.722011 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a573e5f2-9d63-4844-82d1-0412b9374116 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:08.010089 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573e5f2-9d63-4844-82d1-0412b9374116 service nova] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:08.017496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50491e6-1dd4-4edf-b520-b00ee300f586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:08.018421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50491e6-1dd4-4edf-b520-b00ee300f586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.018872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50491e6-1dd4-4edf-b520-b00ee300f586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.019288 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50491e6-1dd4-4edf-b520-b00ee300f586 admin admin] PATH_INFO: `/v3/projects/795dbc964aff45759c8a892b50ca9457` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.020774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50491e6-1dd4-4edf-b520-b00ee300f586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=795dbc964aff45759c8a892b50ca9457)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:08.023843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50491e6-1dd4-4edf-b520-b00ee300f586 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:08.073061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:08.117475 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b50491e6-1dd4-4edf-b520-b00ee300f586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795dbc964aff45759c8a892b50ca9457', 'request_id': 'req-b50491e6-1dd4-4edf-b520-b00ee300f586'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:08.130707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223622d7-680e-4dae-a389-7c487e3cebe6 service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:08.132126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-223622d7-680e-4dae-a389-7c487e3cebe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:08.145519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b50491e6-1dd4-4edf-b520-b00ee300f586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795dbc964aff45759c8a892b50ca9457', 'request_id': 'req-b50491e6-1dd4-4edf-b520-b00ee300f586'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:08.172484 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b50491e6-1dd4-4edf-b520-b00ee300f586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795dbc964aff45759c8a892b50ca9457', 'request_id': 'req-b50491e6-1dd4-4edf-b520-b00ee300f586'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:08.192704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b50491e6-1dd4-4edf-b520-b00ee300f586 admin admin] The token cache is being invalidate because project 795dbc964aff45759c8a892b50ca9457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:08.193137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b50491e6-1dd4-4edf-b520-b00ee300f586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:08.194190 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b50491e6-1dd4-4edf-b520-b00ee300f586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:08.203939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 856/1722] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:07 2022] DELETE /identity/v3/projects/795dbc964aff45759c8a892b50ca9457 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:08.206911 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a379d-8c43-404a-8086-f82a9256b6b1 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.207312 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a379d-8c43-404a-8086-f82a9256b6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.207692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a379d-8c43-404a-8086-f82a9256b6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.228363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:08.251628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-ca5a379d-8c43-404a-8086-f82a9256b6b1 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:08.253230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ca5a379d-8c43-404a-8086-f82a9256b6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:08.258294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223622d7-680e-4dae-a389-7c487e3cebe6 service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:08.348786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406ca18-9327-4a19-b9a8-5959089fc31e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227f958b82a446e19a4d5b29d74193bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:08.349501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406ca18-9327-4a19-b9a8-5959089fc31e service placement] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.349869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406ca18-9327-4a19-b9a8-5959089fc31e service placement] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.350226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406ca18-9327-4a19-b9a8-5959089fc31e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.352140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a406ca18-9327-4a19-b9a8-5959089fc31e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:08.364533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406ca18-9327-4a19-b9a8-5959089fc31e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:08.366601 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406ca18-9327-4a19-b9a8-5959089fc31e service placement] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:08.379483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 867/1723] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:16:08.470324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 857/1724] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:08.470519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406ca18-9327-4a19-b9a8-5959089fc31e service placement] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:08.470519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a406ca18-9327-4a19-b9a8-5959089fc31e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:08.472020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d3b36-ebfa-4f0a-bc8c-5fba3999e0a2 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.472310 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d3b36-ebfa-4f0a-bc8c-5fba3999e0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.472582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d3b36-ebfa-4f0a-bc8c-5fba3999e0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.494589 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406ca18-9327-4a19-b9a8-5959089fc31e service placement] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:08.510454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea10c99-a58c-4cd6-96c4-b4040a99d3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:08.511117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea10c99-a58c-4cd6-96c4-b4040a99d3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.511409 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea10c99-a58c-4cd6-96c4-b4040a99d3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.511720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea10c99-a58c-4cd6-96c4-b4040a99d3f3 admin admin] PATH_INFO: `/v3/users/7748c086051b48079fff42e0e13f0e6b` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.514005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea10c99-a58c-4cd6-96c4-b4040a99d3f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7748c086051b48079fff42e0e13f0e6b)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:08.516288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea10c99-a58c-4cd6-96c4-b4040a99d3f3 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:08.533678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c27d3b36-ebfa-4f0a-bc8c-5fba3999e0a2 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:08.539261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c27d3b36-ebfa-4f0a-bc8c-5fba3999e0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:08.573702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 858/1725] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:08.578032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d3b36-ebfa-4f0a-bc8c-5fba3999e0a2 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:08.601063 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d3b36-ebfa-4f0a-bc8c-5fba3999e0a2 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:08.629385 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16706b35-2358-46c9-b094-3f9b12db7135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:08.630408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16706b35-2358-46c9-b094-3f9b12db7135 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.631728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16706b35-2358-46c9-b094-3f9b12db7135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.632620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16706b35-2358-46c9-b094-3f9b12db7135 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.634052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16706b35-2358-46c9-b094-3f9b12db7135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:08.641632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16706b35-2358-46c9-b094-3f9b12db7135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:08.647392 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16706b35-2358-46c9-b094-3f9b12db7135 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:08.666333 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2ea10c99-a58c-4cd6-96c4-b4040a99d3f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7748c086051b48079fff42e0e13f0e6b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:08.705031 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 859/1726] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:08.712501 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16706b35-2358-46c9-b094-3f9b12db7135 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:08.727935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2ea10c99-a58c-4cd6-96c4-b4040a99d3f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7748c086051b48079fff42e0e13f0e6b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:08.732161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2ea10c99-a58c-4cd6-96c4-b4040a99d3f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7748c086051b48079fff42e0e13f0e6b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:08.734876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2ea10c99-a58c-4cd6-96c4-b4040a99d3f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7748c086051b48079fff42e0e13f0e6b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:08.736423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16706b35-2358-46c9-b094-3f9b12db7135 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:08.742210 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4be61-4174-45b6-9ba3-b824dcec7d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:08.743331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4be61-4174-45b6-9ba3-b824dcec7d8c admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.743802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4be61-4174-45b6-9ba3-b824dcec7d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.744235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4be61-4174-45b6-9ba3-b824dcec7d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.747339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4be61-4174-45b6-9ba3-b824dcec7d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:08.749659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4be61-4174-45b6-9ba3-b824dcec7d8c admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:08.770978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2ea10c99-a58c-4cd6-96c4-b4040a99d3f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7748c086051b48079fff42e0e13f0e6b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:08.832051 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 868/1727] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:08 2022] DELETE /identity/v3/users/7748c086051b48079fff42e0e13f0e6b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:08.837878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e957cc-10bb-4563-8e8b-3a2e44e8a2b9 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.838385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e957cc-10bb-4563-8e8b-3a2e44e8a2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.845587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e957cc-10bb-4563-8e8b-3a2e44e8a2b9 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.847659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 869/1728] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:16:08 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:08.849360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dc99a-220a-4225-87b3-3173cf74761c None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.855793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dc99a-220a-4225-87b3-3173cf74761c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.856450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dc99a-220a-4225-87b3-3173cf74761c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.865723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 860/1729] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:08 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:08.872917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4be61-4174-45b6-9ba3-b824dcec7d8c admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:08.874989 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-10a4be61-4174-45b6-9ba3-b824dcec7d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:08.929484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-cd8dc99a-220a-4225-87b3-3173cf74761c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:08.934631 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-cd8dc99a-220a-4225-87b3-3173cf74761c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:09.147391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:09.187455 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4be61-4174-45b6-9ba3-b824dcec7d8c admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.189309 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 870/1730] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:09.194758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1311c-002d-4ba8-86f2-888fbb47dc3e None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.195508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1311c-002d-4ba8-86f2-888fbb47dc3e None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.198669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1311c-002d-4ba8-86f2-888fbb47dc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.204611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788afee-1b63-478b-bdf6-17bb24372f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.207309 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788afee-1b63-478b-bdf6-17bb24372f70 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.208487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788afee-1b63-478b-bdf6-17bb24372f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.209422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788afee-1b63-478b-bdf6-17bb24372f70 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.211634 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788afee-1b63-478b-bdf6-17bb24372f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.219479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788afee-1b63-478b-bdf6-17bb24372f70 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.265758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-42f1311c-002d-4ba8-86f2-888fbb47dc3e None None] MFA Rules not processed for user `227f958b82a446e19a4d5b29d74193bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:09.269009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-42f1311c-002d-4ba8-86f2-888fbb47dc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:09.277138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:09.286548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 861/1731] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:08 2022] POST /identity/v3/users => generated 283 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:09.290375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788afee-1b63-478b-bdf6-17bb24372f70 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:09.303426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9788afee-1b63-478b-bdf6-17bb24372f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:09.472463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788afee-1b63-478b-bdf6-17bb24372f70 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.480237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030956b-c69c-41d1-a3b2-091291477279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.481175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030956b-c69c-41d1-a3b2-091291477279 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.481783 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030956b-c69c-41d1-a3b2-091291477279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.482261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030956b-c69c-41d1-a3b2-091291477279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.494577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 871/1732] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:16:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:09.495619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1311c-002d-4ba8-86f2-888fbb47dc3e None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:09.511342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1311c-002d-4ba8-86f2-888fbb47dc3e None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.515107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030956b-c69c-41d1-a3b2-091291477279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.524481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030956b-c69c-41d1-a3b2-091291477279 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.525951 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8673630-44b8-46bf-8b1e-47f0390b0da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.526756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8673630-44b8-46bf-8b1e-47f0390b0da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.527301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8673630-44b8-46bf-8b1e-47f0390b0da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.527730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8673630-44b8-46bf-8b1e-47f0390b0da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.529546 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8673630-44b8-46bf-8b1e-47f0390b0da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.531343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8673630-44b8-46bf-8b1e-47f0390b0da8 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.560511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 862/1733] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:09.564791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38a574-4f78-413b-9be3-1aa25481a5be None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.566049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38a574-4f78-413b-9be3-1aa25481a5be None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.567327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38a574-4f78-413b-9be3-1aa25481a5be None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.571697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 863/1734] 10.222.0.60 () {54 vars in 961 bytes} [Wed Aug 31 00:16:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:09.577260 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38a574-4f78-413b-9be3-1aa25481a5be None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:09.577743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 872/1735] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:09.579272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd714-f1d1-4c3c-9eaf-e076c526a454 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.581511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd714-f1d1-4c3c-9eaf-e076c526a454 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.581977 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd714-f1d1-4c3c-9eaf-e076c526a454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.624628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38a574-4f78-413b-9be3-1aa25481a5be None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.630686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-b26bd714-f1d1-4c3c-9eaf-e076c526a454 None None] MFA Rules not processed for user `227f958b82a446e19a4d5b29d74193bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:09.636170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b26bd714-f1d1-4c3c-9eaf-e076c526a454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:09.645427 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d179003-e1f4-453f-b816-60d2f5364137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.646546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d179003-e1f4-453f-b816-60d2f5364137 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.647532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d179003-e1f4-453f-b816-60d2f5364137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.647951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d179003-e1f4-453f-b816-60d2f5364137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.648615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d179003-e1f4-453f-b816-60d2f5364137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.652817 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d179003-e1f4-453f-b816-60d2f5364137 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.659102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 873/1736] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Aug 31 00:16:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:09.671585 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd714-f1d1-4c3c-9eaf-e076c526a454 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:09.683272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd714-f1d1-4c3c-9eaf-e076c526a454 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.693638 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 864/1737] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:09.700024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d179003-e1f4-453f-b816-60d2f5364137 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:09.701122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b700792-6910-463a-ac3d-b8aed04ca041 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227f958b82a446e19a4d5b29d74193bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.701968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b700792-6910-463a-ac3d-b8aed04ca041 service placement] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.702406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b700792-6910-463a-ac3d-b8aed04ca041 service placement] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.702854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b700792-6910-463a-ac3d-b8aed04ca041 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.712841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d179003-e1f4-453f-b816-60d2f5364137 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.724379 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b700792-6910-463a-ac3d-b8aed04ca041 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.726424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b700792-6910-463a-ac3d-b8aed04ca041 service placement] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.731681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af18d4-a0e1-4364-af04-83913988a569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.732383 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af18d4-a0e1-4364-af04-83913988a569 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.732682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af18d4-a0e1-4364-af04-83913988a569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.733018 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af18d4-a0e1-4364-af04-83913988a569 admin admin] PATH_INFO: `/v3/projects/f0cd174cbf4749d38d4e5c2de3d6337e/users/cd205ad646f14fbf8eecc60ef487c9dd/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.747268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 874/1738] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:09.792433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b700792-6910-463a-ac3d-b8aed04ca041 service placement] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:09.794759 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8b700792-6910-463a-ac3d-b8aed04ca041 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:09.795624 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af18d4-a0e1-4364-af04-83913988a569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cd174cbf4749d38d4e5c2de3d6337e, user_id=cd205ad646f14fbf8eecc60ef487c9dd, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.801191 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af18d4-a0e1-4364-af04-83913988a569 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.830559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b700792-6910-463a-ac3d-b8aed04ca041 service placement] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.836075 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 865/1739] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:09 2022] PUT /identity/v3/projects/f0cd174cbf4749d38d4e5c2de3d6337e/users/cd205ad646f14fbf8eecc60ef487c9dd/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:09.837973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb5cbd-e962-4bfc-8918-c38d5ab5332d None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.838257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb5cbd-e962-4bfc-8918-c38d5ab5332d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.839198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb5cbd-e962-4bfc-8918-c38d5ab5332d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.944712 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-30eb5cbd-e962-4bfc-8918-c38d5ab5332d None None] MFA Rules not processed for user `cd205ad646f14fbf8eecc60ef487c9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:09.946513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-30eb5cbd-e962-4bfc-8918-c38d5ab5332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:09.973621 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30889a-47ec-4160-9567-8528ee523c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.974584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30889a-47ec-4160-9567-8528ee523c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.974703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30889a-47ec-4160-9567-8528ee523c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.974963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30889a-47ec-4160-9567-8528ee523c38 admin admin] PATH_INFO: `/v3/users/4f10a2df62974853bbcb1df93c20d2c0` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.976926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30889a-47ec-4160-9567-8528ee523c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f10a2df62974853bbcb1df93c20d2c0)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.979758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30889a-47ec-4160-9567-8528ee523c38 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.112426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 866/1740] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:10.118718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb5cbd-e962-4bfc-8918-c38d5ab5332d None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.120919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-9f30889a-47ec-4160-9567-8528ee523c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f10a2df62974853bbcb1df93c20d2c0'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:10.139325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb5cbd-e962-4bfc-8918-c38d5ab5332d None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.156509 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5577167-68ee-487b-892e-2009ef049b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.160795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5577167-68ee-487b-892e-2009ef049b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.161604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5577167-68ee-487b-892e-2009ef049b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.162125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5577167-68ee-487b-892e-2009ef049b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.164293 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5577167-68ee-487b-892e-2009ef049b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:10.170214 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5577167-68ee-487b-892e-2009ef049b54 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.170882 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:10.175039 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-9f30889a-47ec-4160-9567-8528ee523c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f10a2df62974853bbcb1df93c20d2c0'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:10.176338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-9f30889a-47ec-4160-9567-8528ee523c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f10a2df62974853bbcb1df93c20d2c0'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:10.177110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-9f30889a-47ec-4160-9567-8528ee523c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f10a2df62974853bbcb1df93c20d2c0'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:10.218653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-9f30889a-47ec-4160-9567-8528ee523c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f10a2df62974853bbcb1df93c20d2c0'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:10.241765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 875/1741] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:09 2022] DELETE /identity/v3/users/4f10a2df62974853bbcb1df93c20d2c0 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:10.249379 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f61ca-ba08-45ec-99ad-a6dd6644c314 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.249960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f61ca-ba08-45ec-99ad-a6dd6644c314 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.250433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f61ca-ba08-45ec-99ad-a6dd6644c314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.253241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 867/1742] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:10 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:10.256743 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5577167-68ee-487b-892e-2009ef049b54 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.260465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a5577167-68ee-487b-892e-2009ef049b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:10.282884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-126f61ca-ba08-45ec-99ad-a6dd6644c314 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:10.284579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-126f61ca-ba08-45ec-99ad-a6dd6644c314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:10.323772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:10.366751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5577167-68ee-487b-892e-2009ef049b54 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.373425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364106a4-7142-42bf-a984-fa0b160e14e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.374279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364106a4-7142-42bf-a984-fa0b160e14e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.374557 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364106a4-7142-42bf-a984-fa0b160e14e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.374839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364106a4-7142-42bf-a984-fa0b160e14e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.375571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364106a4-7142-42bf-a984-fa0b160e14e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:10.378070 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364106a4-7142-42bf-a984-fa0b160e14e7 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.445251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 868/1743] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:10 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:10.451880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364106a4-7142-42bf-a984-fa0b160e14e7 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.469673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364106a4-7142-42bf-a984-fa0b160e14e7 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.479492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90169cb-d912-4f02-9060-be3e0c639217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.480761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90169cb-d912-4f02-9060-be3e0c639217 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.481381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90169cb-d912-4f02-9060-be3e0c639217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.481827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90169cb-d912-4f02-9060-be3e0c639217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.482804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90169cb-d912-4f02-9060-be3e0c639217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:10.485015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90169cb-d912-4f02-9060-be3e0c639217 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.494848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 876/1744] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:10.522550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e247e82-2a28-478d-b54f-dc8be91a4fee None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.522832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e247e82-2a28-478d-b54f-dc8be91a4fee None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.523107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e247e82-2a28-478d-b54f-dc8be91a4fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.552081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 869/1745] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:10.556122 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90169cb-d912-4f02-9060-be3e0c639217 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.562857 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-1e247e82-2a28-478d-b54f-dc8be91a4fee None None] MFA Rules not processed for user `30a43f66db08456fb272d7e13a1c9256`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:10.564400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1e247e82-2a28-478d-b54f-dc8be91a4fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:10.590701 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90169cb-d912-4f02-9060-be3e0c639217 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.604827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff01e3-f398-4895-8dbd-7a94aa4b3ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.607079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff01e3-f398-4895-8dbd-7a94aa4b3ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.607486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff01e3-f398-4895-8dbd-7a94aa4b3ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.609423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff01e3-f398-4895-8dbd-7a94aa4b3ec1 admin admin] PATH_INFO: `/v3/projects/4891670c5e6042d79582bb31eefb869b/users/e1d065ad0b2f4c0aae34ef83ac81e4bd/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.657013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff01e3-f398-4895-8dbd-7a94aa4b3ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4891670c5e6042d79582bb31eefb869b, user_id=e1d065ad0b2f4c0aae34ef83ac81e4bd, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:10.668836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff01e3-f398-4895-8dbd-7a94aa4b3ec1 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.685275 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 877/1746] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:10.702269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e247e82-2a28-478d-b54f-dc8be91a4fee None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.710128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1e247e82-2a28-478d-b54f-dc8be91a4fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:10.719083 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 870/1747] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:10 2022] PUT /identity/v3/projects/4891670c5e6042d79582bb31eefb869b/users/e1d065ad0b2f4c0aae34ef83ac81e4bd/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:10.722949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff01e3-f398-4895-8dbd-7a94aa4b3ec1 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.882370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff01e3-f398-4895-8dbd-7a94aa4b3ec1 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.889004 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf23b11-f20f-4c55-b6cf-b2f258ccfd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.889675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf23b11-f20f-4c55-b6cf-b2f258ccfd52 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.889956 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf23b11-f20f-4c55-b6cf-b2f258ccfd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.890225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf23b11-f20f-4c55-b6cf-b2f258ccfd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.890930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf23b11-f20f-4c55-b6cf-b2f258ccfd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:10.893171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf23b11-f20f-4c55-b6cf-b2f258ccfd52 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.902572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e247e82-2a28-478d-b54f-dc8be91a4fee None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.914782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 871/1748] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:10.926281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf23b11-f20f-4c55-b6cf-b2f258ccfd52 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.931542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-5bf23b11-f20f-4c55-b6cf-b2f258ccfd52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:10.990486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf23b11-f20f-4c55-b6cf-b2f258ccfd52 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.007913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:11.015721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.016612 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.016987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.017396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] PATH_INFO: `/v3/users/f71879bcda694171823b8a3ee8d08285` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.019113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71879bcda694171823b8a3ee8d08285)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.027494 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.081900 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2250-529f-498d-9cc9-3119200ef8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.082536 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2250-529f-498d-9cc9-3119200ef8fa service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.082807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2250-529f-498d-9cc9-3119200ef8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.083526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2250-529f-498d-9cc9-3119200ef8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.104081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b2250-529f-498d-9cc9-3119200ef8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.120716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b2250-529f-498d-9cc9-3119200ef8fa service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.141789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 878/1749] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:11.143439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71879bcda694171823b8a3ee8d08285'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:11.155746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2250-529f-498d-9cc9-3119200ef8fa service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.156939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71879bcda694171823b8a3ee8d08285'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:11.157761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71879bcda694171823b8a3ee8d08285'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:11.173761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71879bcda694171823b8a3ee8d08285'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:11.180863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2250-529f-498d-9cc9-3119200ef8fa service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.201504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ada2ca-0c1b-4581-a498-6a77f3a949a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.202178 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada2ca-0c1b-4581-a498-6a77f3a949a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.203754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada2ca-0c1b-4581-a498-6a77f3a949a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.204278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada2ca-0c1b-4581-a498-6a77f3a949a7 admin admin] PATH_INFO: `/v3/projects/4891670c5e6042d79582bb31eefb869b/users/e1d065ad0b2f4c0aae34ef83ac81e4bd/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.210937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ada2ca-0c1b-4581-a498-6a77f3a949a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4891670c5e6042d79582bb31eefb869b, user_id=e1d065ad0b2f4c0aae34ef83ac81e4bd, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.211857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71879bcda694171823b8a3ee8d08285'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:11.215580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:11.219296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ada2ca-0c1b-4581-a498-6a77f3a949a7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.225141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 872/1750] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:10 2022] DELETE /identity/v3/users/f71879bcda694171823b8a3ee8d08285 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:11.226331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.228330 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:11.241250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 879/1751] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:11 2022] PUT /identity/v3/projects/4891670c5e6042d79582bb31eefb869b/users/e1d065ad0b2f4c0aae34ef83ac81e4bd/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:11.248999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c011ad-8e70-4961-8516-664be9a219ca None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.249523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c011ad-8e70-4961-8516-664be9a219ca None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.250524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c011ad-8e70-4961-8516-664be9a219ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.348924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091f063-eb62-4251-bf1d-d858124fbb1f admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.349146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-b1c011ad-8e70-4961-8516-664be9a219ca None None] MFA Rules not processed for user `e1d065ad0b2f4c0aae34ef83ac81e4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:11.350265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b1c011ad-8e70-4961-8516-664be9a219ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:11.508286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 880/1752] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:11.509813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47073ca-fce4-465a-9c35-b758280fa568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.510708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47073ca-fce4-465a-9c35-b758280fa568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.511194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47073ca-fce4-465a-9c35-b758280fa568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.511895 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47073ca-fce4-465a-9c35-b758280fa568 admin admin] PATH_INFO: `/v3/projects/81d4f12b0cb94fcdb53c378fdf57c8cf` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.513470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47073ca-fce4-465a-9c35-b758280fa568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d4f12b0cb94fcdb53c378fdf57c8cf)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.516654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47073ca-fce4-465a-9c35-b758280fa568 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.520281 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c011ad-8e70-4961-8516-664be9a219ca None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.523045 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b1c011ad-8e70-4961-8516-664be9a219ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:11.614614 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c011ad-8e70-4961-8516-664be9a219ca None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.621418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a47073ca-fce4-465a-9c35-b758280fa568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d4f12b0cb94fcdb53c378fdf57c8cf', 'request_id': 'req-a47073ca-fce4-465a-9c35-b758280fa568'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:11.638702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a47073ca-fce4-465a-9c35-b758280fa568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d4f12b0cb94fcdb53c378fdf57c8cf', 'request_id': 'req-a47073ca-fce4-465a-9c35-b758280fa568'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:11.661583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a47073ca-fce4-465a-9c35-b758280fa568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d4f12b0cb94fcdb53c378fdf57c8cf', 'request_id': 'req-a47073ca-fce4-465a-9c35-b758280fa568'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:11.709768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a47073ca-fce4-465a-9c35-b758280fa568 admin admin] The token cache is being invalidate because project 81d4f12b0cb94fcdb53c378fdf57c8cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:11.710450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a47073ca-fce4-465a-9c35-b758280fa568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:11.713147 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a47073ca-fce4-465a-9c35-b758280fa568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:11.716738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 873/1753] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:11 2022] DELETE /identity/v3/projects/81d4f12b0cb94fcdb53c378fdf57c8cf => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:11.723885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f815-48e1-45ed-8fa9-72c8ffcb9416 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.724651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f815-48e1-45ed-8fa9-72c8ffcb9416 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.725014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f815-48e1-45ed-8fa9-72c8ffcb9416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.745774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9974685-927b-4a0c-9272-03b44bba8cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.748349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9974685-927b-4a0c-9272-03b44bba8cfb service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.749153 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9974685-927b-4a0c-9272-03b44bba8cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.750862 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9974685-927b-4a0c-9272-03b44bba8cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.755907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c9974685-927b-4a0c-9272-03b44bba8cfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:11.785892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-0839f815-48e1-45ed-8fa9-72c8ffcb9416 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:11.789322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0839f815-48e1-45ed-8fa9-72c8ffcb9416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:11.840585 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:11.863973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:11.926045 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9974685-927b-4a0c-9272-03b44bba8cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.928221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9974685-927b-4a0c-9272-03b44bba8cfb service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.947235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 874/1754] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:11.947235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839f815-48e1-45ed-8fa9-72c8ffcb9416 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.947235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0839f815-48e1-45ed-8fa9-72c8ffcb9416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:11.956762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 881/1755] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:16:11.958242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331439de-e6e3-4c1e-ae7a-472901f48d2c None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.958529 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331439de-e6e3-4c1e-ae7a-472901f48d2c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.958789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331439de-e6e3-4c1e-ae7a-472901f48d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.988739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-331439de-e6e3-4c1e-ae7a-472901f48d2c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:11.990403 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-331439de-e6e3-4c1e-ae7a-472901f48d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:11.998495 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839f815-48e1-45ed-8fa9-72c8ffcb9416 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.002146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 882/1756] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:12.011387 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331439de-e6e3-4c1e-ae7a-472901f48d2c None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.018615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331439de-e6e3-4c1e-ae7a-472901f48d2c None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.020708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.024095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7805d2-446a-486c-af51-4dd87e39d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.024552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.024883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7805d2-446a-486c-af51-4dd87e39d07a admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.025167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7805d2-446a-486c-af51-4dd87e39d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.025589 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7805d2-446a-486c-af51-4dd87e39d07a admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.025875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.026457 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7805d2-446a-486c-af51-4dd87e39d07a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:12.026895 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7805d2-446a-486c-af51-4dd87e39d07a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.028773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] PATH_INFO: `/v3/projects/cf213afa28974d20b489514343439b87` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.028991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7805d2-446a-486c-af51-4dd87e39d07a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.036736 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf213afa28974d20b489514343439b87)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.048386 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 883/1757] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:12.048558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.050276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7805d2-446a-486c-af51-4dd87e39d07a admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.077297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7805d2-446a-486c-af51-4dd87e39d07a admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.100167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca8c7f-6d2d-449d-b2ee-3951faebc8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.100853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca8c7f-6d2d-449d-b2ee-3951faebc8ce admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.101399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca8c7f-6d2d-449d-b2ee-3951faebc8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.101691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca8c7f-6d2d-449d-b2ee-3951faebc8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.102338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca8c7f-6d2d-449d-b2ee-3951faebc8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.106147 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca8c7f-6d2d-449d-b2ee-3951faebc8ce admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.145678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 884/1758] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:12 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:12.151103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca8c7f-6d2d-449d-b2ee-3951faebc8ce admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.161127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-52ca8c7f-6d2d-449d-b2ee-3951faebc8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:12.191692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf213afa28974d20b489514343439b87', 'request_id': 'req-b8b7724c-5ad7-4601-9ded-f90084dd772b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:12.207948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf213afa28974d20b489514343439b87', 'request_id': 'req-b8b7724c-5ad7-4601-9ded-f90084dd772b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:12.226928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf213afa28974d20b489514343439b87', 'request_id': 'req-b8b7724c-5ad7-4601-9ded-f90084dd772b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:12.241195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] The token cache is being invalidate because project cf213afa28974d20b489514343439b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:12.241613 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:12.242768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:12.244944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 875/1759] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:11 2022] DELETE /identity/v3/projects/cf213afa28974d20b489514343439b87 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:12.246095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.247811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:12.351213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca8c7f-6d2d-449d-b2ee-3951faebc8ce admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.361380 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7724c-5ad7-4601-9ded-f90084dd772b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.366591 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42af13-ea8f-41e5-9b5d-f48666a67198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.367514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42af13-ea8f-41e5-9b5d-f48666a67198 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.367962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42af13-ea8f-41e5-9b5d-f48666a67198 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.368258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42af13-ea8f-41e5-9b5d-f48666a67198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.370761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-bf42af13-ea8f-41e5-9b5d-f48666a67198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:12.460948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.461636 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.462556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.462835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] PATH_INFO: `/v3/projects/76597078b87d4b888dddb78a993f2868` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.467089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76597078b87d4b888dddb78a993f2868)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.470032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.522402 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42af13-ea8f-41e5-9b5d-f48666a67198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.529750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42af13-ea8f-41e5-9b5d-f48666a67198 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.570685 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 876/1760] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:12.574262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42af13-ea8f-41e5-9b5d-f48666a67198 service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.581025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-bf42af13-ea8f-41e5-9b5d-f48666a67198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:12.599301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:12.618828 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42af13-ea8f-41e5-9b5d-f48666a67198 service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.641921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76597078b87d4b888dddb78a993f2868', 'request_id': 'req-383ed467-fa1b-47d3-acfd-fa965a5822c6'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:12.644887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:12.666217 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76597078b87d4b888dddb78a993f2868', 'request_id': 'req-383ed467-fa1b-47d3-acfd-fa965a5822c6'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:12.698219 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76597078b87d4b888dddb78a993f2868', 'request_id': 'req-383ed467-fa1b-47d3-acfd-fa965a5822c6'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:12.738026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] The token cache is being invalidate because project 76597078b87d4b888dddb78a993f2868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:12.738611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:12.741049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:12.756543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 885/1761] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:12 2022] DELETE /identity/v3/projects/76597078b87d4b888dddb78a993f2868 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:12.757424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.763024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:12.808664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6ba9e-0f57-41d2-bf54-249ea4221475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.809554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ba9e-0f57-41d2-bf54-249ea4221475 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.809851 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ba9e-0f57-41d2-bf54-249ea4221475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.810135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ba9e-0f57-41d2-bf54-249ea4221475 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.811046 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6ba9e-0f57-41d2-bf54-249ea4221475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.816282 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6ba9e-0f57-41d2-bf54-249ea4221475 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.860387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 877/1762] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:12 2022] POST /identity/v3/users => generated 290 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:12.862258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f3489-114c-41d7-bd18-0c8dc6ed74a5 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.862549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f3489-114c-41d7-bd18-0c8dc6ed74a5 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.863076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f3489-114c-41d7-bd18-0c8dc6ed74a5 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.871059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 878/1763] 10.222.0.60 () {54 vars in 912 bytes} [Wed Aug 31 00:16:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:12.873773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bcdc2-c15c-4ee0-b7a0-84fefbdafccf None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.873773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bcdc2-c15c-4ee0-b7a0-84fefbdafccf None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.873773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bcdc2-c15c-4ee0-b7a0-84fefbdafccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.958400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-882bcdc2-c15c-4ee0-b7a0-84fefbdafccf None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:12.960079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-882bcdc2-c15c-4ee0-b7a0-84fefbdafccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:12.976157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ed467-fa1b-47d3-acfd-fa965a5822c6 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.984198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.985334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.985764 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.986151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] PATH_INFO: `/v3/users/eee58b02fef045a3b7d7a53cf8c4d140` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.988028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee58b02fef045a3b7d7a53cf8c4d140)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.991074 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.084707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee58b02fef045a3b7d7a53cf8c4d140'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:13.092452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 879/1764] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:16:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:13.094130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a281b5-aded-4c2b-a35d-1a987d712086 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.095732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a281b5-aded-4c2b-a35d-1a987d712086 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.096148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a281b5-aded-4c2b-a35d-1a987d712086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.117841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee58b02fef045a3b7d7a53cf8c4d140'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:13.119797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee58b02fef045a3b7d7a53cf8c4d140'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:13.120663 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee58b02fef045a3b7d7a53cf8c4d140'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:13.123312 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-65a281b5-aded-4c2b-a35d-1a987d712086 None None] MFA Rules not processed for user `cb42eefa189049d4bdaddd776eb735e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:13.125732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-65a281b5-aded-4c2b-a35d-1a987d712086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:13.159254 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee58b02fef045a3b7d7a53cf8c4d140'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:13.195193 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 886/1765] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:12 2022] DELETE /identity/v3/users/eee58b02fef045a3b7d7a53cf8c4d140 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:13.196104 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.202349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:13.233524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 880/1766] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:13.234840 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a281b5-aded-4c2b-a35d-1a987d712086 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.236599 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-65a281b5-aded-4c2b-a35d-1a987d712086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:13.253621 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a281b5-aded-4c2b-a35d-1a987d712086 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.290112 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:13.357078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:13.368650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb55ca7-1999-402d-97b4-431c35a84a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.369300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb55ca7-1999-402d-97b4-431c35a84a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.369576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb55ca7-1999-402d-97b4-431c35a84a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.369880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb55ca7-1999-402d-97b4-431c35a84a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.371379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb55ca7-1999-402d-97b4-431c35a84a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.372251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb55ca7-1999-402d-97b4-431c35a84a22 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.394698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 881/1767] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:13.415202 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb264996-5a98-462e-baca-ed5897d84f1f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.415479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb264996-5a98-462e-baca-ed5897d84f1f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.415746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb264996-5a98-462e-baca-ed5897d84f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.426380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e96d7-b178-4e6b-aaed-737d37e6084c admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.445794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.447231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.447506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.447769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] PATH_INFO: `/v3/users/ab8d0897192e456f983f0ebdf86d313b` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.451072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8d0897192e456f983f0ebdf86d313b)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.452996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.470216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-eb264996-5a98-462e-baca-ed5897d84f1f None None] MFA Rules not processed for user `d4f2b852544b450a86fdcb5fa18fd290`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:13.476952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-eb264996-5a98-462e-baca-ed5897d84f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:13.562966 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8d0897192e456f983f0ebdf86d313b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:13.593801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8d0897192e456f983f0ebdf86d313b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:13.603392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8d0897192e456f983f0ebdf86d313b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:13.604094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8d0897192e456f983f0ebdf86d313b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:13.616582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 882/1768] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:16:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:13.621734 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d03f2-d8d9-45a9-83a7-07199f54d7fd None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.623338 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d03f2-d8d9-45a9-83a7-07199f54d7fd None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.623942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d03f2-d8d9-45a9-83a7-07199f54d7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.625787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8d0897192e456f983f0ebdf86d313b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:13.648489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 887/1769] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:13 2022] DELETE /identity/v3/users/ab8d0897192e456f983f0ebdf86d313b => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:13.649684 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.651418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:13.669284 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-118d03f2-d8d9-45a9-83a7-07199f54d7fd None None] MFA Rules not processed for user `a899638fd4f44d738d98fed19c35babc`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:13.670789 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-118d03f2-d8d9-45a9-83a7-07199f54d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:13.793553 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 883/1770] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:13.797197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d03f2-d8d9-45a9-83a7-07199f54d7fd None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.799288 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-118d03f2-d8d9-45a9-83a7-07199f54d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:13.838579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5d3ad-a7b0-442b-85dd-a1c2ab9fb075 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.856953 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dcba1-0545-4ffc-b699-1e405afa21b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.858482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dcba1-0545-4ffc-b699-1e405afa21b3 service swift] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.858868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dcba1-0545-4ffc-b699-1e405afa21b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.859246 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dcba1-0545-4ffc-b699-1e405afa21b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.861523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ba8dcba1-0545-4ffc-b699-1e405afa21b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:13.966210 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d03f2-d8d9-45a9-83a7-07199f54d7fd None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.969652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:13.979703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2ea0e-dae2-4913-81d5-304f6fce7e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.980534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2ea0e-dae2-4913-81d5-304f6fce7e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.980909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2ea0e-dae2-4913-81d5-304f6fce7e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.981425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2ea0e-dae2-4913-81d5-304f6fce7e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.983319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2ea0e-dae2-4913-81d5-304f6fce7e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.988201 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2ea0e-dae2-4913-81d5-304f6fce7e88 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:14.017913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 884/1771] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:14.017913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2ea0e-dae2-4913-81d5-304f6fce7e88 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:14.022952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-93d2ea0e-dae2-4913-81d5-304f6fce7e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:14.052018 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2ea0e-dae2-4913-81d5-304f6fce7e88 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:14.063281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:14.065020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.065881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.067597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] PATH_INFO: `/v3/projects/c3a313415ad548ac89d21cbc00e4c3c9` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.070237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a313415ad548ac89d21cbc00e4c3c9)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:14.071674 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dcba1-0545-4ffc-b699-1e405afa21b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:14.075179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:14.077321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dcba1-0545-4ffc-b699-1e405afa21b3 service swift] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:14.078319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:14.149856 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 888/1772] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:16:14.151076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dcba1-0545-4ffc-b699-1e405afa21b3 service swift] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:14.154129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ba8dcba1-0545-4ffc-b699-1e405afa21b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:14.239707 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a313415ad548ac89d21cbc00e4c3c9', 'request_id': 'req-181d06ba-3625-4201-bf4d-7b1582f90276'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:14.256370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a313415ad548ac89d21cbc00e4c3c9', 'request_id': 'req-181d06ba-3625-4201-bf4d-7b1582f90276'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:14.273069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a313415ad548ac89d21cbc00e4c3c9', 'request_id': 'req-181d06ba-3625-4201-bf4d-7b1582f90276'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:14.304896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] The token cache is being invalidate because project c3a313415ad548ac89d21cbc00e4c3c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:14.305244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:14.307509 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:14.315850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 885/1773] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:14 2022] DELETE /identity/v3/projects/c3a313415ad548ac89d21cbc00e4c3c9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:14.315850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:14.318894 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:14.333058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dcba1-0545-4ffc-b699-1e405afa21b3 service swift] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:14.436610 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d06ba-3625-4201-bf4d-7b1582f90276 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:14.443607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f370afe-1a21-47a5-bdf3-435aaf59db69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:14.444585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f370afe-1a21-47a5-bdf3-435aaf59db69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.445142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f370afe-1a21-47a5-bdf3-435aaf59db69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.445692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f370afe-1a21-47a5-bdf3-435aaf59db69 admin admin] PATH_INFO: `/v3/projects/304fd3dedf7741f397b93afd77e207d4/users/696c0c009eda4a9b88bbaca54a079e4a/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.518936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f370afe-1a21-47a5-bdf3-435aaf59db69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=304fd3dedf7741f397b93afd77e207d4, user_id=696c0c009eda4a9b88bbaca54a079e4a, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:14.532157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7785c-525e-49c7-8074-9404a40f98ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:14.536206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7785c-525e-49c7-8074-9404a40f98ec service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.536563 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f370afe-1a21-47a5-bdf3-435aaf59db69 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:14.536827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7785c-525e-49c7-8074-9404a40f98ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.537482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7785c-525e-49c7-8074-9404a40f98ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.541473 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1bf7785c-525e-49c7-8074-9404a40f98ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:14.559857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 886/1774] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:14 2022] PUT /identity/v3/projects/304fd3dedf7741f397b93afd77e207d4/users/696c0c009eda4a9b88bbaca54a079e4a/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:14.563608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbadbf-9535-40e3-8642-c7c83d57f185 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.564192 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbadbf-9535-40e3-8642-c7c83d57f185 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.564794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbadbf-9535-40e3-8642-c7c83d57f185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.584231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7785c-525e-49c7-8074-9404a40f98ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:14.586020 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7785c-525e-49c7-8074-9404a40f98ec service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:14.595742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-93cbadbf-9535-40e3-8642-c7c83d57f185 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:14.598124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-93cbadbf-9535-40e3-8642-c7c83d57f185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:14.599835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 889/1775] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:14.627559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7785c-525e-49c7-8074-9404a40f98ec service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:14.631986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1bf7785c-525e-49c7-8074-9404a40f98ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:14.683373 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7785c-525e-49c7-8074-9404a40f98ec service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:14.686897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 887/1776] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:14.688860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336ae15-0d44-4a05-9dab-e71642b6b726 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.689351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336ae15-0d44-4a05-9dab-e71642b6b726 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.689948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336ae15-0d44-4a05-9dab-e71642b6b726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.714288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:14.715275 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.715766 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.716532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] PATH_INFO: `/v3/projects/9a8fcda3ee464d85946cd95ecc77ef49` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.717942 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8fcda3ee464d85946cd95ecc77ef49)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:14.720072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:14.724822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:14.728349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c336ae15-0d44-4a05-9dab-e71642b6b726 None None] MFA Rules not processed for user `696c0c009eda4a9b88bbaca54a079e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:14.731690 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c336ae15-0d44-4a05-9dab-e71642b6b726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:14.856639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 888/1777] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:14.858481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74288bb-a078-4ee2-99ef-55715f412c61 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.858913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74288bb-a078-4ee2-99ef-55715f412c61 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.860626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74288bb-a078-4ee2-99ef-55715f412c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.907160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8fcda3ee464d85946cd95ecc77ef49', 'request_id': 'req-78b3cb40-9fff-4672-818b-6e54814dacac'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:14.926590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8fcda3ee464d85946cd95ecc77ef49', 'request_id': 'req-78b3cb40-9fff-4672-818b-6e54814dacac'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:14.940002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8fcda3ee464d85946cd95ecc77ef49', 'request_id': 'req-78b3cb40-9fff-4672-818b-6e54814dacac'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:14.943956 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-a74288bb-a078-4ee2-99ef-55715f412c61 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:14.950213 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a74288bb-a078-4ee2-99ef-55715f412c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:14.986318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] The token cache is being invalidate because project 9a8fcda3ee464d85946cd95ecc77ef49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:14.986844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:14.988147 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:14.994165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 890/1778] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:14 2022] DELETE /identity/v3/projects/9a8fcda3ee464d85946cd95ecc77ef49 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:14.995456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:15.000221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:15.079516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:15.187554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 889/1779] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:15.190169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02082c60-6791-42d8-ba62-18747439d994 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.192344 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02082c60-6791-42d8-ba62-18747439d994 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.192647 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02082c60-6791-42d8-ba62-18747439d994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.276762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3cb40-9fff-4672-818b-6e54814dacac admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:15.288350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-02082c60-6791-42d8-ba62-18747439d994 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:15.292348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d5d30-edb9-4489-b808-e50d375be78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:15.293150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d5d30-edb9-4489-b808-e50d375be78b admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.293532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d5d30-edb9-4489-b808-e50d375be78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.293867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d5d30-edb9-4489-b808-e50d375be78b admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.293975 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-02082c60-6791-42d8-ba62-18747439d994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:15.294624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d5d30-edb9-4489-b808-e50d375be78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:15.300159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d5d30-edb9-4489-b808-e50d375be78b admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:15.347880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 890/1780] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:15.353965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308470bd-81ec-4a11-af72-0702dc6328b6 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.356679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308470bd-81ec-4a11-af72-0702dc6328b6 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.359311 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308470bd-81ec-4a11-af72-0702dc6328b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.425288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 891/1781] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:14 2022] POST /identity/v3/projects => generated 379 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:15.428172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d5d30-edb9-4489-b808-e50d375be78b admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:15.430619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-308470bd-81ec-4a11-af72-0702dc6328b6 None None] MFA Rules not processed for user `d4f2b852544b450a86fdcb5fa18fd290`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:15.431997 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-308470bd-81ec-4a11-af72-0702dc6328b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:15.527533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 891/1782] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 31 00:16:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:15.530334 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da517e-4a05-4380-85f2-03f4413d7660 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.531046 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da517e-4a05-4380-85f2-03f4413d7660 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.531546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da517e-4a05-4380-85f2-03f4413d7660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.568202 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-27da517e-4a05-4380-85f2-03f4413d7660 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:15.570912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-27da517e-4a05-4380-85f2-03f4413d7660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:15.663580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d5d30-edb9-4489-b808-e50d375be78b admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:15.672033 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b04f2-0d42-4ce2-8e50-494fc4389587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:15.673047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b04f2-0d42-4ce2-8e50-494fc4389587 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.673568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b04f2-0d42-4ce2-8e50-494fc4389587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.674280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b04f2-0d42-4ce2-8e50-494fc4389587 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.675178 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b04f2-0d42-4ce2-8e50-494fc4389587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:15.675629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b04f2-0d42-4ce2-8e50-494fc4389587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:15.677865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b04f2-0d42-4ce2-8e50-494fc4389587 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:15.695753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 892/1783] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:15.697069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b04f2-0d42-4ce2-8e50-494fc4389587 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:15.715452 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b04f2-0d42-4ce2-8e50-494fc4389587 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:15.723720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d19602-2d83-40fe-a67d-116b1f8f69da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:15.725610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d19602-2d83-40fe-a67d-116b1f8f69da admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.726358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d19602-2d83-40fe-a67d-116b1f8f69da admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.726775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d19602-2d83-40fe-a67d-116b1f8f69da admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.728697 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d19602-2d83-40fe-a67d-116b1f8f69da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:15.733391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d19602-2d83-40fe-a67d-116b1f8f69da admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:15.761098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:15.797928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 893/1784] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:15 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:15.800835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d19602-2d83-40fe-a67d-116b1f8f69da admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:15.803972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-28d19602-2d83-40fe-a67d-116b1f8f69da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:15.845946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 892/1785] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:15.845946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da517e-4a05-4380-85f2-03f4413d7660 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:15.876060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da517e-4a05-4380-85f2-03f4413d7660 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:15.886644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d19602-2d83-40fe-a67d-116b1f8f69da admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:15.890794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef23ce3-c283-43e3-a6c4-c19848bfdad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:15.905870 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef23ce3-c283-43e3-a6c4-c19848bfdad4 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.906393 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef23ce3-c283-43e3-a6c4-c19848bfdad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.906645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459783dc-8d10-4126-b1ac-afdc07f41535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:15.907509 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459783dc-8d10-4126-b1ac-afdc07f41535 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.907616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459783dc-8d10-4126-b1ac-afdc07f41535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.908122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef23ce3-c283-43e3-a6c4-c19848bfdad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.909467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459783dc-8d10-4126-b1ac-afdc07f41535 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.916935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459783dc-8d10-4126-b1ac-afdc07f41535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:15.919049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459783dc-8d10-4126-b1ac-afdc07f41535 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:15.956078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef23ce3-c283-43e3-a6c4-c19848bfdad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:15.962125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef23ce3-c283-43e3-a6c4-c19848bfdad4 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.014643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 893/1786] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:15 2022] POST /identity/v3/projects => generated 357 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:16.015227 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459783dc-8d10-4126-b1ac-afdc07f41535 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.026771 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 894/1787] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:16.029485 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef23ce3-c283-43e3-a6c4-c19848bfdad4 service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.061692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef23ce3-c283-43e3-a6c4-c19848bfdad4 service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.216939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459783dc-8d10-4126-b1ac-afdc07f41535 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.231136 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f487135-c4c5-4c37-9a11-330c74dd32f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.231714 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f487135-c4c5-4c37-9a11-330c74dd32f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.232116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f487135-c4c5-4c37-9a11-330c74dd32f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.232535 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f487135-c4c5-4c37-9a11-330c74dd32f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.233437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f487135-c4c5-4c37-9a11-330c74dd32f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:16.236341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f487135-c4c5-4c37-9a11-330c74dd32f3 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.254289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 894/1788] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:16.255298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f487135-c4c5-4c37-9a11-330c74dd32f3 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.258511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf051360-e213-4fe6-9320-e5a661616106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.259142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf051360-e213-4fe6-9320-e5a661616106 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.268306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f487135-c4c5-4c37-9a11-330c74dd32f3 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.268564 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf051360-e213-4fe6-9320-e5a661616106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.269555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf051360-e213-4fe6-9320-e5a661616106 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.271308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf051360-e213-4fe6-9320-e5a661616106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:16.271629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf051360-e213-4fe6-9320-e5a661616106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:16.275034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1c460-0f88-4d81-b20d-7bc56041755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.275034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1c460-0f88-4d81-b20d-7bc56041755b admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.275312 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1c460-0f88-4d81-b20d-7bc56041755b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.275618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1c460-0f88-4d81-b20d-7bc56041755b admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.276498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1c460-0f88-4d81-b20d-7bc56041755b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:16.278740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf051360-e213-4fe6-9320-e5a661616106 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.279056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1c460-0f88-4d81-b20d-7bc56041755b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.308847 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:16.321666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 895/1789] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:16.322517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf051360-e213-4fe6-9320-e5a661616106 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.322932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 895/1790] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:16 2022] POST /identity/v3/users => generated 279 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:16.325540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1c460-0f88-4d81-b20d-7bc56041755b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.346581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf051360-e213-4fe6-9320-e5a661616106 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.353338 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1c460-0f88-4d81-b20d-7bc56041755b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.362039 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3ed22-dc44-436e-84f3-75c56f1f6f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.363165 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3ed22-dc44-436e-84f3-75c56f1f6f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.363671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3ed22-dc44-436e-84f3-75c56f1f6f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.364081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3ed22-dc44-436e-84f3-75c56f1f6f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.364570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a7ec2-cb08-47d8-ae27-be400e2e364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.365257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3ed22-dc44-436e-84f3-75c56f1f6f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:16.365383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a7ec2-cb08-47d8-ae27-be400e2e364d admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.365555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a7ec2-cb08-47d8-ae27-be400e2e364d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.365828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a7ec2-cb08-47d8-ae27-be400e2e364d admin admin] PATH_INFO: `/v3/projects/6c5633bdc12d406eb2146fe90d9ebc9b/users/b83a3ea2a0de4e9fb8c8353c50b33248/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.368439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3ed22-dc44-436e-84f3-75c56f1f6f78 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.383602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 896/1791] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:16.384474 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3ed22-dc44-436e-84f3-75c56f1f6f78 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.407054 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a7ec2-cb08-47d8-ae27-be400e2e364d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5633bdc12d406eb2146fe90d9ebc9b, user_id=b83a3ea2a0de4e9fb8c8353c50b33248, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:16.412786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3ed22-dc44-436e-84f3-75c56f1f6f78 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.420258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a7ec2-cb08-47d8-ae27-be400e2e364d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.428322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe35cf-7971-4354-8e9b-d53e17ac5008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.431702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe35cf-7971-4354-8e9b-d53e17ac5008 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.431986 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe35cf-7971-4354-8e9b-d53e17ac5008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.432267 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe35cf-7971-4354-8e9b-d53e17ac5008 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.435734 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe35cf-7971-4354-8e9b-d53e17ac5008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:16.449279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe35cf-7971-4354-8e9b-d53e17ac5008 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.503179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 896/1792] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:16 2022] PUT /identity/v3/projects/6c5633bdc12d406eb2146fe90d9ebc9b/users/b83a3ea2a0de4e9fb8c8353c50b33248/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:16.511744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a7ec2-cb08-47d8-ae27-be400e2e364d admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.543379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 897/1793] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:16 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:16.543990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe35cf-7971-4354-8e9b-d53e17ac5008 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.736363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a7ec2-cb08-47d8-ae27-be400e2e364d admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.739619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe35cf-7971-4354-8e9b-d53e17ac5008 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.755676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a2542-5bc9-4322-a641-38ab0d7e0d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.757067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a2542-5bc9-4322-a641-38ab0d7e0d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.757371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a2542-5bc9-4322-a641-38ab0d7e0d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.757648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a2542-5bc9-4322-a641-38ab0d7e0d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.758327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a2542-5bc9-4322-a641-38ab0d7e0d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:16.762418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442b1c9-6c07-4d27-a5e1-c192866b3a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.764472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b1c9-6c07-4d27-a5e1-c192866b3a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.767239 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a2542-5bc9-4322-a641-38ab0d7e0d43 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.768326 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b1c9-6c07-4d27-a5e1-c192866b3a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.769711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b1c9-6c07-4d27-a5e1-c192866b3a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.770647 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442b1c9-6c07-4d27-a5e1-c192866b3a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:16.779468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442b1c9-6c07-4d27-a5e1-c192866b3a99 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.820656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 898/1794] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:16.822709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442b1c9-6c07-4d27-a5e1-c192866b3a99 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.827340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 897/1795] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:16.827340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a2542-5bc9-4322-a641-38ab0d7e0d43 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.833714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-251a2542-5bc9-4322-a641-38ab0d7e0d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:16.868675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442b1c9-6c07-4d27-a5e1-c192866b3a99 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.887865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0b738-a84f-4882-94df-bdc7bc903694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.889061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0b738-a84f-4882-94df-bdc7bc903694 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.891329 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0b738-a84f-4882-94df-bdc7bc903694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.892931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0b738-a84f-4882-94df-bdc7bc903694 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.894080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a2542-5bc9-4322-a641-38ab0d7e0d43 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.895063 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0b738-a84f-4882-94df-bdc7bc903694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:16.910776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0b738-a84f-4882-94df-bdc7bc903694 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.930085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:16.935873 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.936688 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.936972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.938357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] PATH_INFO: `/v3/users/cd205ad646f14fbf8eecc60ef487c9dd` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.942446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd205ad646f14fbf8eecc60ef487c9dd)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:16.946647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.994719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 899/1796] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:16 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:16.998562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0b738-a84f-4882-94df-bdc7bc903694 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:17.036465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0b738-a84f-4882-94df-bdc7bc903694 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:17.055729 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4a12a-1242-42c7-a7d6-9cb1f2c7c48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:17.056352 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4a12a-1242-42c7-a7d6-9cb1f2c7c48a admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.056637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4a12a-1242-42c7-a7d6-9cb1f2c7c48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.060930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4a12a-1242-42c7-a7d6-9cb1f2c7c48a admin admin] PATH_INFO: `/v3/projects/6c5633bdc12d406eb2146fe90d9ebc9b/users/b83a3ea2a0de4e9fb8c8353c50b33248/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.062907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd205ad646f14fbf8eecc60ef487c9dd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:17.067735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4a12a-1242-42c7-a7d6-9cb1f2c7c48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5633bdc12d406eb2146fe90d9ebc9b, user_id=b83a3ea2a0de4e9fb8c8353c50b33248, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:17.070451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4a12a-1242-42c7-a7d6-9cb1f2c7c48a admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:17.100888 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd205ad646f14fbf8eecc60ef487c9dd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:17.104496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd205ad646f14fbf8eecc60ef487c9dd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:17.105705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd205ad646f14fbf8eecc60ef487c9dd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:17.119748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 900/1797] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:16 2022] PUT /identity/v3/projects/6c5633bdc12d406eb2146fe90d9ebc9b/users/b83a3ea2a0de4e9fb8c8353c50b33248/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:17.121252 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4a12a-1242-42c7-a7d6-9cb1f2c7c48a admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:17.121521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd205ad646f14fbf8eecc60ef487c9dd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:17.127151 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-55a4a12a-1242-42c7-a7d6-9cb1f2c7c48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:17.168957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 898/1798] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:16 2022] DELETE /identity/v3/users/cd205ad646f14fbf8eecc60ef487c9dd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:17.171839 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:17.180311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:17.354690 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4a12a-1242-42c7-a7d6-9cb1f2c7c48a admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:17.418839 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:17.469300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dba4d-9c36-480b-997f-8fdd7f01ece8 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:17.477354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb96bc-a703-45c7-94a0-fdaed0c1484a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:17.478163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb96bc-a703-45c7-94a0-fdaed0c1484a admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.478445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb96bc-a703-45c7-94a0-fdaed0c1484a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.478741 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb96bc-a703-45c7-94a0-fdaed0c1484a admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.479398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb96bc-a703-45c7-94a0-fdaed0c1484a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:17.484557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb96bc-a703-45c7-94a0-fdaed0c1484a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:17.508174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 899/1799] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:17.510448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a784b-b72e-408c-8ede-0bc3578c0744 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.510722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a784b-b72e-408c-8ede-0bc3578c0744 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.511423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a784b-b72e-408c-8ede-0bc3578c0744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.530155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e207b08-4b76-4059-8ce8-bfcb3a25b4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:17.530964 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207b08-4b76-4059-8ce8-bfcb3a25b4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.531659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207b08-4b76-4059-8ce8-bfcb3a25b4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.531872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207b08-4b76-4059-8ce8-bfcb3a25b4c4 admin admin] PATH_INFO: `/v3/projects/86d5f4ac26324434917ca8bb1fc704d1/users/6129998d2d404cf98158b851c40fb25b/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.582319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e207b08-4b76-4059-8ce8-bfcb3a25b4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d5f4ac26324434917ca8bb1fc704d1, user_id=6129998d2d404cf98158b851c40fb25b, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:17.587328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e207b08-4b76-4059-8ce8-bfcb3a25b4c4 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:17.592286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-0a7a784b-b72e-408c-8ede-0bc3578c0744 None None] MFA Rules not processed for user `b83a3ea2a0de4e9fb8c8353c50b33248`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:17.597238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0a7a784b-b72e-408c-8ede-0bc3578c0744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:17.630002 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 901/1800] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:17 2022] PUT /identity/v3/projects/86d5f4ac26324434917ca8bb1fc704d1/users/6129998d2d404cf98158b851c40fb25b/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:17.643663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc80f-5f3b-4a53-b4f5-1a1d2bdb3d27 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.643663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc80f-5f3b-4a53-b4f5-1a1d2bdb3d27 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.643663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc80f-5f3b-4a53-b4f5-1a1d2bdb3d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.715735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e85bc80f-5f3b-4a53-b4f5-1a1d2bdb3d27 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:17.717153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e85bc80f-5f3b-4a53-b4f5-1a1d2bdb3d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:17.854662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 900/1801] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:17.855660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a784b-b72e-408c-8ede-0bc3578c0744 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:17.872444 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 902/1802] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:17.883685 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0588ea-922a-4b0c-b7b9-484d6aeda9f1 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.884056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0588ea-922a-4b0c-b7b9-484d6aeda9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.884261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0588ea-922a-4b0c-b7b9-484d6aeda9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.895318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a784b-b72e-408c-8ede-0bc3578c0744 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:17.907484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb98162-6089-4202-b8ca-b18cde4341c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:17.908158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98162-6089-4202-b8ca-b18cde4341c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.908365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98162-6089-4202-b8ca-b18cde4341c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.909979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98162-6089-4202-b8ca-b18cde4341c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.911406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb98162-6089-4202-b8ca-b18cde4341c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:17.911900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:17.914310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb98162-6089-4202-b8ca-b18cde4341c9 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:17.933855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 901/1803] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:17.935169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb98162-6089-4202-b8ca-b18cde4341c9 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:17.937441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-feb98162-6089-4202-b8ca-b18cde4341c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:17.951858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-6a0588ea-922a-4b0c-b7b9-484d6aeda9f1 None None] MFA Rules not processed for user `6129998d2d404cf98158b851c40fb25b`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:17.957062 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-6a0588ea-922a-4b0c-b7b9-484d6aeda9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:18.109908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb98162-6089-4202-b8ca-b18cde4341c9 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:18.128246 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65aa5c-4615-4dc0-bcbc-53fed72a24e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:18.128887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65aa5c-4615-4dc0-bcbc-53fed72a24e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.129167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65aa5c-4615-4dc0-bcbc-53fed72a24e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.134167 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 903/1804] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:18.134167 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0588ea-922a-4b0c-b7b9-484d6aeda9f1 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:18.134408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65aa5c-4615-4dc0-bcbc-53fed72a24e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.138457 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-6a0588ea-922a-4b0c-b7b9-484d6aeda9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:18.139046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2b65aa5c-4615-4dc0-bcbc-53fed72a24e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:18.287925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0588ea-922a-4b0c-b7b9-484d6aeda9f1 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:18.298054 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e392a4e-33ef-4b5a-b103-11f850677e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:18.298827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e392a4e-33ef-4b5a-b103-11f850677e8f service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.299109 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e392a4e-33ef-4b5a-b103-11f850677e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.299480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e392a4e-33ef-4b5a-b103-11f850677e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.328324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e392a4e-33ef-4b5a-b103-11f850677e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:18.329981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e392a4e-33ef-4b5a-b103-11f850677e8f service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:18.361582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 904/1805] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:18.362502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e392a4e-33ef-4b5a-b103-11f850677e8f service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:18.388622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e392a4e-33ef-4b5a-b103-11f850677e8f service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:18.392437 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65aa5c-4615-4dc0-bcbc-53fed72a24e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:18.394621 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65aa5c-4615-4dc0-bcbc-53fed72a24e5 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:18.406595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b575637-8f07-4051-bdc7-9eaea10c8602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:18.408272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b575637-8f07-4051-bdc7-9eaea10c8602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.408616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b575637-8f07-4051-bdc7-9eaea10c8602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.409742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b575637-8f07-4051-bdc7-9eaea10c8602 admin admin] PATH_INFO: `/v3/projects/f7a5039c338f4777958a6cfee3a42b6d/users/9126df38c50e4ade847c4ab65c6c4143/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.421160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 902/1806] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:18.422219 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65aa5c-4615-4dc0-bcbc-53fed72a24e5 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:18.444651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b575637-8f07-4051-bdc7-9eaea10c8602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a5039c338f4777958a6cfee3a42b6d, user_id=9126df38c50e4ade847c4ab65c6c4143, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:18.447525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65aa5c-4615-4dc0-bcbc-53fed72a24e5 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:18.452572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b575637-8f07-4051-bdc7-9eaea10c8602 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:18.463382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e55c7f-bfa7-44d0-a2f5-f43c897e2dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:18.464522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e55c7f-bfa7-44d0-a2f5-f43c897e2dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.465096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e55c7f-bfa7-44d0-a2f5-f43c897e2dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.465405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e55c7f-bfa7-44d0-a2f5-f43c897e2dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.466244 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e55c7f-bfa7-44d0-a2f5-f43c897e2dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:18.470744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e55c7f-bfa7-44d0-a2f5-f43c897e2dc6 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:18.485968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:18.497752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 905/1807] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:18 2022] PUT /identity/v3/projects/f7a5039c338f4777958a6cfee3a42b6d/users/9126df38c50e4ade847c4ab65c6c4143/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:18.508381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e77286-13e1-4f73-a593-e037a592e33a None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.510317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e77286-13e1-4f73-a593-e037a592e33a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.512521 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e77286-13e1-4f73-a593-e037a592e33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.550014 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 903/1808] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:18 2022] POST /identity/v3/projects => generated 357 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:18.554700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e55c7f-bfa7-44d0-a2f5-f43c897e2dc6 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:18.701461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-30e77286-13e1-4f73-a593-e037a592e33a None None] MFA Rules not processed for user `9126df38c50e4ade847c4ab65c6c4143`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:18.715985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-30e77286-13e1-4f73-a593-e037a592e33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:18.874657 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e55c7f-bfa7-44d0-a2f5-f43c897e2dc6 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:18.892785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e29ef-2ace-4c0d-b3c4-2f8e78dd0d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:18.895844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e29ef-2ace-4c0d-b3c4-2f8e78dd0d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.896685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e29ef-2ace-4c0d-b3c4-2f8e78dd0d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.898048 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e29ef-2ace-4c0d-b3c4-2f8e78dd0d37 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.899001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e29ef-2ace-4c0d-b3c4-2f8e78dd0d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:18.909782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e29ef-2ace-4c0d-b3c4-2f8e78dd0d37 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:18.987176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 904/1809] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:18 2022] POST /identity/v3/users => generated 285 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:18.990936 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e29ef-2ace-4c0d-b3c4-2f8e78dd0d37 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:18.997066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 906/1810] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:18.999383 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e77286-13e1-4f73-a593-e037a592e33a None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.010964 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:19.024480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e77286-13e1-4f73-a593-e037a592e33a None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.036710 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f26de-16c6-449c-9e1a-a312dbc81915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:19.037474 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f26de-16c6-449c-9e1a-a312dbc81915 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.037758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f26de-16c6-449c-9e1a-a312dbc81915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.039137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f26de-16c6-449c-9e1a-a312dbc81915 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.039944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f26de-16c6-449c-9e1a-a312dbc81915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:19.044157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f26de-16c6-449c-9e1a-a312dbc81915 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:19.055894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e29ef-2ace-4c0d-b3c4-2f8e78dd0d37 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.097404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900d39c-bd2e-46ff-8e24-272841e6f1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:19.105731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d39c-bd2e-46ff-8e24-272841e6f1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.106110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d39c-bd2e-46ff-8e24-272841e6f1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.106437 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d39c-bd2e-46ff-8e24-272841e6f1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.107947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900d39c-bd2e-46ff-8e24-272841e6f1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:19.112717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900d39c-bd2e-46ff-8e24-272841e6f1d7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:19.119359 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 907/1811] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:18 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:19.123289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f26de-16c6-449c-9e1a-a312dbc81915 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.154876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 905/1812] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:19.164198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900d39c-bd2e-46ff-8e24-272841e6f1d7 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.192602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900d39c-bd2e-46ff-8e24-272841e6f1d7 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.320095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f26de-16c6-449c-9e1a-a312dbc81915 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.334023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e19d9e-a7b6-4140-9d10-0adb8d24339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:19.335178 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e19d9e-a7b6-4140-9d10-0adb8d24339d admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.335699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e19d9e-a7b6-4140-9d10-0adb8d24339d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.335977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e19d9e-a7b6-4140-9d10-0adb8d24339d admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.338233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e19d9e-a7b6-4140-9d10-0adb8d24339d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:19.343579 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e19d9e-a7b6-4140-9d10-0adb8d24339d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:19.420933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 908/1813] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:19 2022] POST /identity/v3/users => generated 296 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:19.422016 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e19d9e-a7b6-4140-9d10-0adb8d24339d admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.437112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fa86d-72f2-4ea0-aa40-69e2ddb5e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:19.437850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fa86d-72f2-4ea0-aa40-69e2ddb5e3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.438124 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fa86d-72f2-4ea0-aa40-69e2ddb5e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.443858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fa86d-72f2-4ea0-aa40-69e2ddb5e3bc admin admin] PATH_INFO: `/v3/projects/fa0accd14e24477882757b24f5a90f8f/users/a1cda0321974425bb6da5ed4cc4e27b1/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.465017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e19d9e-a7b6-4140-9d10-0adb8d24339d admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.494387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a83b3-a464-4458-a2fd-e296a4792ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:19.497806 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a83b3-a464-4458-a2fd-e296a4792ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.498063 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a83b3-a464-4458-a2fd-e296a4792ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.498336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a83b3-a464-4458-a2fd-e296a4792ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.499022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a83b3-a464-4458-a2fd-e296a4792ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:19.509130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a83b3-a464-4458-a2fd-e296a4792ad5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:19.513124 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fa86d-72f2-4ea0-aa40-69e2ddb5e3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0accd14e24477882757b24f5a90f8f, user_id=a1cda0321974425bb6da5ed4cc4e27b1, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:19.532567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fa86d-72f2-4ea0-aa40-69e2ddb5e3bc admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:19.568001 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 909/1814] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:19.571874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a83b3-a464-4458-a2fd-e296a4792ad5 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.595461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 906/1815] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:19 2022] PUT /identity/v3/projects/fa0accd14e24477882757b24f5a90f8f/users/a1cda0321974425bb6da5ed4cc4e27b1/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:19.595461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fa86d-72f2-4ea0-aa40-69e2ddb5e3bc admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.600568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-526fa86d-72f2-4ea0-aa40-69e2ddb5e3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:19.610743 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a83b3-a464-4458-a2fd-e296a4792ad5 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.794290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16825a45-9360-4570-a3c1-09200ba4693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:19.795265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16825a45-9360-4570-a3c1-09200ba4693b admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.795702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16825a45-9360-4570-a3c1-09200ba4693b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.796134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16825a45-9360-4570-a3c1-09200ba4693b admin admin] PATH_INFO: `/v3/projects/d7e5397b94a14030ba0a65f8f1566b83/users/aa4a08ada4864e1fb8f63bbe1ba0b256/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.843599 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16825a45-9360-4570-a3c1-09200ba4693b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e5397b94a14030ba0a65f8f1566b83, user_id=aa4a08ada4864e1fb8f63bbe1ba0b256, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:19.846322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16825a45-9360-4570-a3c1-09200ba4693b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:19.860906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:19.882037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 910/1816] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:19 2022] PUT /identity/v3/projects/d7e5397b94a14030ba0a65f8f1566b83/users/aa4a08ada4864e1fb8f63bbe1ba0b256/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:19.883269 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16825a45-9360-4570-a3c1-09200ba4693b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.921303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fa86d-72f2-4ea0-aa40-69e2ddb5e3bc admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.019051 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:20.076732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16825a45-9360-4570-a3c1-09200ba4693b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.105635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c345384-60e8-45a7-b048-6667ce6ca899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.106565 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c345384-60e8-45a7-b048-6667ce6ca899 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.113698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c345384-60e8-45a7-b048-6667ce6ca899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.114223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c345384-60e8-45a7-b048-6667ce6ca899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.123641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c345384-60e8-45a7-b048-6667ce6ca899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.125792 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c345384-60e8-45a7-b048-6667ce6ca899 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.132815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab29ba-e021-4b19-9c37-5e091d2381ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.133626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab29ba-e021-4b19-9c37-5e091d2381ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.134113 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab29ba-e021-4b19-9c37-5e091d2381ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.136350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab29ba-e021-4b19-9c37-5e091d2381ad admin admin] PATH_INFO: `/v3/projects/f0cd174cbf4749d38d4e5c2de3d6337e` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.142622 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab29ba-e021-4b19-9c37-5e091d2381ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0cd174cbf4749d38d4e5c2de3d6337e)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.158076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab29ba-e021-4b19-9c37-5e091d2381ad admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.164429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 911/1817] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:20.176425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c345384-60e8-45a7-b048-6667ce6ca899 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:20.221336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c345384-60e8-45a7-b048-6667ce6ca899 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.254204 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499750e-4fa2-49be-a629-51fa06b2ef74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.255199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499750e-4fa2-49be-a629-51fa06b2ef74 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.255632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499750e-4fa2-49be-a629-51fa06b2ef74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.256052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499750e-4fa2-49be-a629-51fa06b2ef74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.257198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499750e-4fa2-49be-a629-51fa06b2ef74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.259075 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499750e-4fa2-49be-a629-51fa06b2ef74 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.290319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 912/1818] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:20.300953 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499750e-4fa2-49be-a629-51fa06b2ef74 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:20.334640 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499750e-4fa2-49be-a629-51fa06b2ef74 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.391332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-18ab29ba-e021-4b19-9c37-5e091d2381ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0cd174cbf4749d38d4e5c2de3d6337e', 'request_id': 'req-18ab29ba-e021-4b19-9c37-5e091d2381ad'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:20.415468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-18ab29ba-e021-4b19-9c37-5e091d2381ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0cd174cbf4749d38d4e5c2de3d6337e', 'request_id': 'req-18ab29ba-e021-4b19-9c37-5e091d2381ad'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:20.435576 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-18ab29ba-e021-4b19-9c37-5e091d2381ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0cd174cbf4749d38d4e5c2de3d6337e', 'request_id': 'req-18ab29ba-e021-4b19-9c37-5e091d2381ad'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:20.481533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-18ab29ba-e021-4b19-9c37-5e091d2381ad admin admin] The token cache is being invalidate because project f0cd174cbf4749d38d4e5c2de3d6337e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:20.481820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-18ab29ba-e021-4b19-9c37-5e091d2381ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:20.495080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-18ab29ba-e021-4b19-9c37-5e091d2381ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:20.503504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 907/1819] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:19 2022] DELETE /identity/v3/projects/f0cd174cbf4749d38d4e5c2de3d6337e => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:20.505296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516eab9-9ac4-41b7-b970-8e9851f259bb None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.511141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516eab9-9ac4-41b7-b970-8e9851f259bb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.511723 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516eab9-9ac4-41b7-b970-8e9851f259bb None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.520047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 908/1820] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:16:20 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:20.522350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516eab9-9ac4-41b7-b970-8e9851f259bb None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:20.532773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d516eab9-9ac4-41b7-b970-8e9851f259bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:20.546847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551d3db-6831-4aba-9d7a-00c108b9a0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.547748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551d3db-6831-4aba-9d7a-00c108b9a0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.548039 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551d3db-6831-4aba-9d7a-00c108b9a0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.548433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551d3db-6831-4aba-9d7a-00c108b9a0a2 admin admin] PATH_INFO: `/v3/projects/fa0accd14e24477882757b24f5a90f8f/users/a1cda0321974425bb6da5ed4cc4e27b1/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.555583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551d3db-6831-4aba-9d7a-00c108b9a0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0accd14e24477882757b24f5a90f8f, user_id=a1cda0321974425bb6da5ed4cc4e27b1, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.559750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551d3db-6831-4aba-9d7a-00c108b9a0a2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.590317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 913/1821] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:20 2022] PUT /identity/v3/projects/fa0accd14e24477882757b24f5a90f8f/users/a1cda0321974425bb6da5ed4cc4e27b1/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:20.591110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516eab9-9ac4-41b7-b970-8e9851f259bb None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.594279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551d3db-6831-4aba-9d7a-00c108b9a0a2 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:20.598193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-5551d3db-6831-4aba-9d7a-00c108b9a0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:20.701944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551d3db-6831-4aba-9d7a-00c108b9a0a2 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.706777 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.707572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.707949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.708322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] PATH_INFO: `/v3/users/e1d065ad0b2f4c0aae34ef83ac81e4bd` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.710089 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d065ad0b2f4c0aae34ef83ac81e4bd)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.711866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.777519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ace78-e484-4bf6-bd05-c5a734011923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.778404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ace78-e484-4bf6-bd05-c5a734011923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.778676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ace78-e484-4bf6-bd05-c5a734011923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.779155 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ace78-e484-4bf6-bd05-c5a734011923 admin admin] PATH_INFO: `/v3/projects/d7e5397b94a14030ba0a65f8f1566b83/users/aa4a08ada4864e1fb8f63bbe1ba0b256/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.784193 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ace78-e484-4bf6-bd05-c5a734011923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e5397b94a14030ba0a65f8f1566b83, user_id=aa4a08ada4864e1fb8f63bbe1ba0b256, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.792059 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ace78-e484-4bf6-bd05-c5a734011923 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.834710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 909/1822] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:20 2022] PUT /identity/v3/projects/d7e5397b94a14030ba0a65f8f1566b83/users/aa4a08ada4864e1fb8f63bbe1ba0b256/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:20.840234 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04909b9-598e-491e-abc6-9bc7279e1a82 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.840595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04909b9-598e-491e-abc6-9bc7279e1a82 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.840972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04909b9-598e-491e-abc6-9bc7279e1a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.884468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d065ad0b2f4c0aae34ef83ac81e4bd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:20.906602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d065ad0b2f4c0aae34ef83ac81e4bd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:20.907930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d065ad0b2f4c0aae34ef83ac81e4bd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:20.962174 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d065ad0b2f4c0aae34ef83ac81e4bd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:20.978318 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:20.996481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a04909b9-598e-491e-abc6-9bc7279e1a82 None None] MFA Rules not processed for user `a1cda0321974425bb6da5ed4cc4e27b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:20.999549 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a04909b9-598e-491e-abc6-9bc7279e1a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:21.003350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d065ad0b2f4c0aae34ef83ac81e4bd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:21.014327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 914/1823] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:20 2022] DELETE /identity/v3/users/e1d065ad0b2f4c0aae34ef83ac81e4bd => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:21.015446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:21.022290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:21.039990 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:21.178736 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc22f5b-cb8f-43a2-b538-296588461aaf admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:21.184752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fa205-123a-4cf3-a8d2-4054e44bfc6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:21.185446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fa205-123a-4cf3-a8d2-4054e44bfc6f service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:21.185852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fa205-123a-4cf3-a8d2-4054e44bfc6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:21.186261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fa205-123a-4cf3-a8d2-4054e44bfc6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:21.188673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d56fa205-123a-4cf3-a8d2-4054e44bfc6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:21.227371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 910/1824] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:21.228825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083415c-f517-41fc-86b4-f05e0357a429 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:21.229229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083415c-f517-41fc-86b4-f05e0357a429 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:21.229743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083415c-f517-41fc-86b4-f05e0357a429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:21.283041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-0083415c-f517-41fc-86b4-f05e0357a429 None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:21.285042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0083415c-f517-41fc-86b4-f05e0357a429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:21.421502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fa205-123a-4cf3-a8d2-4054e44bfc6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:21.430681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fa205-123a-4cf3-a8d2-4054e44bfc6f service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:21.471140 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 915/1825] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:21.488583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e7658-c449-40c1-8c71-ea0ab8ac0d92 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:21.493514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e7658-c449-40c1-8c71-ea0ab8ac0d92 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:21.493926 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e7658-c449-40c1-8c71-ea0ab8ac0d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:21.506136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 911/1826] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:16:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:21.508451 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083415c-f517-41fc-86b4-f05e0357a429 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:21.512562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0083415c-f517-41fc-86b4-f05e0357a429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:21.555618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083415c-f517-41fc-86b4-f05e0357a429 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:21.568122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4173f-2dc0-4ed3-a98c-52828f37db10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:21.569113 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4173f-2dc0-4ed3-a98c-52828f37db10 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:21.569584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4173f-2dc0-4ed3-a98c-52828f37db10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:21.569918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4173f-2dc0-4ed3-a98c-52828f37db10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:21.614205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-db6e7658-c449-40c1-8c71-ea0ab8ac0d92 None None] MFA Rules not processed for user `aa4a08ada4864e1fb8f63bbe1ba0b256`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:21.615543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-db6e7658-c449-40c1-8c71-ea0ab8ac0d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:21.857267 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 916/1827] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:21.858641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e7658-c449-40c1-8c71-ea0ab8ac0d92 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:21.863754 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-db6e7658-c449-40c1-8c71-ea0ab8ac0d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:21.883183 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4173f-2dc0-4ed3-a98c-52828f37db10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:21.890710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4173f-2dc0-4ed3-a98c-52828f37db10 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:21.906287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e7658-c449-40c1-8c71-ea0ab8ac0d92 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:21.920243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae662-0bb3-4c48-8e6f-c3fe3af4c271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:21.923798 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae662-0bb3-4c48-8e6f-c3fe3af4c271 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:21.925084 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae662-0bb3-4c48-8e6f-c3fe3af4c271 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:21.926024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae662-0bb3-4c48-8e6f-c3fe3af4c271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:21.944038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 912/1828] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:21.972039 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae662-0bb3-4c48-8e6f-c3fe3af4c271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:21.973757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae662-0bb3-4c48-8e6f-c3fe3af4c271 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:22.018228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4173f-2dc0-4ed3-a98c-52828f37db10 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:22.030428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4173f-2dc0-4ed3-a98c-52828f37db10 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:22.039926 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 917/1829] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:22.056243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecb387-e399-4be4-9187-cfa926dbb0e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:22.057008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecb387-e399-4be4-9187-cfa926dbb0e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:22.058676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecb387-e399-4be4-9187-cfa926dbb0e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:22.058949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecb387-e399-4be4-9187-cfa926dbb0e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:22.071555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecb387-e399-4be4-9187-cfa926dbb0e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:22.073788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecb387-e399-4be4-9187-cfa926dbb0e4 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:22.120707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 913/1830] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:22.164102 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae662-0bb3-4c48-8e6f-c3fe3af4c271 service nova] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:22.174682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:22.188431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae662-0bb3-4c48-8e6f-c3fe3af4c271 service nova] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:22.208951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae43dfa-116d-40ba-a246-0cea7c793a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:22.209944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae43dfa-116d-40ba-a246-0cea7c793a16 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:22.210103 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae43dfa-116d-40ba-a246-0cea7c793a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:22.218700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae43dfa-116d-40ba-a246-0cea7c793a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:22.227140 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8ae43dfa-116d-40ba-a246-0cea7c793a16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:22.434441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae43dfa-116d-40ba-a246-0cea7c793a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:22.436449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae43dfa-116d-40ba-a246-0cea7c793a16 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:22.470970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 918/1831] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:22.949980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecb387-e399-4be4-9187-cfa926dbb0e4 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:22.952048 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b8ecb387-e399-4be4-9187-cfa926dbb0e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:23.014983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:23.053588 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae43dfa-116d-40ba-a246-0cea7c793a16 service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:23.056930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8ae43dfa-116d-40ba-a246-0cea7c793a16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:23.219705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecb387-e399-4be4-9187-cfa926dbb0e4 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:23.228299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bdb9e-1832-42af-98ba-96f2b74182ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:23.229073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bdb9e-1832-42af-98ba-96f2b74182ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:23.230914 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bdb9e-1832-42af-98ba-96f2b74182ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:23.232279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bdb9e-1832-42af-98ba-96f2b74182ad admin admin] PATH_INFO: `/v3/users/9126df38c50e4ade847c4ab65c6c4143` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:23.238062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bdb9e-1832-42af-98ba-96f2b74182ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9126df38c50e4ade847c4ab65c6c4143)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:23.241396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bdb9e-1832-42af-98ba-96f2b74182ad admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:23.266027 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae43dfa-116d-40ba-a246-0cea7c793a16 service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:23.275392 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12592-8808-4818-8013-3959609380e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:23.276255 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12592-8808-4818-8013-3959609380e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:23.276962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12592-8808-4818-8013-3959609380e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:23.277445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12592-8808-4818-8013-3959609380e2 admin admin] PATH_INFO: `/v3/projects/4891670c5e6042d79582bb31eefb869b` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:23.279661 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12592-8808-4818-8013-3959609380e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4891670c5e6042d79582bb31eefb869b)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:23.282734 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12592-8808-4818-8013-3959609380e2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:23.395793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-de7bdb9e-1832-42af-98ba-96f2b74182ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9126df38c50e4ade847c4ab65c6c4143'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:23.413265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8e12592-8808-4818-8013-3959609380e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4891670c5e6042d79582bb31eefb869b', 'request_id': 'req-b8e12592-8808-4818-8013-3959609380e2'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:23.437600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8e12592-8808-4818-8013-3959609380e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4891670c5e6042d79582bb31eefb869b', 'request_id': 'req-b8e12592-8808-4818-8013-3959609380e2'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:23.449195 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-de7bdb9e-1832-42af-98ba-96f2b74182ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9126df38c50e4ade847c4ab65c6c4143'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:23.452398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-de7bdb9e-1832-42af-98ba-96f2b74182ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9126df38c50e4ade847c4ab65c6c4143'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:23.454933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-de7bdb9e-1832-42af-98ba-96f2b74182ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9126df38c50e4ade847c4ab65c6c4143'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:23.460821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8e12592-8808-4818-8013-3959609380e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4891670c5e6042d79582bb31eefb869b', 'request_id': 'req-b8e12592-8808-4818-8013-3959609380e2'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:23.488918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-de7bdb9e-1832-42af-98ba-96f2b74182ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9126df38c50e4ade847c4ab65c6c4143'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:23.495819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8e12592-8808-4818-8013-3959609380e2 admin admin] The token cache is being invalidate because project 4891670c5e6042d79582bb31eefb869b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:23.498417 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8e12592-8808-4818-8013-3959609380e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:23.499533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8e12592-8808-4818-8013-3959609380e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:23.508042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 919/1832] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:23 2022] DELETE /identity/v3/projects/4891670c5e6042d79582bb31eefb869b => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:23.523532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38630ac3-acd5-488e-abc8-6beee109b323 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:23.524707 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38630ac3-acd5-488e-abc8-6beee109b323 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:23.524997 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38630ac3-acd5-488e-abc8-6beee109b323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:23.571066 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 914/1833] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:22 2022] DELETE /identity/v3/users/9126df38c50e4ade847c4ab65c6c4143 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:23.576163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb37e0-4703-4a20-80b9-419e644c4ce9 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:23.577517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb37e0-4703-4a20-80b9-419e644c4ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:23.577979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb37e0-4703-4a20-80b9-419e644c4ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:23.605645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-38630ac3-acd5-488e-abc8-6beee109b323 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:23.618445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-38630ac3-acd5-488e-abc8-6beee109b323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:23.635541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-3dfb37e0-4703-4a20-80b9-419e644c4ce9 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:23.638715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3dfb37e0-4703-4a20-80b9-419e644c4ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:23.767519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:23.809107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 915/1834] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:23.884014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 920/1835] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:23.895850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e69675-6677-4c9e-a3d2-1b69667e9ef4 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:23.896743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e69675-6677-4c9e-a3d2-1b69667e9ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:23.897258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e69675-6677-4c9e-a3d2-1b69667e9ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:23.951456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-82e69675-6677-4c9e-a3d2-1b69667e9ef4 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:23.953163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-82e69675-6677-4c9e-a3d2-1b69667e9ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:23.971805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 916/1836] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:23.972764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38630ac3-acd5-488e-abc8-6beee109b323 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.000543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38630ac3-acd5-488e-abc8-6beee109b323 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.018797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820abf8-a6f1-4ff3-b832-4656e5f2c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.019919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820abf8-a6f1-4ff3-b832-4656e5f2c87c admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.020402 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820abf8-a6f1-4ff3-b832-4656e5f2c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.020814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820abf8-a6f1-4ff3-b832-4656e5f2c87c admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.022936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820abf8-a6f1-4ff3-b832-4656e5f2c87c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:24.023473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820abf8-a6f1-4ff3-b832-4656e5f2c87c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.027836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820abf8-a6f1-4ff3-b832-4656e5f2c87c admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.036221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e69675-6677-4c9e-a3d2-1b69667e9ef4 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.038771 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-82e69675-6677-4c9e-a3d2-1b69667e9ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:24.078537 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 921/1837] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:24.081357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820abf8-a6f1-4ff3-b832-4656e5f2c87c admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.109332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820abf8-a6f1-4ff3-b832-4656e5f2c87c admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.117839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a81c43-ea69-47b1-8fc8-fe809ef3c635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.119401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a81c43-ea69-47b1-8fc8-fe809ef3c635 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.120074 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a81c43-ea69-47b1-8fc8-fe809ef3c635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.120657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a81c43-ea69-47b1-8fc8-fe809ef3c635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.121999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a81c43-ea69-47b1-8fc8-fe809ef3c635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.125191 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a81c43-ea69-47b1-8fc8-fe809ef3c635 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.163536 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:24.203841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e69675-6677-4c9e-a3d2-1b69667e9ef4 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.208757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8767ce-7033-45fb-9a1e-02876a4719fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.209417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8767ce-7033-45fb-9a1e-02876a4719fa service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.209771 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8767ce-7033-45fb-9a1e-02876a4719fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.210045 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8767ce-7033-45fb-9a1e-02876a4719fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.218434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 922/1838] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:24 2022] POST /identity/v3/projects => generated 401 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:24.222212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8767ce-7033-45fb-9a1e-02876a4719fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.223147 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a81c43-ea69-47b1-8fc8-fe809ef3c635 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.223688 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8767ce-7033-45fb-9a1e-02876a4719fa service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.238956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 917/1839] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:24.403553 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a81c43-ea69-47b1-8fc8-fe809ef3c635 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.411094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccce08-521c-4c76-a262-b4f522385831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.412119 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccce08-521c-4c76-a262-b4f522385831 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.412538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccce08-521c-4c76-a262-b4f522385831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.412912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccce08-521c-4c76-a262-b4f522385831 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.413827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccce08-521c-4c76-a262-b4f522385831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.416396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccce08-521c-4c76-a262-b4f522385831 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.462221 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 923/1840] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:24 2022] POST /identity/v3/users => generated 301 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:24.462886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8767ce-7033-45fb-9a1e-02876a4719fa service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.484253 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8767ce-7033-45fb-9a1e-02876a4719fa service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.491721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e659-abab-42e4-93a5-d690f97d0dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.493061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e659-abab-42e4-93a5-d690f97d0dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.493760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e659-abab-42e4-93a5-d690f97d0dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.494519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e659-abab-42e4-93a5-d690f97d0dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.495891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e659-abab-42e4-93a5-d690f97d0dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.498762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e659-abab-42e4-93a5-d690f97d0dd1 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.519917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccce08-521c-4c76-a262-b4f522385831 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.533007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 918/1841] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:16:24.540860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccce08-521c-4c76-a262-b4f522385831 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.547434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d94bc6-99d2-4db8-8e1c-28fc7a2976a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.548780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d94bc6-99d2-4db8-8e1c-28fc7a2976a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.549864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d94bc6-99d2-4db8-8e1c-28fc7a2976a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.550523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d94bc6-99d2-4db8-8e1c-28fc7a2976a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.551575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d94bc6-99d2-4db8-8e1c-28fc7a2976a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.560651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d94bc6-99d2-4db8-8e1c-28fc7a2976a3 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.594097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e659-abab-42e4-93a5-d690f97d0dd1 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.596344 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 924/1842] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:24.616605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e659-abab-42e4-93a5-d690f97d0dd1 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.636450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d4849-8ba7-4b33-b49e-566ede1b82ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.637858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d4849-8ba7-4b33-b49e-566ede1b82ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.638371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d4849-8ba7-4b33-b49e-566ede1b82ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.639527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d4849-8ba7-4b33-b49e-566ede1b82ff admin admin] PATH_INFO: `/v3/projects/feba48b666c84e3098cc83f7d9dd39ef/users/f62cd2a7b56a45899b95c8f85f9ad1b7/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.672678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d4849-8ba7-4b33-b49e-566ede1b82ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=feba48b666c84e3098cc83f7d9dd39ef, user_id=f62cd2a7b56a45899b95c8f85f9ad1b7, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.677474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d4849-8ba7-4b33-b49e-566ede1b82ff admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.766040 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0691a-f1d0-453b-b5cf-db5c56cd60e6 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.766833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0691a-f1d0-453b-b5cf-db5c56cd60e6 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.767705 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0691a-f1d0-453b-b5cf-db5c56cd60e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.776924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 919/1843] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:24 2022] PUT /identity/v3/projects/feba48b666c84e3098cc83f7d9dd39ef/users/f62cd2a7b56a45899b95c8f85f9ad1b7/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:24.858034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-70e0691a-f1d0-453b-b5cf-db5c56cd60e6 None None] MFA Rules not processed for user `f62cd2a7b56a45899b95c8f85f9ad1b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:24.859918 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-70e0691a-f1d0-453b-b5cf-db5c56cd60e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:25.047097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 925/1844] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:24 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:25.049626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d4849-8ba7-4b33-b49e-566ede1b82ff admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:25.240638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d4849-8ba7-4b33-b49e-566ede1b82ff admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:25.268034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf18837-04ca-48ae-b183-e633a7803635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:25.268842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18837-04ca-48ae-b183-e633a7803635 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.268949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18837-04ca-48ae-b183-e633a7803635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.269188 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18837-04ca-48ae-b183-e633a7803635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.272609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf18837-04ca-48ae-b183-e633a7803635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:25.277594 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf18837-04ca-48ae-b183-e633a7803635 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:25.399268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 920/1845] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:25 2022] POST /identity/v3/projects => generated 401 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:25.400895 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0691a-f1d0-453b-b5cf-db5c56cd60e6 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:25.431815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0691a-f1d0-453b-b5cf-db5c56cd60e6 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:25.447632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:25.599005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0742f4-8288-4372-9c53-199d075c3844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:25.599880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0742f4-8288-4372-9c53-199d075c3844 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.600273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0742f4-8288-4372-9c53-199d075c3844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.600625 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0742f4-8288-4372-9c53-199d075c3844 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.602522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0742f4-8288-4372-9c53-199d075c3844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:25.608493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0742f4-8288-4372-9c53-199d075c3844 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:25.668547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 926/1846] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:25 2022] POST /identity/v3/users => generated 307 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:25.669476 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf18837-04ca-48ae-b183-e633a7803635 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:25.682166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf18837-04ca-48ae-b183-e633a7803635 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:25.699347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31889a6f-ae2c-4754-99ba-e3ad28e68fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:25.707645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31889a6f-ae2c-4754-99ba-e3ad28e68fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.713709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31889a6f-ae2c-4754-99ba-e3ad28e68fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.714423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31889a6f-ae2c-4754-99ba-e3ad28e68fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.715394 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31889a6f-ae2c-4754-99ba-e3ad28e68fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:25.717804 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31889a6f-ae2c-4754-99ba-e3ad28e68fc3 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:25.761357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 921/1847] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:25.774247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0742f4-8288-4372-9c53-199d075c3844 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:25.794645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0742f4-8288-4372-9c53-199d075c3844 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:25.809857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d1072-7b6a-4991-88da-8f500ea40434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:25.810715 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d1072-7b6a-4991-88da-8f500ea40434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.811057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d1072-7b6a-4991-88da-8f500ea40434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.826089 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d1072-7b6a-4991-88da-8f500ea40434 admin admin] PATH_INFO: `/v3/projects/54f3e2e63b454813b5248e80595abc29/users/814168304121487c9b41494924d329b5/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.878198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d1072-7b6a-4991-88da-8f500ea40434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f3e2e63b454813b5248e80595abc29, user_id=814168304121487c9b41494924d329b5, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:25.884014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d1072-7b6a-4991-88da-8f500ea40434 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:25.925256 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 927/1848] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:25 2022] PUT /identity/v3/projects/54f3e2e63b454813b5248e80595abc29/users/814168304121487c9b41494924d329b5/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:25.929808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31889a6f-ae2c-4754-99ba-e3ad28e68fc3 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:25.952186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31889a6f-ae2c-4754-99ba-e3ad28e68fc3 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:26.168538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc80e8-9074-44ca-9bfd-4d5497a0faeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:26.170012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc80e8-9074-44ca-9bfd-4d5497a0faeb admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.171011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc80e8-9074-44ca-9bfd-4d5497a0faeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.171518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc80e8-9074-44ca-9bfd-4d5497a0faeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.172492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc80e8-9074-44ca-9bfd-4d5497a0faeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:26.174512 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc80e8-9074-44ca-9bfd-4d5497a0faeb admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:26.223414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d1072-7b6a-4991-88da-8f500ea40434 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:26.225356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-495d1072-7b6a-4991-88da-8f500ea40434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:26.233293 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 922/1849] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:26.235423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc80e8-9074-44ca-9bfd-4d5497a0faeb admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:26.296938 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc80e8-9074-44ca-9bfd-4d5497a0faeb admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:26.298222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d1072-7b6a-4991-88da-8f500ea40434 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:26.314501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60401791-355b-48a1-96e2-3e905cc5c9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:26.316087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60401791-355b-48a1-96e2-3e905cc5c9af admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.317089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60401791-355b-48a1-96e2-3e905cc5c9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.317402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60401791-355b-48a1-96e2-3e905cc5c9af admin admin] PATH_INFO: `/v3/projects/54f3e2e63b454813b5248e80595abc29/users/814168304121487c9b41494924d329b5/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.331821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:26.332271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60401791-355b-48a1-96e2-3e905cc5c9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f3e2e63b454813b5248e80595abc29, user_id=814168304121487c9b41494924d329b5, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:26.332496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.332775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.333046 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] PATH_INFO: `/v3/projects/f7a5039c338f4777958a6cfee3a42b6d` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.335119 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60401791-355b-48a1-96e2-3e905cc5c9af admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:26.339026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a5039c338f4777958a6cfee3a42b6d)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:26.357862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:26.359280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:26.376272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 923/1850] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:26 2022] PUT /identity/v3/projects/54f3e2e63b454813b5248e80595abc29/users/814168304121487c9b41494924d329b5/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:26.391013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68432f8d-14be-4286-a98c-cdc1214ee540 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.391348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68432f8d-14be-4286-a98c-cdc1214ee540 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.391639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68432f8d-14be-4286-a98c-cdc1214ee540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.457765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-68432f8d-14be-4286-a98c-cdc1214ee540 None None] MFA Rules not processed for user `814168304121487c9b41494924d329b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:26.461102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-68432f8d-14be-4286-a98c-cdc1214ee540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:26.488182 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a5039c338f4777958a6cfee3a42b6d', 'request_id': 'req-65649051-6dcf-42a6-ba79-a752a5a9f5bd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:26.510889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a5039c338f4777958a6cfee3a42b6d', 'request_id': 'req-65649051-6dcf-42a6-ba79-a752a5a9f5bd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:26.537352 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a5039c338f4777958a6cfee3a42b6d', 'request_id': 'req-65649051-6dcf-42a6-ba79-a752a5a9f5bd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:26.564707 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] The token cache is being invalidate because project f7a5039c338f4777958a6cfee3a42b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:26.565048 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:26.569241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:26.571279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 928/1851] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:26 2022] DELETE /identity/v3/projects/f7a5039c338f4777958a6cfee3a42b6d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:26.578479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:26.581794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:26.654738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 924/1852] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:26 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:26.672272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68432f8d-14be-4286-a98c-cdc1214ee540 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:26.674018 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-68432f8d-14be-4286-a98c-cdc1214ee540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:26.682440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:26.694438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65649051-6dcf-42a6-ba79-a752a5a9f5bd admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:26.716500 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:26.717161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.717452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.717831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] PATH_INFO: `/v3/users/aa4a08ada4864e1fb8f63bbe1ba0b256` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.720908 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4a08ada4864e1fb8f63bbe1ba0b256)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:26.722970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:26.792326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68432f8d-14be-4286-a98c-cdc1214ee540 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:26.799160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a82794-2a81-4286-a7a4-3dfeb5718469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:26.800636 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a82794-2a81-4286-a7a4-3dfeb5718469 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.801192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a82794-2a81-4286-a7a4-3dfeb5718469 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.802894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a82794-2a81-4286-a7a4-3dfeb5718469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.816737 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a82794-2a81-4286-a7a4-3dfeb5718469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:26.820131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a82794-2a81-4286-a7a4-3dfeb5718469 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:26.840216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4a08ada4864e1fb8f63bbe1ba0b256'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:26.859404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4a08ada4864e1fb8f63bbe1ba0b256'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:26.860330 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 925/1853] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:26 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:16:26.861356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4a08ada4864e1fb8f63bbe1ba0b256'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:26.863465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a82794-2a81-4286-a7a4-3dfeb5718469 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:26.868074 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-34a82794-2a81-4286-a7a4-3dfeb5718469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:26.883958 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4a08ada4864e1fb8f63bbe1ba0b256'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:26.917298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a82794-2a81-4286-a7a4-3dfeb5718469 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:26.931736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fedec7-7916-4e47-8f1b-f23cba6e828a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:26.933447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fedec7-7916-4e47-8f1b-f23cba6e828a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.933845 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fedec7-7916-4e47-8f1b-f23cba6e828a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.934118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fedec7-7916-4e47-8f1b-f23cba6e828a admin admin] PATH_INFO: `/v3/users/696c0c009eda4a9b88bbaca54a079e4a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.935884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fedec7-7916-4e47-8f1b-f23cba6e828a admin admin] RBAC: Authorizing `identity:delete_user(user_id=696c0c009eda4a9b88bbaca54a079e4a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:26.943580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fedec7-7916-4e47-8f1b-f23cba6e828a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:26.968108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4a08ada4864e1fb8f63bbe1ba0b256'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:27.016209 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-43fedec7-7916-4e47-8f1b-f23cba6e828a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696c0c009eda4a9b88bbaca54a079e4a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:27.017672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 929/1854] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:26 2022] DELETE /identity/v3/users/aa4a08ada4864e1fb8f63bbe1ba0b256 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:27.049965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-43fedec7-7916-4e47-8f1b-f23cba6e828a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696c0c009eda4a9b88bbaca54a079e4a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:27.051734 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-43fedec7-7916-4e47-8f1b-f23cba6e828a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696c0c009eda4a9b88bbaca54a079e4a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:27.053669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-43fedec7-7916-4e47-8f1b-f23cba6e828a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696c0c009eda4a9b88bbaca54a079e4a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:27.067613 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:27.069615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:27.075402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-43fedec7-7916-4e47-8f1b-f23cba6e828a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696c0c009eda4a9b88bbaca54a079e4a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:27.107849 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:27.133637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 926/1855] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:26 2022] DELETE /identity/v3/users/696c0c009eda4a9b88bbaca54a079e4a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:27.138132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7c15-501e-42c2-9519-f9ff6b18be17 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:27.139107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7c15-501e-42c2-9519-f9ff6b18be17 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:27.139383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7c15-501e-42c2-9519-f9ff6b18be17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:27.177368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-17cf7c15-501e-42c2-9519-f9ff6b18be17 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:27.178468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-17cf7c15-501e-42c2-9519-f9ff6b18be17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:27.265374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de121e08-7b2b-4598-ae59-cc5c7cf321ce admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:27.292875 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 927/1856] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:27.308073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf7c15-501e-42c2-9519-f9ff6b18be17 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:27.317517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-17cf7c15-501e-42c2-9519-f9ff6b18be17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:27.380126 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f9cfa-d374-4d10-96c3-b6943a66ae6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:27.382860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f9cfa-d374-4d10-96c3-b6943a66ae6c service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:27.383135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f9cfa-d374-4d10-96c3-b6943a66ae6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:27.383399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f9cfa-d374-4d10-96c3-b6943a66ae6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:27.389456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f05f9cfa-d374-4d10-96c3-b6943a66ae6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:27.553153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:27.555432 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf7c15-501e-42c2-9519-f9ff6b18be17 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:27.571475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3bd29-f875-4ee9-bfd6-1ce7430718cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:27.571475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3bd29-f875-4ee9-bfd6-1ce7430718cb service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:27.571734 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3bd29-f875-4ee9-bfd6-1ce7430718cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:27.581400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3bd29-f875-4ee9-bfd6-1ce7430718cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:27.586526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f9cfa-d374-4d10-96c3-b6943a66ae6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:27.588459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f9cfa-d374-4d10-96c3-b6943a66ae6c service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:27.609330 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3bd29-f875-4ee9-bfd6-1ce7430718cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:27.611316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3bd29-f875-4ee9-bfd6-1ce7430718cb service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:27.614620 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 930/1857] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:27 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:27.639242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 928/1858] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:28.033317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f9cfa-d374-4d10-96c3-b6943a66ae6c service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.035280 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f05f9cfa-d374-4d10-96c3-b6943a66ae6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:28.059070 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f9cfa-d374-4d10-96c3-b6943a66ae6c service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.066218 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8682c-c436-449d-b4fa-28554e920698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.067422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8682c-c436-449d-b4fa-28554e920698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.067422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8682c-c436-449d-b4fa-28554e920698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.067915 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8682c-c436-449d-b4fa-28554e920698 admin admin] PATH_INFO: `/v3/projects/d7e5397b94a14030ba0a65f8f1566b83` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.069550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8682c-c436-449d-b4fa-28554e920698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e5397b94a14030ba0a65f8f1566b83)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.072494 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8682c-c436-449d-b4fa-28554e920698 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.211005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8aa8682c-c436-449d-b4fa-28554e920698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e5397b94a14030ba0a65f8f1566b83', 'request_id': 'req-8aa8682c-c436-449d-b4fa-28554e920698'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:28.222111 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8aa8682c-c436-449d-b4fa-28554e920698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e5397b94a14030ba0a65f8f1566b83', 'request_id': 'req-8aa8682c-c436-449d-b4fa-28554e920698'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:28.239061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8aa8682c-c436-449d-b4fa-28554e920698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e5397b94a14030ba0a65f8f1566b83', 'request_id': 'req-8aa8682c-c436-449d-b4fa-28554e920698'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:28.262349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8aa8682c-c436-449d-b4fa-28554e920698 admin admin] The token cache is being invalidate because project d7e5397b94a14030ba0a65f8f1566b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:28.263248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8aa8682c-c436-449d-b4fa-28554e920698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:28.265134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8aa8682c-c436-449d-b4fa-28554e920698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:28.273730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 931/1859] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:28 2022] DELETE /identity/v3/projects/d7e5397b94a14030ba0a65f8f1566b83 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:28.275152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352ed32-48b1-4a5a-a0bc-7e79e45ee6a5 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.275470 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352ed32-48b1-4a5a-a0bc-7e79e45ee6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.275913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352ed32-48b1-4a5a-a0bc-7e79e45ee6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.327240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-7352ed32-48b1-4a5a-a0bc-7e79e45ee6a5 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:28.329592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7352ed32-48b1-4a5a-a0bc-7e79e45ee6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:28.421672 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 929/1860] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:28.424534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c141595-889b-4cc4-8042-a1f5fdfe1fb3 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.424814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c141595-889b-4cc4-8042-a1f5fdfe1fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.425088 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c141595-889b-4cc4-8042-a1f5fdfe1fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.454180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7c141595-889b-4cc4-8042-a1f5fdfe1fb3 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:28.455813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7c141595-889b-4cc4-8042-a1f5fdfe1fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:28.468877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 932/1861] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:28.473714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352ed32-48b1-4a5a-a0bc-7e79e45ee6a5 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.483947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352ed32-48b1-4a5a-a0bc-7e79e45ee6a5 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.490450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be607fe-97eb-40ae-aec7-eb9aabe88fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.491222 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be607fe-97eb-40ae-aec7-eb9aabe88fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.491349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be607fe-97eb-40ae-aec7-eb9aabe88fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.491720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be607fe-97eb-40ae-aec7-eb9aabe88fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.492536 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be607fe-97eb-40ae-aec7-eb9aabe88fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:28.493253 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be607fe-97eb-40ae-aec7-eb9aabe88fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.494657 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be607fe-97eb-40ae-aec7-eb9aabe88fb0 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.511303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 930/1862] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:28.515524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c141595-889b-4cc4-8042-a1f5fdfe1fb3 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.528337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c141595-889b-4cc4-8042-a1f5fdfe1fb3 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.534875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25417402-40fa-4a33-a106-4c78c3ac1c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.535632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25417402-40fa-4a33-a106-4c78c3ac1c3c admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.535996 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25417402-40fa-4a33-a106-4c78c3ac1c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.536406 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25417402-40fa-4a33-a106-4c78c3ac1c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.537568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25417402-40fa-4a33-a106-4c78c3ac1c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.539397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25417402-40fa-4a33-a106-4c78c3ac1c3c admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.576101 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be607fe-97eb-40ae-aec7-eb9aabe88fb0 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.578146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7be607fe-97eb-40ae-aec7-eb9aabe88fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:28.588428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 933/1863] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:28 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:28.593099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25417402-40fa-4a33-a106-4c78c3ac1c3c admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.597362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be607fe-97eb-40ae-aec7-eb9aabe88fb0 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.649471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:28.695704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25417402-40fa-4a33-a106-4c78c3ac1c3c admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.696235 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f042c-1fa6-44c9-95af-d9cd91460807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.697001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f042c-1fa6-44c9-95af-d9cd91460807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.697342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f042c-1fa6-44c9-95af-d9cd91460807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.697651 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f042c-1fa6-44c9-95af-d9cd91460807 admin admin] PATH_INFO: `/v3/projects/304fd3dedf7741f397b93afd77e207d4` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.699030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f042c-1fa6-44c9-95af-d9cd91460807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=304fd3dedf7741f397b93afd77e207d4)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.701457 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f042c-1fa6-44c9-95af-d9cd91460807 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.712932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4b616-34c8-4dcb-b5f0-195e5a5e1d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.713695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4b616-34c8-4dcb-b5f0-195e5a5e1d78 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.714306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4b616-34c8-4dcb-b5f0-195e5a5e1d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.714753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4b616-34c8-4dcb-b5f0-195e5a5e1d78 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.715499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4b616-34c8-4dcb-b5f0-195e5a5e1d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.719706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4b616-34c8-4dcb-b5f0-195e5a5e1d78 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.753536 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 934/1864] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:28 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:28.754949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f2c53-c135-4d1c-b4e1-1c2bdc60ed08 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.755235 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f2c53-c135-4d1c-b4e1-1c2bdc60ed08 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.755511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f2c53-c135-4d1c-b4e1-1c2bdc60ed08 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.758584 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 935/1865] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:28.759734 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f2c53-c135-4d1c-b4e1-1c2bdc60ed08 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.782440 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e06f042c-1fa6-44c9-95af-d9cd91460807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '304fd3dedf7741f397b93afd77e207d4', 'request_id': 'req-e06f042c-1fa6-44c9-95af-d9cd91460807'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:28.799555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e06f042c-1fa6-44c9-95af-d9cd91460807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '304fd3dedf7741f397b93afd77e207d4', 'request_id': 'req-e06f042c-1fa6-44c9-95af-d9cd91460807'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:28.807379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:28.827757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e06f042c-1fa6-44c9-95af-d9cd91460807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '304fd3dedf7741f397b93afd77e207d4', 'request_id': 'req-e06f042c-1fa6-44c9-95af-d9cd91460807'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:28.841285 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e06f042c-1fa6-44c9-95af-d9cd91460807 admin admin] The token cache is being invalidate because project 304fd3dedf7741f397b93afd77e207d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:28.841597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e06f042c-1fa6-44c9-95af-d9cd91460807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:28.842232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e06f042c-1fa6-44c9-95af-d9cd91460807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:28.847389 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 931/1866] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:28 2022] DELETE /identity/v3/projects/304fd3dedf7741f397b93afd77e207d4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:28.849377 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e06e5-20d9-4982-ad40-3aea97157fea None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.849661 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e06e5-20d9-4982-ad40-3aea97157fea None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.849929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e06e5-20d9-4982-ad40-3aea97157fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.854969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f2c53-c135-4d1c-b4e1-1c2bdc60ed08 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.861810 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9579203-8b99-45d1-a973-4a2fb1e6d26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.862693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9579203-8b99-45d1-a973-4a2fb1e6d26f admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.863385 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9579203-8b99-45d1-a973-4a2fb1e6d26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.863791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9579203-8b99-45d1-a973-4a2fb1e6d26f admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.864738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9579203-8b99-45d1-a973-4a2fb1e6d26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.866707 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9579203-8b99-45d1-a973-4a2fb1e6d26f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.875511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d82e06e5-20d9-4982-ad40-3aea97157fea None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:28.877442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d82e06e5-20d9-4982-ad40-3aea97157fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:28.880107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 936/1867] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:28.881290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9579203-8b99-45d1-a973-4a2fb1e6d26f admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.883183 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b9579203-8b99-45d1-a973-4a2fb1e6d26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:28.900793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9579203-8b99-45d1-a973-4a2fb1e6d26f admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.908310 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.909519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.909966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.910402 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] PATH_INFO: `/v3/users/b83a3ea2a0de4e9fb8c8353c50b33248` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.912269 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83a3ea2a0de4e9fb8c8353c50b33248)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.914954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.984324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83a3ea2a0de4e9fb8c8353c50b33248'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:28.991524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 932/1868] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:16:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:28.992454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e06e5-20d9-4982-ad40-3aea97157fea None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.995162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83a3ea2a0de4e9fb8c8353c50b33248'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:28.995951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83a3ea2a0de4e9fb8c8353c50b33248'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:28.996326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d82e06e5-20d9-4982-ad40-3aea97157fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:29.007164 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83a3ea2a0de4e9fb8c8353c50b33248'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:29.014854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e06e5-20d9-4982-ad40-3aea97157fea None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.020533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea051a96-0066-4cae-90a8-3909901468b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.021628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea051a96-0066-4cae-90a8-3909901468b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.021890 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea051a96-0066-4cae-90a8-3909901468b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.022164 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea051a96-0066-4cae-90a8-3909901468b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.022804 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea051a96-0066-4cae-90a8-3909901468b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.023202 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83a3ea2a0de4e9fb8c8353c50b33248'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:29.024691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea051a96-0066-4cae-90a8-3909901468b7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.032650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 937/1869] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:28 2022] DELETE /identity/v3/users/b83a3ea2a0de4e9fb8c8353c50b33248 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:29.049405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 933/1870] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:29.059137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:29.060691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:29.076849 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea051a96-0066-4cae-90a8-3909901468b7 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:29.079942 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ea051a96-0066-4cae-90a8-3909901468b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:29.142646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea051a96-0066-4cae-90a8-3909901468b7 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.181160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18086bb-b682-4e51-9556-c39dc25dba8c admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.188145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ddbb2-bc8c-4548-ad7e-3c4622faf5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.191469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ddbb2-bc8c-4548-ad7e-3c4622faf5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.191829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ddbb2-bc8c-4548-ad7e-3c4622faf5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.192246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ddbb2-bc8c-4548-ad7e-3c4622faf5cd admin admin] PATH_INFO: `/v3/projects/945e510dd29647b09127e9e2147b8339/users/81f07b055309485aa5a854a4df910f3f/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.205136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:29.224759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ddbb2-bc8c-4548-ad7e-3c4622faf5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=945e510dd29647b09127e9e2147b8339, user_id=81f07b055309485aa5a854a4df910f3f, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.230067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ddbb2-bc8c-4548-ad7e-3c4622faf5cd admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.252967 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 938/1871] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:29 2022] PUT /identity/v3/projects/945e510dd29647b09127e9e2147b8339/users/81f07b055309485aa5a854a4df910f3f/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:29.267681 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3463c0-cc88-40f9-ad39-726cfb3ab611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.268370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3463c0-cc88-40f9-ad39-726cfb3ab611 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.268634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3463c0-cc88-40f9-ad39-726cfb3ab611 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.268920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3463c0-cc88-40f9-ad39-726cfb3ab611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.271880 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-5c3463c0-cc88-40f9-ad39-726cfb3ab611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:29.280272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0ca0-735b-440e-a83b-ceed4a1a21b2 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.280848 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0ca0-735b-440e-a83b-ceed4a1a21b2 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.281446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0ca0-735b-440e-a83b-ceed4a1a21b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.291176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3463c0-cc88-40f9-ad39-726cfb3ab611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.295036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3463c0-cc88-40f9-ad39-726cfb3ab611 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.310026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 934/1872] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:29.352877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-b1fc0ca0-735b-440e-a83b-ceed4a1a21b2 None None] MFA Rules not processed for user `81f07b055309485aa5a854a4df910f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:29.354229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b1fc0ca0-735b-440e-a83b-ceed4a1a21b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:29.366105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:29.482619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 939/1873] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:29.554165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3463c0-cc88-40f9-ad39-726cfb3ab611 service nova] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:29.555719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0ca0-735b-440e-a83b-ceed4a1a21b2 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:29.557255 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b1fc0ca0-735b-440e-a83b-ceed4a1a21b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:29.558257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-5c3463c0-cc88-40f9-ad39-726cfb3ab611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:29.578704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3463c0-cc88-40f9-ad39-726cfb3ab611 service nova] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.668218 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0ca0-735b-440e-a83b-ceed4a1a21b2 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.675695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06260b4a-96b1-4c4d-8c0d-61815b3040f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.676970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06260b4a-96b1-4c4d-8c0d-61815b3040f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.677372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06260b4a-96b1-4c4d-8c0d-61815b3040f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.677647 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06260b4a-96b1-4c4d-8c0d-61815b3040f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.691747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06260b4a-96b1-4c4d-8c0d-61815b3040f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.694429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06260b4a-96b1-4c4d-8c0d-61815b3040f2 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.709820 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 940/1874] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:29.711732 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208f493-71d3-4b17-81af-bf2939ffcfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.712370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208f493-71d3-4b17-81af-bf2939ffcfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.712637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208f493-71d3-4b17-81af-bf2939ffcfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.712904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208f493-71d3-4b17-81af-bf2939ffcfb7 admin admin] PATH_INFO: `/v3/projects/6c5633bdc12d406eb2146fe90d9ebc9b` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.714404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208f493-71d3-4b17-81af-bf2939ffcfb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5633bdc12d406eb2146fe90d9ebc9b)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.716303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208f493-71d3-4b17-81af-bf2939ffcfb7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.730401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06260b4a-96b1-4c4d-8c0d-61815b3040f2 service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:29.752767 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06260b4a-96b1-4c4d-8c0d-61815b3040f2 service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.758084 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f4e03-d2aa-462a-aaac-908657ebbca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.758742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f4e03-d2aa-462a-aaac-908657ebbca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.759020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f4e03-d2aa-462a-aaac-908657ebbca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.759357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f4e03-d2aa-462a-aaac-908657ebbca7 admin admin] PATH_INFO: `/v3/users/81f07b055309485aa5a854a4df910f3f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.760490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f4e03-d2aa-462a-aaac-908657ebbca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f07b055309485aa5a854a4df910f3f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.763077 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f4e03-d2aa-462a-aaac-908657ebbca7 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.827110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ca3f4e03-d2aa-462a-aaac-908657ebbca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f07b055309485aa5a854a4df910f3f'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:29.839294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-9208f493-71d3-4b17-81af-bf2939ffcfb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5633bdc12d406eb2146fe90d9ebc9b', 'request_id': 'req-9208f493-71d3-4b17-81af-bf2939ffcfb7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:29.855402 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ca3f4e03-d2aa-462a-aaac-908657ebbca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f07b055309485aa5a854a4df910f3f'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:29.856518 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ca3f4e03-d2aa-462a-aaac-908657ebbca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f07b055309485aa5a854a4df910f3f'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:29.863088 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-9208f493-71d3-4b17-81af-bf2939ffcfb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5633bdc12d406eb2146fe90d9ebc9b', 'request_id': 'req-9208f493-71d3-4b17-81af-bf2939ffcfb7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:29.873794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ca3f4e03-d2aa-462a-aaac-908657ebbca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f07b055309485aa5a854a4df910f3f'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:29.876099 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-9208f493-71d3-4b17-81af-bf2939ffcfb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5633bdc12d406eb2146fe90d9ebc9b', 'request_id': 'req-9208f493-71d3-4b17-81af-bf2939ffcfb7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:29.899368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-9208f493-71d3-4b17-81af-bf2939ffcfb7 admin admin] The token cache is being invalidate because project 6c5633bdc12d406eb2146fe90d9ebc9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:29.899988 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-9208f493-71d3-4b17-81af-bf2939ffcfb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:29.900834 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-9208f493-71d3-4b17-81af-bf2939ffcfb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:29.903905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 935/1875] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:29 2022] DELETE /identity/v3/projects/6c5633bdc12d406eb2146fe90d9ebc9b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:29.904773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ca3f4e03-d2aa-462a-aaac-908657ebbca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f07b055309485aa5a854a4df910f3f'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:29.909365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145f9f-68c5-4453-b197-cb2e867b3c7f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.913389 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145f9f-68c5-4453-b197-cb2e867b3c7f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.913730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145f9f-68c5-4453-b197-cb2e867b3c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.916024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 941/1876] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:29 2022] DELETE /identity/v3/users/81f07b055309485aa5a854a4df910f3f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:29.920731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712442e5-c87f-4407-a6f0-cc0f7da6a745 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.921020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712442e5-c87f-4407-a6f0-cc0f7da6a745 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.921357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712442e5-c87f-4407-a6f0-cc0f7da6a745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.954103 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-712442e5-c87f-4407-a6f0-cc0f7da6a745 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:29.954103 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-712442e5-c87f-4407-a6f0-cc0f7da6a745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:29.973048 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-f6145f9f-68c5-4453-b197-cb2e867b3c7f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:29.977444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f6145f9f-68c5-4453-b197-cb2e867b3c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:29.993622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:30.065421 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:30.092606 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 936/1877] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:30.099765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46086c-661e-4c1c-b2ca-030f7af6577a None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.100274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46086c-661e-4c1c-b2ca-030f7af6577a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.100750 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46086c-661e-4c1c-b2ca-030f7af6577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.106804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 942/1878] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:30.129815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712442e5-c87f-4407-a6f0-cc0f7da6a745 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.133434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-712442e5-c87f-4407-a6f0-cc0f7da6a745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:30.137074 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-bf46086c-661e-4c1c-b2ca-030f7af6577a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:30.138995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-bf46086c-661e-4c1c-b2ca-030f7af6577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:30.154099 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 937/1879] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:30.155095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46086c-661e-4c1c-b2ca-030f7af6577a None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.166136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46086c-661e-4c1c-b2ca-030f7af6577a None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.172358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba59fd9-6960-435c-af16-11832ed632e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.173265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59fd9-6960-435c-af16-11832ed632e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.173957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59fd9-6960-435c-af16-11832ed632e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.174315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59fd9-6960-435c-af16-11832ed632e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.175038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba59fd9-6960-435c-af16-11832ed632e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:30.175399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba59fd9-6960-435c-af16-11832ed632e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.177479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba59fd9-6960-435c-af16-11832ed632e9 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.201401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 938/1880] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:30.205619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba59fd9-6960-435c-af16-11832ed632e9 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.222758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba59fd9-6960-435c-af16-11832ed632e9 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.229888 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0d440-04ae-463e-a3e6-0d8064ce3386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.230557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d440-04ae-463e-a3e6-0d8064ce3386 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.230836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d440-04ae-463e-a3e6-0d8064ce3386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.231107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d440-04ae-463e-a3e6-0d8064ce3386 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.231751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0d440-04ae-463e-a3e6-0d8064ce3386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.234937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0d440-04ae-463e-a3e6-0d8064ce3386 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.238869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712442e5-c87f-4407-a6f0-cc0f7da6a745 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.244512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa654ff-6f94-4dc3-a4c7-faed36c0603d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.245946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa654ff-6f94-4dc3-a4c7-faed36c0603d service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.247020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa654ff-6f94-4dc3-a4c7-faed36c0603d service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.247484 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa654ff-6f94-4dc3-a4c7-faed36c0603d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.265614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa654ff-6f94-4dc3-a4c7-faed36c0603d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.267476 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa654ff-6f94-4dc3-a4c7-faed36c0603d service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.280902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 939/1881] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:30 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:30.284695 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0d440-04ae-463e-a3e6-0d8064ce3386 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.290572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 943/1882] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:30.373714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0d440-04ae-463e-a3e6-0d8064ce3386 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.378449 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65974a-1058-4efc-a218-ff80d596651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.379127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65974a-1058-4efc-a218-ff80d596651e admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.379464 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65974a-1058-4efc-a218-ff80d596651e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.379820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65974a-1058-4efc-a218-ff80d596651e admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.380523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65974a-1058-4efc-a218-ff80d596651e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.382709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65974a-1058-4efc-a218-ff80d596651e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.409253 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 940/1883] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:30 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:30.411091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa654ff-6f94-4dc3-a4c7-faed36c0603d service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.422339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa654ff-6f94-4dc3-a4c7-faed36c0603d service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.428594 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ec0ab-1afc-41d1-9b3f-d5744c3b5ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.429264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ec0ab-1afc-41d1-9b3f-d5744c3b5ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.429508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ec0ab-1afc-41d1-9b3f-d5744c3b5ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.429779 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ec0ab-1afc-41d1-9b3f-d5744c3b5ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.430421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ec0ab-1afc-41d1-9b3f-d5744c3b5ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.432009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ec0ab-1afc-41d1-9b3f-d5744c3b5ea4 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.442823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 944/1884] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:30.447153 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65974a-1058-4efc-a218-ff80d596651e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.458602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65974a-1058-4efc-a218-ff80d596651e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.463793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49dc29-f790-4295-9b65-3873bb94158f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.464803 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49dc29-f790-4295-9b65-3873bb94158f admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.465251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49dc29-f790-4295-9b65-3873bb94158f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.465712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49dc29-f790-4295-9b65-3873bb94158f admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.466235 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49dc29-f790-4295-9b65-3873bb94158f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.468027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49dc29-f790-4295-9b65-3873bb94158f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.481878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 941/1885] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:30.483097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ec0ab-1afc-41d1-9b3f-d5744c3b5ea4 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.493016 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ec0ab-1afc-41d1-9b3f-d5744c3b5ea4 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.497923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2f14d-da0b-4617-a345-d27701d72c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.498569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2f14d-da0b-4617-a345-d27701d72c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.498845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2f14d-da0b-4617-a345-d27701d72c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.499114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2f14d-da0b-4617-a345-d27701d72c8d admin admin] PATH_INFO: `/v3/projects/7a71fab3deb34a86871cda14ff809c13/users/495e6ff211b446fe8827f2e846ca4dfb/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.514829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2f14d-da0b-4617-a345-d27701d72c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a71fab3deb34a86871cda14ff809c13, user_id=495e6ff211b446fe8827f2e846ca4dfb, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.517736 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2f14d-da0b-4617-a345-d27701d72c8d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.534112 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 945/1886] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:30 2022] PUT /identity/v3/projects/7a71fab3deb34a86871cda14ff809c13/users/495e6ff211b446fe8827f2e846ca4dfb/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:30.545050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830c420-7639-438f-b840-e02457c7f16f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.545481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830c420-7639-438f-b840-e02457c7f16f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.545991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830c420-7639-438f-b840-e02457c7f16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.583520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-9830c420-7639-438f-b840-e02457c7f16f None None] MFA Rules not processed for user `495e6ff211b446fe8827f2e846ca4dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:30.584922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-9830c420-7639-438f-b840-e02457c7f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:30.669032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 942/1887] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:30.673623 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2f14d-da0b-4617-a345-d27701d72c8d admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.756144 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2f14d-da0b-4617-a345-d27701d72c8d admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.768018 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae8dc2-8660-4fb3-9643-e6683d2c6541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.768785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8dc2-8660-4fb3-9643-e6683d2c6541 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.769169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8dc2-8660-4fb3-9643-e6683d2c6541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.769724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8dc2-8660-4fb3-9643-e6683d2c6541 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.770512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae8dc2-8660-4fb3-9643-e6683d2c6541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.772754 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae8dc2-8660-4fb3-9643-e6683d2c6541 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.808470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 946/1888] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:30 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:30.812349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830c420-7639-438f-b840-e02457c7f16f None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.824012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830c420-7639-438f-b840-e02457c7f16f None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.844280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:30.856373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae8dc2-8660-4fb3-9643-e6683d2c6541 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.858362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f7ae8dc2-8660-4fb3-9643-e6683d2c6541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:30.885264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:30.900117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18c0ad-8d46-458c-81a4-8dac893c2589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.900877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c0ad-8d46-458c-81a4-8dac893c2589 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.901007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c0ad-8d46-458c-81a4-8dac893c2589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.901307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c0ad-8d46-458c-81a4-8dac893c2589 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.902064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18c0ad-8d46-458c-81a4-8dac893c2589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.904537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18c0ad-8d46-458c-81a4-8dac893c2589 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.929944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 943/1889] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:30 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:30.934370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18c0ad-8d46-458c-81a4-8dac893c2589 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.938263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae8dc2-8660-4fb3-9643-e6683d2c6541 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.943099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db44c37-da3f-42f9-a85e-e879a9d48949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.943747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db44c37-da3f-42f9-a85e-e879a9d48949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.944974 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18c0ad-8d46-458c-81a4-8dac893c2589 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.945448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db44c37-da3f-42f9-a85e-e879a9d48949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.945867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db44c37-da3f-42f9-a85e-e879a9d48949 admin admin] PATH_INFO: `/v3/projects/945e510dd29647b09127e9e2147b8339` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.950290 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb6ff0-7bd8-4730-9b59-38c8a8c4fe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.950689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db44c37-da3f-42f9-a85e-e879a9d48949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945e510dd29647b09127e9e2147b8339)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.951029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb6ff0-7bd8-4730-9b59-38c8a8c4fe41 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.951372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb6ff0-7bd8-4730-9b59-38c8a8c4fe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.951735 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb6ff0-7bd8-4730-9b59-38c8a8c4fe41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.952428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb6ff0-7bd8-4730-9b59-38c8a8c4fe41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.952702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db44c37-da3f-42f9-a85e-e879a9d48949 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.954183 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb6ff0-7bd8-4730-9b59-38c8a8c4fe41 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.973409 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 944/1890] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:30.975986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb6ff0-7bd8-4730-9b59-38c8a8c4fe41 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.986541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb6ff0-7bd8-4730-9b59-38c8a8c4fe41 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.991863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c29fa-6a99-4642-834b-6ff36606e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.992606 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c29fa-6a99-4642-834b-6ff36606e4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.992994 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c29fa-6a99-4642-834b-6ff36606e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.993371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c29fa-6a99-4642-834b-6ff36606e4ab admin admin] PATH_INFO: `/v3/projects/5e180b3e489c4696bb7e420984061650/users/fad8c43da5434bb4aab3d96ceb638de8/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.009149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8db44c37-da3f-42f9-a85e-e879a9d48949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945e510dd29647b09127e9e2147b8339', 'request_id': 'req-8db44c37-da3f-42f9-a85e-e879a9d48949'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:31.010231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c29fa-6a99-4642-834b-6ff36606e4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e180b3e489c4696bb7e420984061650, user_id=fad8c43da5434bb4aab3d96ceb638de8, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.013237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c29fa-6a99-4642-834b-6ff36606e4ab admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.018630 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8db44c37-da3f-42f9-a85e-e879a9d48949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945e510dd29647b09127e9e2147b8339', 'request_id': 'req-8db44c37-da3f-42f9-a85e-e879a9d48949'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:31.027178 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8db44c37-da3f-42f9-a85e-e879a9d48949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945e510dd29647b09127e9e2147b8339', 'request_id': 'req-8db44c37-da3f-42f9-a85e-e879a9d48949'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:31.029496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 945/1891] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:30 2022] PUT /identity/v3/projects/5e180b3e489c4696bb7e420984061650/users/fad8c43da5434bb4aab3d96ceb638de8/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:31.033905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c29fa-6a99-4642-834b-6ff36606e4ab admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.045009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8db44c37-da3f-42f9-a85e-e879a9d48949 admin admin] The token cache is being invalidate because project 945e510dd29647b09127e9e2147b8339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:31.045392 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8db44c37-da3f-42f9-a85e-e879a9d48949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:31.046176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8db44c37-da3f-42f9-a85e-e879a9d48949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:31.050911 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 947/1892] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:30 2022] DELETE /identity/v3/projects/945e510dd29647b09127e9e2147b8339 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:31.055844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc6b88-b24a-4b55-a064-3b0d2de7e04e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.056126 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc6b88-b24a-4b55-a064-3b0d2de7e04e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.057128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc6b88-b24a-4b55-a064-3b0d2de7e04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.082702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-71dc6b88-b24a-4b55-a064-3b0d2de7e04e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:31.085070 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-71dc6b88-b24a-4b55-a064-3b0d2de7e04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:31.112176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c29fa-6a99-4642-834b-6ff36606e4ab admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.117262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0bde5-c741-4bf1-bd54-4689fe050c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.117872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0bde5-c741-4bf1-bd54-4689fe050c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.118158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0bde5-c741-4bf1-bd54-4689fe050c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.118452 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0bde5-c741-4bf1-bd54-4689fe050c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.119241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0bde5-c741-4bf1-bd54-4689fe050c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.121793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0bde5-c741-4bf1-bd54-4689fe050c16 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.133749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 946/1893] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:16:31.138134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0bde5-c741-4bf1-bd54-4689fe050c16 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.139926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-69e0bde5-c741-4bf1-bd54-4689fe050c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:31.156434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0bde5-c741-4bf1-bd54-4689fe050c16 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.161854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d3b83-8882-4f49-985a-143183dab023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.162917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3b83-8882-4f49-985a-143183dab023 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.163591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3b83-8882-4f49-985a-143183dab023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.164000 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3b83-8882-4f49-985a-143183dab023 admin admin] PATH_INFO: `/v3/projects/5e180b3e489c4696bb7e420984061650/users/fad8c43da5434bb4aab3d96ceb638de8/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.166116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d3b83-8882-4f49-985a-143183dab023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e180b3e489c4696bb7e420984061650, user_id=fad8c43da5434bb4aab3d96ceb638de8, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.170538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d3b83-8882-4f49-985a-143183dab023 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.180215 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 948/1894] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:31.183968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 947/1895] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:31 2022] PUT /identity/v3/projects/5e180b3e489c4696bb7e420984061650/users/fad8c43da5434bb4aab3d96ceb638de8/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:31.189262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697253a-82ca-4607-808a-ccebcd4fd8f5 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.189669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697253a-82ca-4607-808a-ccebcd4fd8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.189790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697253a-82ca-4607-808a-ccebcd4fd8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.199734 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b72511-cfad-4759-bcc6-a586df982753 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.200027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b72511-cfad-4759-bcc6-a586df982753 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.200286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b72511-cfad-4759-bcc6-a586df982753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.210232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d697253a-82ca-4607-808a-ccebcd4fd8f5 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:31.211660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d697253a-82ca-4607-808a-ccebcd4fd8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:31.237624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a9b72511-cfad-4759-bcc6-a586df982753 None None] MFA Rules not processed for user `fad8c43da5434bb4aab3d96ceb638de8`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:31.237624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a9b72511-cfad-4759-bcc6-a586df982753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:31.278578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:31.301391 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 949/1896] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:31.306369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697253a-82ca-4607-808a-ccebcd4fd8f5 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.313952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:31.317257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697253a-82ca-4607-808a-ccebcd4fd8f5 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.324585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02ca42-fbce-400f-8fea-7edd2274aa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.325394 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02ca42-fbce-400f-8fea-7edd2274aa34 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.325823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02ca42-fbce-400f-8fea-7edd2274aa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.326227 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02ca42-fbce-400f-8fea-7edd2274aa34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.327641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02ca42-fbce-400f-8fea-7edd2274aa34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:31.327765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02ca42-fbce-400f-8fea-7edd2274aa34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.338534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02ca42-fbce-400f-8fea-7edd2274aa34 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.348937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 948/1897] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:31.358202 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 950/1898] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:31.363449 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b72511-cfad-4759-bcc6-a586df982753 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.370545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02ca42-fbce-400f-8fea-7edd2274aa34 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.374507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ed02ca42-fbce-400f-8fea-7edd2274aa34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:31.377481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b72511-cfad-4759-bcc6-a586df982753 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.383434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834894fd-5425-48d8-9204-0315231dd2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.384513 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834894fd-5425-48d8-9204-0315231dd2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.384866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834894fd-5425-48d8-9204-0315231dd2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.385615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834894fd-5425-48d8-9204-0315231dd2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.386466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834894fd-5425-48d8-9204-0315231dd2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.388983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834894fd-5425-48d8-9204-0315231dd2a7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.449808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02ca42-fbce-400f-8fea-7edd2274aa34 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.455400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca585f-336b-4434-945c-24ca517217ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.456475 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca585f-336b-4434-945c-24ca517217ee service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.456925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca585f-336b-4434-945c-24ca517217ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.457812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca585f-336b-4434-945c-24ca517217ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.470118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 949/1899] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:31 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:31.471740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834894fd-5425-48d8-9204-0315231dd2a7 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.471968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca585f-336b-4434-945c-24ca517217ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.473714 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca585f-336b-4434-945c-24ca517217ee service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.486887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 951/1900] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:31.546872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834894fd-5425-48d8-9204-0315231dd2a7 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.551832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05a6f2-8595-4921-9e53-dc3a3e6cd940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.552591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05a6f2-8595-4921-9e53-dc3a3e6cd940 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.552869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05a6f2-8595-4921-9e53-dc3a3e6cd940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.553139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05a6f2-8595-4921-9e53-dc3a3e6cd940 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.553802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05a6f2-8595-4921-9e53-dc3a3e6cd940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.555715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05a6f2-8595-4921-9e53-dc3a3e6cd940 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.582827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 950/1901] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:31 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:31.587464 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca585f-336b-4434-945c-24ca517217ee service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.600372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca585f-336b-4434-945c-24ca517217ee service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.606691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f9523-e63e-4764-b046-396dcf4e09b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.607319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f9523-e63e-4764-b046-396dcf4e09b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.608179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f9523-e63e-4764-b046-396dcf4e09b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.608920 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f9523-e63e-4764-b046-396dcf4e09b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.609640 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f9523-e63e-4764-b046-396dcf4e09b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.613354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f9523-e63e-4764-b046-396dcf4e09b3 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.631854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 952/1902] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:16:31.633197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05a6f2-8595-4921-9e53-dc3a3e6cd940 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.646325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05a6f2-8595-4921-9e53-dc3a3e6cd940 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.655616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fb704-89bd-41af-b2c8-62e1c42b235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.656354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fb704-89bd-41af-b2c8-62e1c42b235f admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.656634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fb704-89bd-41af-b2c8-62e1c42b235f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.656903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fb704-89bd-41af-b2c8-62e1c42b235f admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.657590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fb704-89bd-41af-b2c8-62e1c42b235f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.669408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fb704-89bd-41af-b2c8-62e1c42b235f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.687361 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 951/1903] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:31.692679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f9523-e63e-4764-b046-396dcf4e09b3 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.704608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f9523-e63e-4764-b046-396dcf4e09b3 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.709436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d230a-5cf1-4a49-8ae6-8f8fe6cbc179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.710134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d230a-5cf1-4a49-8ae6-8f8fe6cbc179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.710412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d230a-5cf1-4a49-8ae6-8f8fe6cbc179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.710680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d230a-5cf1-4a49-8ae6-8f8fe6cbc179 admin admin] PATH_INFO: `/v3/projects/0c17b8138b004bc2ac17b84338ef9a2b/users/4e3d035086914b88a3756a6b7ca20a70/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.728025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d230a-5cf1-4a49-8ae6-8f8fe6cbc179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c17b8138b004bc2ac17b84338ef9a2b, user_id=4e3d035086914b88a3756a6b7ca20a70, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.730981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d230a-5cf1-4a49-8ae6-8f8fe6cbc179 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.751597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 953/1904] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:31 2022] PUT /identity/v3/projects/0c17b8138b004bc2ac17b84338ef9a2b/users/4e3d035086914b88a3756a6b7ca20a70/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:31.762894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c047a-fd36-478d-8b52-86704afef771 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.763247 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c047a-fd36-478d-8b52-86704afef771 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.763736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c047a-fd36-478d-8b52-86704afef771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.801444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d61c047a-fd36-478d-8b52-86704afef771 None None] MFA Rules not processed for user `4e3d035086914b88a3756a6b7ca20a70`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:31.803172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d61c047a-fd36-478d-8b52-86704afef771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:31.936439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 952/1905] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:31.948508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d230a-5cf1-4a49-8ae6-8f8fe6cbc179 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.951015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-212d230a-5cf1-4a49-8ae6-8f8fe6cbc179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:31.984817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c047a-fd36-478d-8b52-86704afef771 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.018208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:32.049375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d230a-5cf1-4a49-8ae6-8f8fe6cbc179 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.052721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70a598-4c50-45b9-ad75-800f1dc62d56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd967a3fa32ef48b68c9e3a174f0c9a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.052912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c047a-fd36-478d-8b52-86704afef771 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.053367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70a598-4c50-45b9-ad75-800f1dc62d56 service glance] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.053647 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70a598-4c50-45b9-ad75-800f1dc62d56 service glance] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.053922 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70a598-4c50-45b9-ad75-800f1dc62d56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.057443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b8be4-750f-4a8a-952e-8a4ffc525091 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad8c43da5434bb4aab3d96ceb638de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e180b3e489c4696bb7e420984061650', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.058085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8be4-750f-4a8a-952e-8a4ffc525091 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.058358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8be4-750f-4a8a-952e-8a4ffc525091 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.058647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8be4-750f-4a8a-952e-8a4ffc525091 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.059267 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b8be4-750f-4a8a-952e-8a4ffc525091 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:32.059561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b8be4-750f-4a8a-952e-8a4ffc525091 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.061132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b8be4-750f-4a8a-952e-8a4ffc525091 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.062611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70a598-4c50-45b9-ad75-800f1dc62d56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.064034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70a598-4c50-45b9-ad75-800f1dc62d56 service glance] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.072558 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 953/1906] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:32.073070 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 954/1907] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:32.077420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b8be4-750f-4a8a-952e-8a4ffc525091 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.088286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b8be4-750f-4a8a-952e-8a4ffc525091 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.093966 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c8482-7426-4fb9-a6e1-f1adf9fadb83 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad8c43da5434bb4aab3d96ceb638de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e180b3e489c4696bb7e420984061650', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.094725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c8482-7426-4fb9-a6e1-f1adf9fadb83 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.095003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c8482-7426-4fb9-a6e1-f1adf9fadb83 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.095530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c8482-7426-4fb9-a6e1-f1adf9fadb83 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.096197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c8482-7426-4fb9-a6e1-f1adf9fadb83 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.098116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c8482-7426-4fb9-a6e1-f1adf9fadb83 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.130316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 954/1908] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:32 2022] POST /identity/v3/projects => generated 354 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:32.134860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70a598-4c50-45b9-ad75-800f1dc62d56 service glance] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.152833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70a598-4c50-45b9-ad75-800f1dc62d56 service glance] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.180796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:32.224982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a2c44-3716-4a91-9ef8-132442da1369 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad8c43da5434bb4aab3d96ceb638de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e180b3e489c4696bb7e420984061650', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.224982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a2c44-3716-4a91-9ef8-132442da1369 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.224982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a2c44-3716-4a91-9ef8-132442da1369 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.225444 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a2c44-3716-4a91-9ef8-132442da1369 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.225444 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a2c44-3716-4a91-9ef8-132442da1369 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:32.225444 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a2c44-3716-4a91-9ef8-132442da1369 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.226384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a2c44-3716-4a91-9ef8-132442da1369 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.240085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 955/1909] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:32.325617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c8482-7426-4fb9-a6e1-f1adf9fadb83 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.340569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a2c44-3716-4a91-9ef8-132442da1369 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.343847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f24a2c44-3716-4a91-9ef8-132442da1369 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:32.344356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c8482-7426-4fb9-a6e1-f1adf9fadb83 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.353081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8213c-12ee-4500-b7b0-b2d10d237686 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad8c43da5434bb4aab3d96ceb638de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e180b3e489c4696bb7e420984061650', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.353700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8213c-12ee-4500-b7b0-b2d10d237686 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.353975 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8213c-12ee-4500-b7b0-b2d10d237686 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.354242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8213c-12ee-4500-b7b0-b2d10d237686 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] PATH_INFO: `/v3/projects/34c8956c3b404b83a8c3e829b4f0480a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.356257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8213c-12ee-4500-b7b0-b2d10d237686 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: Authorizing `identity:delete_project(project_id=34c8956c3b404b83a8c3e829b4f0480a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.358340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8213c-12ee-4500-b7b0-b2d10d237686 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.446232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e2b8213c-12ee-4500-b7b0-b2d10d237686 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c8956c3b404b83a8c3e829b4f0480a', 'request_id': 'req-e2b8213c-12ee-4500-b7b0-b2d10d237686'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:32.462046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e2b8213c-12ee-4500-b7b0-b2d10d237686 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c8956c3b404b83a8c3e829b4f0480a', 'request_id': 'req-e2b8213c-12ee-4500-b7b0-b2d10d237686'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:32.463660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a2c44-3716-4a91-9ef8-132442da1369 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.484784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e2b8213c-12ee-4500-b7b0-b2d10d237686 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c8956c3b404b83a8c3e829b4f0480a', 'request_id': 'req-e2b8213c-12ee-4500-b7b0-b2d10d237686'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:32.548683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e2b8213c-12ee-4500-b7b0-b2d10d237686 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] The token cache is being invalidate because project 34c8956c3b404b83a8c3e829b4f0480a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:32.550897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e2b8213c-12ee-4500-b7b0-b2d10d237686 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:32.551667 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.553711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.553711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.553711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] PATH_INFO: `/v3/users/f62cd2a7b56a45899b95c8f85f9ad1b7` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.553967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e2b8213c-12ee-4500-b7b0-b2d10d237686 tempest-VolumeQuotaClassesTest-113309144 tempest-VolumeQuotaClassesTest-113309144-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:32.556259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62cd2a7b56a45899b95c8f85f9ad1b7)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.557174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 955/1910] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:32 2022] DELETE /identity/v3/projects/34c8956c3b404b83a8c3e829b4f0480a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:32.559670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.657102 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62cd2a7b56a45899b95c8f85f9ad1b7'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:32.672487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62cd2a7b56a45899b95c8f85f9ad1b7'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:32.674914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62cd2a7b56a45899b95c8f85f9ad1b7'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:32.698212 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62cd2a7b56a45899b95c8f85f9ad1b7'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:32.721436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:32.732217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62cd2a7b56a45899b95c8f85f9ad1b7'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:32.749665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 956/1911] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:32 2022] DELETE /identity/v3/users/f62cd2a7b56a45899b95c8f85f9ad1b7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:32.754206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214b70-e7c0-4727-92a9-3aa6367bd76a None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.755179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214b70-e7c0-4727-92a9-3aa6367bd76a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.755636 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214b70-e7c0-4727-92a9-3aa6367bd76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.789694 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-0b214b70-e7c0-4727-92a9-3aa6367bd76a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:32.791166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0b214b70-e7c0-4727-92a9-3aa6367bd76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:32.899801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 956/1912] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:32.925725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.928834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:32.973352 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b214b70-e7c0-4727-92a9-3aa6367bd76a None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.975335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0b214b70-e7c0-4727-92a9-3aa6367bd76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:32.996126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b214b70-e7c0-4727-92a9-3aa6367bd76a None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.016566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.017633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.018068 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.018754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] PATH_INFO: `/v3/users/495e6ff211b446fe8827f2e846ca4dfb` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.020672 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=495e6ff211b446fe8827f2e846ca4dfb)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.023269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.051724 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:33.078520 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74be093-dd5b-4cd9-b344-c2f9e87ca1cb admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.088340 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079e97f-0ba4-4bbd-91f2-9e616e03fa5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.092223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079e97f-0ba4-4bbd-91f2-9e616e03fa5e service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.093485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079e97f-0ba4-4bbd-91f2-9e616e03fa5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.094704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079e97f-0ba4-4bbd-91f2-9e616e03fa5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.115750 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495e6ff211b446fe8827f2e846ca4dfb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.119414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079e97f-0ba4-4bbd-91f2-9e616e03fa5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.121236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079e97f-0ba4-4bbd-91f2-9e616e03fa5e service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.149776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 957/1913] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:33.150508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495e6ff211b446fe8827f2e846ca4dfb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.151388 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495e6ff211b446fe8827f2e846ca4dfb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.152105 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495e6ff211b446fe8827f2e846ca4dfb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.163479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495e6ff211b446fe8827f2e846ca4dfb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.193945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1160206-d895-44d3-94a9-0235cae46fd7 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.194142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1160206-d895-44d3-94a9-0235cae46fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.194426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1160206-d895-44d3-94a9-0235cae46fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.197200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 957/1914] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:32 2022] DELETE /identity/v3/users/495e6ff211b446fe8827f2e846ca4dfb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:33.218097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d1160206-d895-44d3-94a9-0235cae46fd7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:33.219187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d1160206-d895-44d3-94a9-0235cae46fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:33.318066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 958/1915] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:33.408301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.410201 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:33.583751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a397e-e1a5-4417-908b-2bf3c7a33217 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.590567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a7a2e-be80-4f1b-9591-8b57e8b92df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.591563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a7a2e-be80-4f1b-9591-8b57e8b92df6 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.592988 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a7a2e-be80-4f1b-9591-8b57e8b92df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.595166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a7a2e-be80-4f1b-9591-8b57e8b92df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.617031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a7a2e-be80-4f1b-9591-8b57e8b92df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.620709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a7a2e-be80-4f1b-9591-8b57e8b92df6 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.644757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 958/1916] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:33.757496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1160206-d895-44d3-94a9-0235cae46fd7 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.760169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d1160206-d895-44d3-94a9-0235cae46fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:33.819441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1160206-d895-44d3-94a9-0235cae46fd7 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.827227 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.828362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.828789 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.829262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] PATH_INFO: `/v3/projects/feba48b666c84e3098cc83f7d9dd39ef` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.830797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feba48b666c84e3098cc83f7d9dd39ef)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.833697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.905838 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feba48b666c84e3098cc83f7d9dd39ef', 'request_id': 'req-9a979dad-940d-4e17-a65b-2f1e76173218'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.914683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feba48b666c84e3098cc83f7d9dd39ef', 'request_id': 'req-9a979dad-940d-4e17-a65b-2f1e76173218'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.922559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feba48b666c84e3098cc83f7d9dd39ef', 'request_id': 'req-9a979dad-940d-4e17-a65b-2f1e76173218'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.939703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] The token cache is being invalidate because project feba48b666c84e3098cc83f7d9dd39ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:33.940204 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.940959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.945259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 959/1917] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:33 2022] DELETE /identity/v3/projects/feba48b666c84e3098cc83f7d9dd39ef => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:33.946883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a7a2e-be80-4f1b-9591-8b57e8b92df6 service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.957195 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a7a2e-be80-4f1b-9591-8b57e8b92df6 service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.032735 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.033577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.033923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.034262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] PATH_INFO: `/v3/users/814168304121487c9b41494924d329b5` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.035459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] RBAC: Authorizing `identity:delete_user(user_id=814168304121487c9b41494924d329b5)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.037491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.120880 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:34.128431 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814168304121487c9b41494924d329b5'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.144978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814168304121487c9b41494924d329b5'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.146310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814168304121487c9b41494924d329b5'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.148739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814168304121487c9b41494924d329b5'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.160392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814168304121487c9b41494924d329b5'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.174726 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 959/1918] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:33 2022] DELETE /identity/v3/users/814168304121487c9b41494924d329b5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:34.428507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.430049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:34.449396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a979dad-940d-4e17-a65b-2f1e76173218 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.462211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:34.515961 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.516637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.516913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.517322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] PATH_INFO: `/v3/projects/7a71fab3deb34a86871cda14ff809c13` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.521655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a71fab3deb34a86871cda14ff809c13)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.521655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.568855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.570209 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:34.581765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a71fab3deb34a86871cda14ff809c13', 'request_id': 'req-8a21b32d-0b4e-4443-a332-3d80d0b6a926'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.586216 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84d702-85a4-4980-94e5-0802a216408e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.600504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a71fab3deb34a86871cda14ff809c13', 'request_id': 'req-8a21b32d-0b4e-4443-a332-3d80d0b6a926'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.622674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a71fab3deb34a86871cda14ff809c13', 'request_id': 'req-8a21b32d-0b4e-4443-a332-3d80d0b6a926'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.634386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] The token cache is being invalidate because project 7a71fab3deb34a86871cda14ff809c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:34.634675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.635533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.637559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 960/1919] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:34 2022] DELETE /identity/v3/projects/7a71fab3deb34a86871cda14ff809c13 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:34.642067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.643844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:34.658564 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a5658-53ef-4428-a19f-54129c19749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.659202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a5658-53ef-4428-a19f-54129c19749e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.659452 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a5658-53ef-4428-a19f-54129c19749e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.659722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a5658-53ef-4428-a19f-54129c19749e admin admin] PATH_INFO: `/v3/projects/54f3e2e63b454813b5248e80595abc29` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.660823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a5658-53ef-4428-a19f-54129c19749e admin admin] RBAC: Authorizing `identity:delete_project(project_id=54f3e2e63b454813b5248e80595abc29)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.662732 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a5658-53ef-4428-a19f-54129c19749e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.719359 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21b32d-0b4e-4443-a332-3d80d0b6a926 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.725442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-234a5658-53ef-4428-a19f-54129c19749e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54f3e2e63b454813b5248e80595abc29', 'request_id': 'req-234a5658-53ef-4428-a19f-54129c19749e'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.752318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-234a5658-53ef-4428-a19f-54129c19749e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54f3e2e63b454813b5248e80595abc29', 'request_id': 'req-234a5658-53ef-4428-a19f-54129c19749e'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.760400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-234a5658-53ef-4428-a19f-54129c19749e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54f3e2e63b454813b5248e80595abc29', 'request_id': 'req-234a5658-53ef-4428-a19f-54129c19749e'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.776012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-234a5658-53ef-4428-a19f-54129c19749e admin admin] The token cache is being invalidate because project 54f3e2e63b454813b5248e80595abc29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:34.776432 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-234a5658-53ef-4428-a19f-54129c19749e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.777738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-234a5658-53ef-4428-a19f-54129c19749e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.779503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 960/1920] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:34 2022] DELETE /identity/v3/projects/54f3e2e63b454813b5248e80595abc29 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:34.780578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:34.784775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9e208-f2c6-4b46-8d82-d45aa8054229 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.785365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9e208-f2c6-4b46-8d82-d45aa8054229 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.787096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9e208-f2c6-4b46-8d82-d45aa8054229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.794258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f679f1-a7e4-445c-84e5-cbed08effa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.794981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f679f1-a7e4-445c-84e5-cbed08effa46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.795716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f679f1-a7e4-445c-84e5-cbed08effa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.796192 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f679f1-a7e4-445c-84e5-cbed08effa46 admin admin] PATH_INFO: `/v3/users/fad8c43da5434bb4aab3d96ceb638de8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.797982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f679f1-a7e4-445c-84e5-cbed08effa46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad8c43da5434bb4aab3d96ceb638de8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.800401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f679f1-a7e4-445c-84e5-cbed08effa46 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.818311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-bca9e208-f2c6-4b46-8d82-d45aa8054229 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:34.819487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-bca9e208-f2c6-4b46-8d82-d45aa8054229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:34.830618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 961/1921] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:34.839129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216a540-9a91-41f2-95fe-9bcca95335f6 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.839812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216a540-9a91-41f2-95fe-9bcca95335f6 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.840156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216a540-9a91-41f2-95fe-9bcca95335f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.865086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-2216a540-9a91-41f2-95fe-9bcca95335f6 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:34.866131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2216a540-9a91-41f2-95fe-9bcca95335f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:34.866999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-03f679f1-a7e4-445c-84e5-cbed08effa46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad8c43da5434bb4aab3d96ceb638de8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.876650 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 962/1922] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:34.880898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216a540-9a91-41f2-95fe-9bcca95335f6 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.882726 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-03f679f1-a7e4-445c-84e5-cbed08effa46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad8c43da5434bb4aab3d96ceb638de8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.883356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-03f679f1-a7e4-445c-84e5-cbed08effa46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad8c43da5434bb4aab3d96ceb638de8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.893384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216a540-9a91-41f2-95fe-9bcca95335f6 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.901424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a6d62-1750-4c6c-bcb4-05437af905fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.902001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a6d62-1750-4c6c-bcb4-05437af905fe admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.902274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a6d62-1750-4c6c-bcb4-05437af905fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.902541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a6d62-1750-4c6c-bcb4-05437af905fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.903191 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a6d62-1750-4c6c-bcb4-05437af905fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:34.903660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a6d62-1750-4c6c-bcb4-05437af905fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.905368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a6d62-1750-4c6c-bcb4-05437af905fe admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.909371 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-03f679f1-a7e4-445c-84e5-cbed08effa46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad8c43da5434bb4aab3d96ceb638de8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.920795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 963/1923] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:34.925735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-03f679f1-a7e4-445c-84e5-cbed08effa46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad8c43da5434bb4aab3d96ceb638de8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:34.925918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a6d62-1750-4c6c-bcb4-05437af905fe admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.927917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-cd0a6d62-1750-4c6c-bcb4-05437af905fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:34.933348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 961/1924] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:34 2022] DELETE /identity/v3/users/fad8c43da5434bb4aab3d96ceb638de8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:34.967691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a6d62-1750-4c6c-bcb4-05437af905fe admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.999827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:35.071478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96848e-eee7-41ce-a188-5216dcd043d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.072274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96848e-eee7-41ce-a188-5216dcd043d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.072616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96848e-eee7-41ce-a188-5216dcd043d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.072884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96848e-eee7-41ce-a188-5216dcd043d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.073611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96848e-eee7-41ce-a188-5216dcd043d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.076199 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96848e-eee7-41ce-a188-5216dcd043d7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.118712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 964/1925] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:34 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:35.123016 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f679f1-a7e4-445c-84e5-cbed08effa46 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.135891 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f679f1-a7e4-445c-84e5-cbed08effa46 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.207805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04021-0139-4884-8bba-2c0234c02c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.208667 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04021-0139-4884-8bba-2c0234c02c2e admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.208951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04021-0139-4884-8bba-2c0234c02c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.209238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04021-0139-4884-8bba-2c0234c02c2e admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.209908 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c04021-0139-4884-8bba-2c0234c02c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.212243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c04021-0139-4884-8bba-2c0234c02c2e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.244461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 962/1926] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:35 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:35.249168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96848e-eee7-41ce-a188-5216dcd043d7 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.263159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96848e-eee7-41ce-a188-5216dcd043d7 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.269673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba2cc7-efcd-42e7-a457-de9be6189151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.270511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba2cc7-efcd-42e7-a457-de9be6189151 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.271361 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba2cc7-efcd-42e7-a457-de9be6189151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.271887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba2cc7-efcd-42e7-a457-de9be6189151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.272748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba2cc7-efcd-42e7-a457-de9be6189151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.274637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba2cc7-efcd-42e7-a457-de9be6189151 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.285547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 965/1927] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:35.289745 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04021-0139-4884-8bba-2c0234c02c2e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.302522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04021-0139-4884-8bba-2c0234c02c2e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.308938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4a98d-d269-4f1f-8494-6d2506bb1636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.309697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4a98d-d269-4f1f-8494-6d2506bb1636 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.310035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4a98d-d269-4f1f-8494-6d2506bb1636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.310367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4a98d-d269-4f1f-8494-6d2506bb1636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.311085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4a98d-d269-4f1f-8494-6d2506bb1636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.312789 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4a98d-d269-4f1f-8494-6d2506bb1636 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.329258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 963/1928] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:35.334678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba2cc7-efcd-42e7-a457-de9be6189151 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.348723 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba2cc7-efcd-42e7-a457-de9be6189151 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.352304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4a98d-d269-4f1f-8494-6d2506bb1636 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.356423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afc294-7f7a-4567-ab8b-6d7138ebc43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.356612 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2ce4a98d-d269-4f1f-8494-6d2506bb1636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:35.358140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afc294-7f7a-4567-ab8b-6d7138ebc43c admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.359113 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afc294-7f7a-4567-ab8b-6d7138ebc43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.359602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afc294-7f7a-4567-ab8b-6d7138ebc43c admin admin] PATH_INFO: `/v3/projects/f297ce3f457a4b238c429c529d33f816/users/ddb4469edcd54987a3549fd83ec41fac/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.383142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4a98d-d269-4f1f-8494-6d2506bb1636 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.390665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afc294-7f7a-4567-ab8b-6d7138ebc43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f297ce3f457a4b238c429c529d33f816, user_id=ddb4469edcd54987a3549fd83ec41fac, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.391157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b42705-9408-405a-9dd1-e9a5ce723c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.393129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42705-9408-405a-9dd1-e9a5ce723c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.393742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42705-9408-405a-9dd1-e9a5ce723c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.394156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afc294-7f7a-4567-ab8b-6d7138ebc43c admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.394335 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42705-9408-405a-9dd1-e9a5ce723c53 admin admin] PATH_INFO: `/v3/projects/5e180b3e489c4696bb7e420984061650` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.395793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b42705-9408-405a-9dd1-e9a5ce723c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e180b3e489c4696bb7e420984061650)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.398623 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b42705-9408-405a-9dd1-e9a5ce723c53 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.418692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 966/1929] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:35 2022] PUT /identity/v3/projects/f297ce3f457a4b238c429c529d33f816/users/ddb4469edcd54987a3549fd83ec41fac/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:35.424168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f3090-2067-4272-ad0f-6736b53ff62a None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.424564 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f3090-2067-4272-ad0f-6736b53ff62a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.424922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f3090-2067-4272-ad0f-6736b53ff62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.460604 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-308f3090-2067-4272-ad0f-6736b53ff62a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:35.462063 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-308f3090-2067-4272-ad0f-6736b53ff62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:35.475355 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:35.482364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-63b42705-9408-405a-9dd1-e9a5ce723c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e180b3e489c4696bb7e420984061650', 'request_id': 'req-63b42705-9408-405a-9dd1-e9a5ce723c53'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:35.496061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-63b42705-9408-405a-9dd1-e9a5ce723c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e180b3e489c4696bb7e420984061650', 'request_id': 'req-63b42705-9408-405a-9dd1-e9a5ce723c53'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:35.508194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-63b42705-9408-405a-9dd1-e9a5ce723c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e180b3e489c4696bb7e420984061650', 'request_id': 'req-63b42705-9408-405a-9dd1-e9a5ce723c53'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:35.531980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-63b42705-9408-405a-9dd1-e9a5ce723c53 admin admin] The token cache is being invalidate because project 5e180b3e489c4696bb7e420984061650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:35.532608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-63b42705-9408-405a-9dd1-e9a5ce723c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:35.534209 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-63b42705-9408-405a-9dd1-e9a5ce723c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:35.536947 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 964/1930] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:35 2022] DELETE /identity/v3/projects/5e180b3e489c4696bb7e420984061650 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:35.542716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce0147-bbe2-4e49-818a-701af84af9e7 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.543355 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce0147-bbe2-4e49-818a-701af84af9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.543852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce0147-bbe2-4e49-818a-701af84af9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.544508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 967/1931] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:35.556310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f3090-2067-4272-ad0f-6736b53ff62a None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.558997 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-308f3090-2067-4272-ad0f-6736b53ff62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:35.576585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-3fce0147-bbe2-4e49-818a-701af84af9e7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:35.577810 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-3fce0147-bbe2-4e49-818a-701af84af9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:35.586208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 965/1932] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:35.594325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316caa4-39b2-477d-bdf9-2d00c56bfe15 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.594743 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316caa4-39b2-477d-bdf9-2d00c56bfe15 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.595150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316caa4-39b2-477d-bdf9-2d00c56bfe15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.618957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-2316caa4-39b2-477d-bdf9-2d00c56bfe15 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:35.620167 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2316caa4-39b2-477d-bdf9-2d00c56bfe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:35.623436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f3090-2067-4272-ad0f-6736b53ff62a None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.628624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d376d1-f619-4df1-8feb-3aa774b31bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.629254 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d376d1-f619-4df1-8feb-3aa774b31bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.629526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d376d1-f619-4df1-8feb-3aa774b31bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.629794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d376d1-f619-4df1-8feb-3aa774b31bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.630635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 966/1933] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:35.635419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316caa4-39b2-477d-bdf9-2d00c56bfe15 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.654471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d376d1-f619-4df1-8feb-3aa774b31bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.655417 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316caa4-39b2-477d-bdf9-2d00c56bfe15 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.656329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d376d1-f619-4df1-8feb-3aa774b31bb8 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.663282 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bf330-8280-4c09-8a75-c9966fee585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.665399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bf330-8280-4c09-8a75-c9966fee585f admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.665903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bf330-8280-4c09-8a75-c9966fee585f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.667101 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bf330-8280-4c09-8a75-c9966fee585f admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.667968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bf330-8280-4c09-8a75-c9966fee585f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:35.668370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bf330-8280-4c09-8a75-c9966fee585f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.669540 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 968/1934] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:16:35.670467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bf330-8280-4c09-8a75-c9966fee585f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.670803 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcb69a-f33f-49ed-a1e3-43d59d7a3e45 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.671087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcb69a-f33f-49ed-a1e3-43d59d7a3e45 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.671358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcb69a-f33f-49ed-a1e3-43d59d7a3e45 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.672947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 969/1935] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:35.693248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 967/1936] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:35.696222 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcb69a-f33f-49ed-a1e3-43d59d7a3e45 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.698535 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b7e0a-5c5d-4e1a-81b7-b4b13f8de6e9 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.698817 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b7e0a-5c5d-4e1a-81b7-b4b13f8de6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.699285 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b7e0a-5c5d-4e1a-81b7-b4b13f8de6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.724425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-bb3b7e0a-5c5d-4e1a-81b7-b4b13f8de6e9 None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:35.725608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-bb3b7e0a-5c5d-4e1a-81b7-b4b13f8de6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:35.729413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcb69a-f33f-49ed-a1e3-43d59d7a3e45 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.735201 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d1250-05fc-4152-bd4c-626470a43cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.735653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d1250-05fc-4152-bd4c-626470a43cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.735994 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d1250-05fc-4152-bd4c-626470a43cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.736326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d1250-05fc-4152-bd4c-626470a43cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.737060 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d1250-05fc-4152-bd4c-626470a43cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.739227 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d1250-05fc-4152-bd4c-626470a43cbf admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.760954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:35.778885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 970/1937] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:35 2022] POST /identity/v3/projects => generated 391 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:35.783653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d1250-05fc-4152-bd4c-626470a43cbf admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.818112 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 968/1938] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:16:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:35.838461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b7e0a-5c5d-4e1a-81b7-b4b13f8de6e9 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.841199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-bb3b7e0a-5c5d-4e1a-81b7-b4b13f8de6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:35.859136 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b7e0a-5c5d-4e1a-81b7-b4b13f8de6e9 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.874672 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d1250-05fc-4152-bd4c-626470a43cbf admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.883751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb96f40-7706-4ac7-b430-8295a872dd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.884561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb96f40-7706-4ac7-b430-8295a872dd6d admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.884936 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb96f40-7706-4ac7-b430-8295a872dd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.885368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb96f40-7706-4ac7-b430-8295a872dd6d admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.886461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb96f40-7706-4ac7-b430-8295a872dd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.890276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb96f40-7706-4ac7-b430-8295a872dd6d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.928821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 971/1939] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:35 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:35.932562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb96f40-7706-4ac7-b430-8295a872dd6d admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.947365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb96f40-7706-4ac7-b430-8295a872dd6d admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.961960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81231b0-870c-4693-b9ef-a8c925b4f45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.962855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81231b0-870c-4693-b9ef-a8c925b4f45b admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.963225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81231b0-870c-4693-b9ef-a8c925b4f45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.963590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81231b0-870c-4693-b9ef-a8c925b4f45b admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.964409 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81231b0-870c-4693-b9ef-a8c925b4f45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.966267 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81231b0-870c-4693-b9ef-a8c925b4f45b admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.980205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a1723-7a40-4927-b5ac-237d9dc5a908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.980932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a1723-7a40-4927-b5ac-237d9dc5a908 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.981246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a1723-7a40-4927-b5ac-237d9dc5a908 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.981532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a1723-7a40-4927-b5ac-237d9dc5a908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.983166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 972/1940] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:16:35.991122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81231b0-870c-4693-b9ef-a8c925b4f45b admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.999709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a1723-7a40-4927-b5ac-237d9dc5a908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:36.002450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81231b0-870c-4693-b9ef-a8c925b4f45b admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:36.003342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a1723-7a40-4927-b5ac-237d9dc5a908 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:36.007700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c159a2c-61c0-4988-8bc7-8e8757e2fa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:36.008454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159a2c-61c0-4988-8bc7-8e8757e2fa9a admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:36.008846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159a2c-61c0-4988-8bc7-8e8757e2fa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:36.009221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159a2c-61c0-4988-8bc7-8e8757e2fa9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:36.010518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c159a2c-61c0-4988-8bc7-8e8757e2fa9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:36.013050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c159a2c-61c0-4988-8bc7-8e8757e2fa9a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:36.017118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 969/1941] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:16:36.029875 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 973/1942] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:36.032468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a1723-7a40-4927-b5ac-237d9dc5a908 service nova] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:36.045900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a1723-7a40-4927-b5ac-237d9dc5a908 service nova] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:36.062027 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1401-b2a7-4008-b06b-338031da3bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:36.062923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1401-b2a7-4008-b06b-338031da3bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:36.063205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1401-b2a7-4008-b06b-338031da3bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:36.064530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1401-b2a7-4008-b06b-338031da3bf2 admin admin] PATH_INFO: `/v3/projects/6f05f2d75fd5403e811f2740e9ae1fec/users/a8dc2f2154c14c65bab843cdf15a9b52/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:36.087820 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b1401-b2a7-4008-b06b-338031da3bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f05f2d75fd5403e811f2740e9ae1fec, user_id=a8dc2f2154c14c65bab843cdf15a9b52, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:36.091366 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b1401-b2a7-4008-b06b-338031da3bf2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:36.107769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:36.115689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 970/1943] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:36 2022] PUT /identity/v3/projects/6f05f2d75fd5403e811f2740e9ae1fec/users/a8dc2f2154c14c65bab843cdf15a9b52/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:36.142528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024dbb-d809-4562-9cb2-f9bcd45d8537 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:36.143551 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024dbb-d809-4562-9cb2-f9bcd45d8537 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:36.144090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024dbb-d809-4562-9cb2-f9bcd45d8537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:36.190101 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ac024dbb-d809-4562-9cb2-f9bcd45d8537 None None] MFA Rules not processed for user `a8dc2f2154c14c65bab843cdf15a9b52`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:36.191529 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ac024dbb-d809-4562-9cb2-f9bcd45d8537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:36.286511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 974/1944] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:36.288043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1401-b2a7-4008-b06b-338031da3bf2 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:36.451278 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1401-b2a7-4008-b06b-338031da3bf2 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:36.456927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67d9f-f533-4524-b6f8-77607292527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:36.457642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67d9f-f533-4524-b6f8-77607292527f admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:36.458346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67d9f-f533-4524-b6f8-77607292527f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:36.458346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67d9f-f533-4524-b6f8-77607292527f admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:36.458827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a67d9f-f533-4524-b6f8-77607292527f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:36.461596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a67d9f-f533-4524-b6f8-77607292527f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:36.499979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 971/1945] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:36 2022] POST /identity/v3/projects => generated 391 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:36.504232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac024dbb-d809-4562-9cb2-f9bcd45d8537 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:36.517832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac024dbb-d809-4562-9cb2-f9bcd45d8537 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:36.579723 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:36.591931 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607ba59-72ed-4402-aedd-772c1d44be5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:36.599826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607ba59-72ed-4402-aedd-772c1d44be5d admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:36.600666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607ba59-72ed-4402-aedd-772c1d44be5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:36.600666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607ba59-72ed-4402-aedd-772c1d44be5d admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:36.601026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607ba59-72ed-4402-aedd-772c1d44be5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:36.603006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607ba59-72ed-4402-aedd-772c1d44be5d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:36.628648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 975/1946] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:36 2022] POST /identity/v3/users => generated 302 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:36.633022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67d9f-f533-4524-b6f8-77607292527f admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:36.651645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67d9f-f533-4524-b6f8-77607292527f admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:36.662372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4918e93-c35c-49cb-9bdc-ec099816ef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:36.663466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4918e93-c35c-49cb-9bdc-ec099816ef63 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:36.663882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4918e93-c35c-49cb-9bdc-ec099816ef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:36.664298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4918e93-c35c-49cb-9bdc-ec099816ef63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:36.664932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4918e93-c35c-49cb-9bdc-ec099816ef63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:36.666714 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4918e93-c35c-49cb-9bdc-ec099816ef63 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:36.682210 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 972/1947] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:36.686803 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607ba59-72ed-4402-aedd-772c1d44be5d admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:36.712897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607ba59-72ed-4402-aedd-772c1d44be5d admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:36.718951 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ff942-11fb-41ac-974e-414a34473c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:36.719806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ff942-11fb-41ac-974e-414a34473c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:36.720692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ff942-11fb-41ac-974e-414a34473c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:36.721043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ff942-11fb-41ac-974e-414a34473c6a admin admin] PATH_INFO: `/v3/projects/69cffde372b747cf846675651654f2bf/users/b9161ca82f3c4027886f137b40648fc0/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:36.748921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ff942-11fb-41ac-974e-414a34473c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cffde372b747cf846675651654f2bf, user_id=b9161ca82f3c4027886f137b40648fc0, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:36.752495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ff942-11fb-41ac-974e-414a34473c6a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:36.770091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 976/1948] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:36 2022] PUT /identity/v3/projects/69cffde372b747cf846675651654f2bf/users/b9161ca82f3c4027886f137b40648fc0/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:36.774570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4918e93-c35c-49cb-9bdc-ec099816ef63 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:36.788470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4918e93-c35c-49cb-9bdc-ec099816ef63 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:36.851046 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc97b9-0bfd-4a12-aaae-dc1f96963919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:36.851820 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc97b9-0bfd-4a12-aaae-dc1f96963919 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:36.851906 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc97b9-0bfd-4a12-aaae-dc1f96963919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:36.852704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc97b9-0bfd-4a12-aaae-dc1f96963919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:36.853089 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc97b9-0bfd-4a12-aaae-dc1f96963919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:36.855252 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc97b9-0bfd-4a12-aaae-dc1f96963919 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:36.874706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 973/1949] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:16:36.874928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ff942-11fb-41ac-974e-414a34473c6a admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:36.887344 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ff942-11fb-41ac-974e-414a34473c6a admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:36.893061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817011f-d572-4157-8152-84b287abc138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:36.893577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817011f-d572-4157-8152-84b287abc138 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:36.893855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817011f-d572-4157-8152-84b287abc138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:36.894428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817011f-d572-4157-8152-84b287abc138 admin admin] PATH_INFO: `/v3/projects/69cffde372b747cf846675651654f2bf/users/b9161ca82f3c4027886f137b40648fc0/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:36.897537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817011f-d572-4157-8152-84b287abc138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cffde372b747cf846675651654f2bf, user_id=b9161ca82f3c4027886f137b40648fc0, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:36.900861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817011f-d572-4157-8152-84b287abc138 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:36.966175 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 977/1950] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:36 2022] PUT /identity/v3/projects/69cffde372b747cf846675651654f2bf/users/b9161ca82f3c4027886f137b40648fc0/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:36.972569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9a222-c8fd-4217-a480-080d654b49eb None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:36.973170 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9a222-c8fd-4217-a480-080d654b49eb None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:36.973603 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9a222-c8fd-4217-a480-080d654b49eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.029628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-07f9a222-c8fd-4217-a480-080d654b49eb None None] MFA Rules not processed for user `b9161ca82f3c4027886f137b40648fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:37.031115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-07f9a222-c8fd-4217-a480-080d654b49eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:37.149966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:37.168617 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 974/1951] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:37.179921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817011f-d572-4157-8152-84b287abc138 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:37.181860 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0817011f-d572-4157-8152-84b287abc138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:37.254656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817011f-d572-4157-8152-84b287abc138 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:37.258656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b668a27-0c8e-443c-9c51-f8fc0d1d34ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:37.259264 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b668a27-0c8e-443c-9c51-f8fc0d1d34ed service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.259535 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b668a27-0c8e-443c-9c51-f8fc0d1d34ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.259801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b668a27-0c8e-443c-9c51-f8fc0d1d34ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.271520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b668a27-0c8e-443c-9c51-f8fc0d1d34ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:37.273163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b668a27-0c8e-443c-9c51-f8fc0d1d34ed service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:37.293678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 978/1952] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:37.315647 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e0cc-1710-4db1-b5a1-25d89aa88fc3 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.316005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e0cc-1710-4db1-b5a1-25d89aa88fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.316244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e0cc-1710-4db1-b5a1-25d89aa88fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.348116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-8767e0cc-1710-4db1-b5a1-25d89aa88fc3 None None] MFA Rules not processed for user `ddb4469edcd54987a3549fd83ec41fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:37.349364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8767e0cc-1710-4db1-b5a1-25d89aa88fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:37.357327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b668a27-0c8e-443c-9c51-f8fc0d1d34ed service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:37.358814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2b668a27-0c8e-443c-9c51-f8fc0d1d34ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:37.371105 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b668a27-0c8e-443c-9c51-f8fc0d1d34ed service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:37.375339 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8e3f5-f3b5-4efc-b4c5-b8609adbc137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:37.376394 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8e3f5-f3b5-4efc-b4c5-b8609adbc137 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.376740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8e3f5-f3b5-4efc-b4c5-b8609adbc137 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.377076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8e3f5-f3b5-4efc-b4c5-b8609adbc137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.431785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 975/1953] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:37.437764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767e0cc-1710-4db1-b5a1-25d89aa88fc3 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:37.439442 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8767e0cc-1710-4db1-b5a1-25d89aa88fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:37.509581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8e3f5-f3b5-4efc-b4c5-b8609adbc137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:37.512121 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8e3f5-f3b5-4efc-b4c5-b8609adbc137 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:37.555300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 979/1954] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:16:37.564946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767e0cc-1710-4db1-b5a1-25d89aa88fc3 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:37.571320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e9c76-e9f2-4623-91a6-0c38bc2525f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:37.572065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e9c76-e9f2-4623-91a6-0c38bc2525f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.572344 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e9c76-e9f2-4623-91a6-0c38bc2525f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.572613 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e9c76-e9f2-4623-91a6-0c38bc2525f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.573599 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e9c76-e9f2-4623-91a6-0c38bc2525f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:37.575419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e9c76-e9f2-4623-91a6-0c38bc2525f1 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:37.608508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 976/1955] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:37 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:37.613181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8e3f5-f3b5-4efc-b4c5-b8609adbc137 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:37.625771 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8e3f5-f3b5-4efc-b4c5-b8609adbc137 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:37.725306 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:37.744959 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a87dc8-fde6-4465-b5fa-43c3d6ef7d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:37.746594 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a87dc8-fde6-4465-b5fa-43c3d6ef7d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.746970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a87dc8-fde6-4465-b5fa-43c3d6ef7d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.747727 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a87dc8-fde6-4465-b5fa-43c3d6ef7d37 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.748699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a87dc8-fde6-4465-b5fa-43c3d6ef7d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:37.751590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a87dc8-fde6-4465-b5fa-43c3d6ef7d37 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:37.798375 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 980/1956] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:37 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:37.802814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e9c76-e9f2-4623-91a6-0c38bc2525f1 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:37.820550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e9c76-e9f2-4623-91a6-0c38bc2525f1 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:37.833254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2dc6d-74ab-44b7-967b-ba2821a3de9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:37.833254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2dc6d-74ab-44b7-967b-ba2821a3de9b admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.833254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2dc6d-74ab-44b7-967b-ba2821a3de9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.833254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2dc6d-74ab-44b7-967b-ba2821a3de9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.833696 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2dc6d-74ab-44b7-967b-ba2821a3de9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:37.833696 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2dc6d-74ab-44b7-967b-ba2821a3de9b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:37.844976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 977/1957] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:37.849347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a87dc8-fde6-4465-b5fa-43c3d6ef7d37 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:37.864626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a87dc8-fde6-4465-b5fa-43c3d6ef7d37 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:37.877101 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea272a-77d7-48bc-b700-067bf81c5abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:37.878916 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea272a-77d7-48bc-b700-067bf81c5abb admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.879328 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea272a-77d7-48bc-b700-067bf81c5abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.879721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea272a-77d7-48bc-b700-067bf81c5abb admin admin] PATH_INFO: `/v3/projects/49761b4bc85c4eaf98e133521ee9b1d4/users/5608f7156d3a420b837f48d40c69f4a7/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.900066 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea272a-77d7-48bc-b700-067bf81c5abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=49761b4bc85c4eaf98e133521ee9b1d4, user_id=5608f7156d3a420b837f48d40c69f4a7, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:37.903998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea272a-77d7-48bc-b700-067bf81c5abb admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:37.930612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 981/1958] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:37 2022] PUT /identity/v3/projects/49761b4bc85c4eaf98e133521ee9b1d4/users/5608f7156d3a420b837f48d40c69f4a7/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:37.934761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2dc6d-74ab-44b7-967b-ba2821a3de9b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:37.954772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2dc6d-74ab-44b7-967b-ba2821a3de9b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:38.074480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:38.081978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f96a85-cf4f-403c-86e0-12194a2d3d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:38.083042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f96a85-cf4f-403c-86e0-12194a2d3d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.083491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f96a85-cf4f-403c-86e0-12194a2d3d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.083916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f96a85-cf4f-403c-86e0-12194a2d3d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:38.084751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f96a85-cf4f-403c-86e0-12194a2d3d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:38.087420 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f96a85-cf4f-403c-86e0-12194a2d3d90 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:38.100401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 978/1959] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:38.105854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea272a-77d7-48bc-b700-067bf81c5abb admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:38.117259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea272a-77d7-48bc-b700-067bf81c5abb admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:38.122591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92feae4-4815-4b35-a7f6-c6ed4b7ef972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:38.123259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92feae4-4815-4b35-a7f6-c6ed4b7ef972 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.123529 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92feae4-4815-4b35-a7f6-c6ed4b7ef972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.123801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92feae4-4815-4b35-a7f6-c6ed4b7ef972 admin admin] PATH_INFO: `/v3/projects/49761b4bc85c4eaf98e133521ee9b1d4/users/5608f7156d3a420b837f48d40c69f4a7/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:38.125719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92feae4-4815-4b35-a7f6-c6ed4b7ef972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49761b4bc85c4eaf98e133521ee9b1d4, user_id=5608f7156d3a420b837f48d40c69f4a7, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:38.128362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92feae4-4815-4b35-a7f6-c6ed4b7ef972 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:38.139967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 982/1960] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:38 2022] PUT /identity/v3/projects/49761b4bc85c4eaf98e133521ee9b1d4/users/5608f7156d3a420b837f48d40c69f4a7/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:38.967221 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba2aa1-9fd2-4b37-a433-2a99c0c911bd None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.967703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba2aa1-9fd2-4b37-a433-2a99c0c911bd None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.967793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba2aa1-9fd2-4b37-a433-2a99c0c911bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.004319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e6ba2aa1-9fd2-4b37-a433-2a99c0c911bd None None] MFA Rules not processed for user `5608f7156d3a420b837f48d40c69f4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:39.005551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e6ba2aa1-9fd2-4b37-a433-2a99c0c911bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:39.136193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 979/1961] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:39.153848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecbddb-838f-4d63-b475-482c2b5935e1 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.154405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecbddb-838f-4d63-b475-482c2b5935e1 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.154405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecbddb-838f-4d63-b475-482c2b5935e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.177694 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-92ecbddb-838f-4d63-b475-482c2b5935e1 None None] MFA Rules not processed for user `ddb4469edcd54987a3549fd83ec41fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:39.178927 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-92ecbddb-838f-4d63-b475-482c2b5935e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:39.301135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 983/1962] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:39.318646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba2aa1-9fd2-4b37-a433-2a99c0c911bd None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:39.481060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba2aa1-9fd2-4b37-a433-2a99c0c911bd None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:39.513034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d2edc-fb9e-4d59-93a9-4e5b607e8f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:39.514041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d2edc-fb9e-4d59-93a9-4e5b607e8f4d service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.514338 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d2edc-fb9e-4d59-93a9-4e5b607e8f4d service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.514616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d2edc-fb9e-4d59-93a9-4e5b607e8f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.540252 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d2edc-fb9e-4d59-93a9-4e5b607e8f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:39.542979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d2edc-fb9e-4d59-93a9-4e5b607e8f4d service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:39.571597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 980/1963] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:39.622821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecbddb-838f-4d63-b475-482c2b5935e1 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:39.624888 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-92ecbddb-838f-4d63-b475-482c2b5935e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:39.739818 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecbddb-838f-4d63-b475-482c2b5935e1 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:39.745307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:39.746238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.746672 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.747041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] PATH_INFO: `/v3/users/6129998d2d404cf98158b851c40fb25b` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.748534 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6129998d2d404cf98158b851c40fb25b)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:39.750866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:39.823177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:39.826579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6129998d2d404cf98158b851c40fb25b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:39.851476 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6129998d2d404cf98158b851c40fb25b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:39.852364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6129998d2d404cf98158b851c40fb25b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:39.853091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6129998d2d404cf98158b851c40fb25b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:39.862421 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6129998d2d404cf98158b851c40fb25b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:39.878007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 984/1964] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:39 2022] DELETE /identity/v3/users/6129998d2d404cf98158b851c40fb25b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:39.883036 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ae8ce-a745-452a-8543-e1a40b5db510 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.883425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ae8ce-a745-452a-8543-e1a40b5db510 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.883918 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ae8ce-a745-452a-8543-e1a40b5db510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.913407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-fe4ae8ce-a745-452a-8543-e1a40b5db510 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:39.914637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-fe4ae8ce-a745-452a-8543-e1a40b5db510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:40.014286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 981/1965] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:40.030942 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:40.032469 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:40.127540 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba5429-2509-47a8-9b34-211ea8c01259 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:40.135317 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d613e02-f0a5-47e8-a07b-0681f1605635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:40.145104 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d613e02-f0a5-47e8-a07b-0681f1605635 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:40.145775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d613e02-f0a5-47e8-a07b-0681f1605635 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:40.147061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d613e02-f0a5-47e8-a07b-0681f1605635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:40.170235 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d613e02-f0a5-47e8-a07b-0681f1605635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:40.175348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d613e02-f0a5-47e8-a07b-0681f1605635 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:40.211738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 985/1966] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:40.739411 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ae8ce-a745-452a-8543-e1a40b5db510 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:40.740940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-fe4ae8ce-a745-452a-8543-e1a40b5db510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:40.756137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:40.762529 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ae8ce-a745-452a-8543-e1a40b5db510 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:40.768028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:40.768657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:40.768959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:40.769292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] PATH_INFO: `/v3/projects/86d5f4ac26324434917ca8bb1fc704d1` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:40.770434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d5f4ac26324434917ca8bb1fc704d1)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:40.772972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:40.839966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d5f4ac26324434917ca8bb1fc704d1', 'request_id': 'req-aeac443c-3e1c-4896-8443-12b3c0a09846'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:40.849967 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d5f4ac26324434917ca8bb1fc704d1', 'request_id': 'req-aeac443c-3e1c-4896-8443-12b3c0a09846'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:40.858655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d5f4ac26324434917ca8bb1fc704d1', 'request_id': 'req-aeac443c-3e1c-4896-8443-12b3c0a09846'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:40.872262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] The token cache is being invalidate because project 86d5f4ac26324434917ca8bb1fc704d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:40.872707 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:40.873727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:40.874923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 982/1967] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:40 2022] DELETE /identity/v3/projects/86d5f4ac26324434917ca8bb1fc704d1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:40.880115 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d613e02-f0a5-47e8-a07b-0681f1605635 service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:40.894753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d613e02-f0a5-47e8-a07b-0681f1605635 service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:40.963700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7758ede-63d0-418c-b346-761c2ead1cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:40.964413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7758ede-63d0-418c-b346-761c2ead1cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:40.964869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7758ede-63d0-418c-b346-761c2ead1cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:40.965302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7758ede-63d0-418c-b346-761c2ead1cd7 admin admin] PATH_INFO: `/v3/users/a1cda0321974425bb6da5ed4cc4e27b1` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:40.966538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7758ede-63d0-418c-b346-761c2ead1cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1cda0321974425bb6da5ed4cc4e27b1)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:40.972146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7758ede-63d0-418c-b346-761c2ead1cd7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:41.023236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c7758ede-63d0-418c-b346-761c2ead1cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1cda0321974425bb6da5ed4cc4e27b1'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:41.035514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c7758ede-63d0-418c-b346-761c2ead1cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1cda0321974425bb6da5ed4cc4e27b1'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:41.036237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c7758ede-63d0-418c-b346-761c2ead1cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1cda0321974425bb6da5ed4cc4e27b1'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:41.036907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c7758ede-63d0-418c-b346-761c2ead1cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1cda0321974425bb6da5ed4cc4e27b1'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:41.038648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:41.045159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c7758ede-63d0-418c-b346-761c2ead1cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1cda0321974425bb6da5ed4cc4e27b1'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:41.060156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 986/1968] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:40 2022] DELETE /identity/v3/users/a1cda0321974425bb6da5ed4cc4e27b1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:41.380751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:41.380751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:41.399854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac443c-3e1c-4896-8443-12b3c0a09846 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:41.474889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593539f-0fba-4876-90b2-7f9c04b296d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:41.476186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593539f-0fba-4876-90b2-7f9c04b296d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:41.476509 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593539f-0fba-4876-90b2-7f9c04b296d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:41.476883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593539f-0fba-4876-90b2-7f9c04b296d2 admin admin] PATH_INFO: `/v3/projects/fa0accd14e24477882757b24f5a90f8f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:41.486589 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593539f-0fba-4876-90b2-7f9c04b296d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0accd14e24477882757b24f5a90f8f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:41.488721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593539f-0fba-4876-90b2-7f9c04b296d2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:41.609571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e593539f-0fba-4876-90b2-7f9c04b296d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0accd14e24477882757b24f5a90f8f', 'request_id': 'req-e593539f-0fba-4876-90b2-7f9c04b296d2'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:41.628838 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e593539f-0fba-4876-90b2-7f9c04b296d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0accd14e24477882757b24f5a90f8f', 'request_id': 'req-e593539f-0fba-4876-90b2-7f9c04b296d2'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:41.639399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e593539f-0fba-4876-90b2-7f9c04b296d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0accd14e24477882757b24f5a90f8f', 'request_id': 'req-e593539f-0fba-4876-90b2-7f9c04b296d2'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:41.689965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e593539f-0fba-4876-90b2-7f9c04b296d2 admin admin] The token cache is being invalidate because project fa0accd14e24477882757b24f5a90f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:41.690259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e593539f-0fba-4876-90b2-7f9c04b296d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:41.691313 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e593539f-0fba-4876-90b2-7f9c04b296d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:41.693002 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 983/1969] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:41 2022] DELETE /identity/v3/projects/fa0accd14e24477882757b24f5a90f8f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:41.698093 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e15aae-6ba3-4eda-b8a1-c409461ddff1 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:41.698596 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e15aae-6ba3-4eda-b8a1-c409461ddff1 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:41.698839 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e15aae-6ba3-4eda-b8a1-c409461ddff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:41.754209 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d1e15aae-6ba3-4eda-b8a1-c409461ddff1 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:41.755509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d1e15aae-6ba3-4eda-b8a1-c409461ddff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:41.869253 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 987/1970] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:41.872011 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9f1e-7d39-416e-b058-eadfc2313163 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:41.876209 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9f1e-7d39-416e-b058-eadfc2313163 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:41.877513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9f1e-7d39-416e-b058-eadfc2313163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:41.905924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e15aae-6ba3-4eda-b8a1-c409461ddff1 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:41.907635 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d1e15aae-6ba3-4eda-b8a1-c409461ddff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:41.924099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-9d3b9f1e-7d39-416e-b058-eadfc2313163 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:41.925803 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e15aae-6ba3-4eda-b8a1-c409461ddff1 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:41.926628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9d3b9f1e-7d39-416e-b058-eadfc2313163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:41.937200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53671812-2e62-453f-a63c-bb3463b65f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:41.938170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53671812-2e62-453f-a63c-bb3463b65f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:41.938456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53671812-2e62-453f-a63c-bb3463b65f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:41.938727 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53671812-2e62-453f-a63c-bb3463b65f74 admin admin] PATH_INFO: `/v3/users/a8dc2f2154c14c65bab843cdf15a9b52` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:41.941869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53671812-2e62-453f-a63c-bb3463b65f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8dc2f2154c14c65bab843cdf15a9b52)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:41.942923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 984/1971] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:41.944273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53671812-2e62-453f-a63c-bb3463b65f74 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:41.947331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9f1e-7d39-416e-b058-eadfc2313163 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:41.958850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9f1e-7d39-416e-b058-eadfc2313163 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:41.966203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ac28-a2ae-4c44-b1a0-a37905ef8d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:41.973634 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ac28-a2ae-4c44-b1a0-a37905ef8d53 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:41.974107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ac28-a2ae-4c44-b1a0-a37905ef8d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:41.974425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ac28-a2ae-4c44-b1a0-a37905ef8d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:41.975142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346ac28-a2ae-4c44-b1a0-a37905ef8d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:41.975445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346ac28-a2ae-4c44-b1a0-a37905ef8d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:41.977078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346ac28-a2ae-4c44-b1a0-a37905ef8d53 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:41.990351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:41.994849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 985/1972] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:41.999958 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ac28-a2ae-4c44-b1a0-a37905ef8d53 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.022343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ac28-a2ae-4c44-b1a0-a37905ef8d53 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.022837 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-53671812-2e62-453f-a63c-bb3463b65f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8dc2f2154c14c65bab843cdf15a9b52'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:42.029558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af826763-2c39-4167-a4c9-a43380e234cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.029891 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af826763-2c39-4167-a4c9-a43380e234cd admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.030161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af826763-2c39-4167-a4c9-a43380e234cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.030426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af826763-2c39-4167-a4c9-a43380e234cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.031061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af826763-2c39-4167-a4c9-a43380e234cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.033618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af826763-2c39-4167-a4c9-a43380e234cd admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.037158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-53671812-2e62-453f-a63c-bb3463b65f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8dc2f2154c14c65bab843cdf15a9b52'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:42.037987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-53671812-2e62-453f-a63c-bb3463b65f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8dc2f2154c14c65bab843cdf15a9b52'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:42.038795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-53671812-2e62-453f-a63c-bb3463b65f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8dc2f2154c14c65bab843cdf15a9b52'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:42.049242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-53671812-2e62-453f-a63c-bb3463b65f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8dc2f2154c14c65bab843cdf15a9b52'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:42.067829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 986/1973] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:41 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:42.068836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af826763-2c39-4167-a4c9-a43380e234cd admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.070524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-af826763-2c39-4167-a4c9-a43380e234cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:42.070952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 988/1974] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:41 2022] DELETE /identity/v3/users/a8dc2f2154c14c65bab843cdf15a9b52 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:42.076307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8ebc-b10b-4951-8298-a4bf5e78440d None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.076705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8ebc-b10b-4951-8298-a4bf5e78440d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.077022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8ebc-b10b-4951-8298-a4bf5e78440d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.104610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-4ffb8ebc-b10b-4951-8298-a4bf5e78440d None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:42.105931 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4ffb8ebc-b10b-4951-8298-a4bf5e78440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:42.166200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:42.173164 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af826763-2c39-4167-a4c9-a43380e234cd admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.193587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 989/1975] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:42.194656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8ebc-b10b-4951-8298-a4bf5e78440d None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.196026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4ffb8ebc-b10b-4951-8298-a4bf5e78440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:42.235179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437ba07-2298-4ce4-8ab9-d57040c2c267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.235925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ba07-2298-4ce4-8ab9-d57040c2c267 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.236203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ba07-2298-4ce4-8ab9-d57040c2c267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.236475 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ba07-2298-4ce4-8ab9-d57040c2c267 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.237107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437ba07-2298-4ce4-8ab9-d57040c2c267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.239079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437ba07-2298-4ce4-8ab9-d57040c2c267 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.257986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8ebc-b10b-4951-8298-a4bf5e78440d None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.262669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da4d9d-a6db-41f4-9a3c-f0149c535ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.263281 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da4d9d-a6db-41f4-9a3c-f0149c535ddf service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.263556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da4d9d-a6db-41f4-9a3c-f0149c535ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.263823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da4d9d-a6db-41f4-9a3c-f0149c535ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.264386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 987/1976] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:42 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:42.268421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437ba07-2298-4ce4-8ab9-d57040c2c267 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.275525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da4d9d-a6db-41f4-9a3c-f0149c535ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.277742 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da4d9d-a6db-41f4-9a3c-f0149c535ddf service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.279162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437ba07-2298-4ce4-8ab9-d57040c2c267 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.283778 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8496a0-72c3-4124-9a4c-3c4bb2947438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.284390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8496a0-72c3-4124-9a4c-3c4bb2947438 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.284669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8496a0-72c3-4124-9a4c-3c4bb2947438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.284937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8496a0-72c3-4124-9a4c-3c4bb2947438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.285614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8496a0-72c3-4124-9a4c-3c4bb2947438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.287251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8496a0-72c3-4124-9a4c-3c4bb2947438 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.289504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 990/1977] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:42.302783 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 988/1978] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:16:42.306842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da4d9d-a6db-41f4-9a3c-f0149c535ddf service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.317820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da4d9d-a6db-41f4-9a3c-f0149c535ddf service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.323821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf703c84-12f6-43bb-8d9e-5cdd81e7013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.323976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf703c84-12f6-43bb-8d9e-5cdd81e7013f admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.324242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf703c84-12f6-43bb-8d9e-5cdd81e7013f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.324507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf703c84-12f6-43bb-8d9e-5cdd81e7013f admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.325148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf703c84-12f6-43bb-8d9e-5cdd81e7013f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.326832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf703c84-12f6-43bb-8d9e-5cdd81e7013f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.341841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 991/1979] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:42.342920 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8496a0-72c3-4124-9a4c-3c4bb2947438 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.353355 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8496a0-72c3-4124-9a4c-3c4bb2947438 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.359360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b18d0-0408-4cd6-96fd-5e990027feba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.360127 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b18d0-0408-4cd6-96fd-5e990027feba admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.360473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b18d0-0408-4cd6-96fd-5e990027feba admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.360832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b18d0-0408-4cd6-96fd-5e990027feba admin admin] PATH_INFO: `/v3/projects/994e2b0fda524823baeff7f0c8c6dc31/users/434dad1233324d1c951ea9e9a60bc5ab/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.377983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b18d0-0408-4cd6-96fd-5e990027feba admin admin] RBAC: Authorizing `identity:create_grant(project_id=994e2b0fda524823baeff7f0c8c6dc31, user_id=434dad1233324d1c951ea9e9a60bc5ab, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.382780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b18d0-0408-4cd6-96fd-5e990027feba admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.402635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 989/1980] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:42 2022] PUT /identity/v3/projects/994e2b0fda524823baeff7f0c8c6dc31/users/434dad1233324d1c951ea9e9a60bc5ab/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:42.414255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ec39-72c1-491e-8faf-af65bbe622fc None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.414688 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ec39-72c1-491e-8faf-af65bbe622fc None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.415323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ec39-72c1-491e-8faf-af65bbe622fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.508239 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-f031ec39-72c1-491e-8faf-af65bbe622fc None None] MFA Rules not processed for user `434dad1233324d1c951ea9e9a60bc5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:42.509634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f031ec39-72c1-491e-8faf-af65bbe622fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:42.640073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 992/1981] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:42.644900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b18d0-0408-4cd6-96fd-5e990027feba admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.693065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:42.726857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b18d0-0408-4cd6-96fd-5e990027feba admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.734337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060c46c-9cc9-452d-885e-02d93f5307a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.735066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c46c-9cc9-452d-885e-02d93f5307a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.735441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c46c-9cc9-452d-885e-02d93f5307a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.735796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c46c-9cc9-452d-885e-02d93f5307a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.736550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060c46c-9cc9-452d-885e-02d93f5307a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.739036 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060c46c-9cc9-452d-885e-02d93f5307a1 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.746783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ec39-72c1-491e-8faf-af65bbe622fc None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.748188 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f031ec39-72c1-491e-8faf-af65bbe622fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:42.786824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ec39-72c1-491e-8faf-af65bbe622fc None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.805185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.806683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.807157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.810691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] PATH_INFO: `/v3/projects/6f05f2d75fd5403e811f2740e9ae1fec` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.812406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f05f2d75fd5403e811f2740e9ae1fec)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.815233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.818717 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 990/1982] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:42 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:42.821697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060c46c-9cc9-452d-885e-02d93f5307a1 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.887323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f05f2d75fd5403e811f2740e9ae1fec', 'request_id': 'req-75f0f356-f516-4c6c-ab97-109f2ff6c995'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:42.900408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f05f2d75fd5403e811f2740e9ae1fec', 'request_id': 'req-75f0f356-f516-4c6c-ab97-109f2ff6c995'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:42.908244 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f05f2d75fd5403e811f2740e9ae1fec', 'request_id': 'req-75f0f356-f516-4c6c-ab97-109f2ff6c995'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:42.909869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060c46c-9cc9-452d-885e-02d93f5307a1 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.922606 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:42.929366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] The token cache is being invalidate because project 6f05f2d75fd5403e811f2740e9ae1fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:42.930292 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:42.931947 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:42.934035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 993/1983] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:42 2022] DELETE /identity/v3/projects/6f05f2d75fd5403e811f2740e9ae1fec => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:42.937491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.945480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:43.022242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f6fe7-9a92-4f0f-9992-3f3d5be53323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:43.024711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f6fe7-9a92-4f0f-9992-3f3d5be53323 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.025886 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f6fe7-9a92-4f0f-9992-3f3d5be53323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.026793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f6fe7-9a92-4f0f-9992-3f3d5be53323 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.028728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f6fe7-9a92-4f0f-9992-3f3d5be53323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:43.032305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f6fe7-9a92-4f0f-9992-3f3d5be53323 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:43.052760 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0f356-f516-4c6c-ab97-109f2ff6c995 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:43.062843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964792d-b52d-4ad0-a9e7-3fcd7837f84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:43.063556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964792d-b52d-4ad0-a9e7-3fcd7837f84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.063831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964792d-b52d-4ad0-a9e7-3fcd7837f84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.064580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964792d-b52d-4ad0-a9e7-3fcd7837f84f admin admin] PATH_INFO: `/v3/users/b9161ca82f3c4027886f137b40648fc0` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.065320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964792d-b52d-4ad0-a9e7-3fcd7837f84f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9161ca82f3c4027886f137b40648fc0)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:43.069704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964792d-b52d-4ad0-a9e7-3fcd7837f84f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:43.109644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 991/1984] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:42 2022] POST /identity/v3/users => generated 298 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:43.115160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f6fe7-9a92-4f0f-9992-3f3d5be53323 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:43.117399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d50f6fe7-9a92-4f0f-9992-3f3d5be53323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:43.140283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f6fe7-9a92-4f0f-9992-3f3d5be53323 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:43.160081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bdf21-5e82-4339-9263-f18fd66897d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:43.160805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bdf21-5e82-4339-9263-f18fd66897d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.161072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bdf21-5e82-4339-9263-f18fd66897d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.161593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bdf21-5e82-4339-9263-f18fd66897d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.162250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bdf21-5e82-4339-9263-f18fd66897d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:43.167842 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bdf21-5e82-4339-9263-f18fd66897d7 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:43.171110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3964792d-b52d-4ad0-a9e7-3fcd7837f84f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9161ca82f3c4027886f137b40648fc0'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:43.186970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3964792d-b52d-4ad0-a9e7-3fcd7837f84f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9161ca82f3c4027886f137b40648fc0'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:43.187707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3964792d-b52d-4ad0-a9e7-3fcd7837f84f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9161ca82f3c4027886f137b40648fc0'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:43.188686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3964792d-b52d-4ad0-a9e7-3fcd7837f84f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9161ca82f3c4027886f137b40648fc0'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:43.199443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 992/1985] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:43.212113 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3964792d-b52d-4ad0-a9e7-3fcd7837f84f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9161ca82f3c4027886f137b40648fc0'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:43.216654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bdf21-5e82-4339-9263-f18fd66897d7 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:43.224570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-cd7bdf21-5e82-4339-9263-f18fd66897d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:43.235288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 994/1986] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:42 2022] DELETE /identity/v3/users/b9161ca82f3c4027886f137b40648fc0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:43.247208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bdf21-5e82-4339-9263-f18fd66897d7 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:43.320541 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:43.344451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3070ac8-e1be-4ec6-97eb-153ae9bbb662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:43.349493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3070ac8-e1be-4ec6-97eb-153ae9bbb662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.349867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3070ac8-e1be-4ec6-97eb-153ae9bbb662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.350204 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3070ac8-e1be-4ec6-97eb-153ae9bbb662 admin admin] PATH_INFO: `/v3/projects/5aa686142fac4412901f287c3ef53dce/users/5f8190c116c44b64a9691b2ba131db3d/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.374642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3070ac8-e1be-4ec6-97eb-153ae9bbb662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa686142fac4412901f287c3ef53dce, user_id=5f8190c116c44b64a9691b2ba131db3d, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:43.379432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3070ac8-e1be-4ec6-97eb-153ae9bbb662 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:43.410856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 993/1987] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:43 2022] PUT /identity/v3/projects/5aa686142fac4412901f287c3ef53dce/users/5f8190c116c44b64a9691b2ba131db3d/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:43.415879 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964792d-b52d-4ad0-a9e7-3fcd7837f84f admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:43.431302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964792d-b52d-4ad0-a9e7-3fcd7837f84f admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:43.502279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fca0c-57e0-4d6d-8163-4dad2ab38f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:43.502996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fca0c-57e0-4d6d-8163-4dad2ab38f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.503341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fca0c-57e0-4d6d-8163-4dad2ab38f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.503680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fca0c-57e0-4d6d-8163-4dad2ab38f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.504402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fca0c-57e0-4d6d-8163-4dad2ab38f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:43.506174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fca0c-57e0-4d6d-8163-4dad2ab38f04 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:43.521514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 995/1988] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:43.523608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3070ac8-e1be-4ec6-97eb-153ae9bbb662 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:43.558419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3070ac8-e1be-4ec6-97eb-153ae9bbb662 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:43.570496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe76b77-bcdc-4b07-a30d-c5b63382bba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:43.571747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe76b77-bcdc-4b07-a30d-c5b63382bba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.571951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe76b77-bcdc-4b07-a30d-c5b63382bba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.572375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe76b77-bcdc-4b07-a30d-c5b63382bba7 admin admin] PATH_INFO: `/v3/projects/5aa686142fac4412901f287c3ef53dce/users/5f8190c116c44b64a9691b2ba131db3d/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.577379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe76b77-bcdc-4b07-a30d-c5b63382bba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa686142fac4412901f287c3ef53dce, user_id=5f8190c116c44b64a9691b2ba131db3d, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:43.583894 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe76b77-bcdc-4b07-a30d-c5b63382bba7 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:43.618361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 994/1989] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:43 2022] PUT /identity/v3/projects/5aa686142fac4412901f287c3ef53dce/users/5f8190c116c44b64a9691b2ba131db3d/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:43.635069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13e156-1210-4518-a46e-ed1c55a02392 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.635459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13e156-1210-4518-a46e-ed1c55a02392 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.635961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13e156-1210-4518-a46e-ed1c55a02392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.687161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ec13e156-1210-4518-a46e-ed1c55a02392 None None] MFA Rules not processed for user `5f8190c116c44b64a9691b2ba131db3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:43.688405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ec13e156-1210-4518-a46e-ed1c55a02392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:43.698303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:43.852511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 996/1990] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:43.862923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe76b77-bcdc-4b07-a30d-c5b63382bba7 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:43.866202 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-cbe76b77-bcdc-4b07-a30d-c5b63382bba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:43.963250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe76b77-bcdc-4b07-a30d-c5b63382bba7 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:43.970516 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d270-724e-4e21-b3bf-ee8b03d1c2fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:43.971768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d270-724e-4e21-b3bf-ee8b03d1c2fa service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.972302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d270-724e-4e21-b3bf-ee8b03d1c2fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.972769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d270-724e-4e21-b3bf-ee8b03d1c2fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.975456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7ce1d270-724e-4e21-b3bf-ee8b03d1c2fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:44.102308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13e156-1210-4518-a46e-ed1c55a02392 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.104811 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ec13e156-1210-4518-a46e-ed1c55a02392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:44.107231 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1d270-724e-4e21-b3bf-ee8b03d1c2fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.109865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1d270-724e-4e21-b3bf-ee8b03d1c2fa service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.140837 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 995/1991] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:44.286512 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13e156-1210-4518-a46e-ed1c55a02392 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.302398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.303062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.303330 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.303596 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1 admin admin] PATH_INFO: `/v3/projects/69cffde372b747cf846675651654f2bf` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.304762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69cffde372b747cf846675651654f2bf)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.306714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.399225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69cffde372b747cf846675651654f2bf', 'request_id': 'req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:44.409143 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69cffde372b747cf846675651654f2bf', 'request_id': 'req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:44.415942 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69cffde372b747cf846675651654f2bf', 'request_id': 'req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:44.427726 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1 admin admin] The token cache is being invalidate because project 69cffde372b747cf846675651654f2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:44.428007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:44.428691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-cf3472ae-2ee0-4d8b-8039-5e62c3a6cdc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:44.430346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 997/1992] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:44 2022] DELETE /identity/v3/projects/69cffde372b747cf846675651654f2bf => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:44.436186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d1d91-bf94-4e79-8392-9cd4e804117d None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.436707 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d1d91-bf94-4e79-8392-9cd4e804117d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.436707 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d1d91-bf94-4e79-8392-9cd4e804117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.465321 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d00d1d91-bf94-4e79-8392-9cd4e804117d None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:44.467007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d00d1d91-bf94-4e79-8392-9cd4e804117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:44.556965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 996/1993] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:44.566207 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb447b0-32d8-4dbd-ac47-3252521b237d None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.566696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb447b0-32d8-4dbd-ac47-3252521b237d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.567256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb447b0-32d8-4dbd-ac47-3252521b237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.589287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-4fb447b0-32d8-4dbd-ac47-3252521b237d None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:44.590586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4fb447b0-32d8-4dbd-ac47-3252521b237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:44.605647 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d1d91-bf94-4e79-8392-9cd4e804117d None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.613702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 998/1994] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:44.630001 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d1d91-bf94-4e79-8392-9cd4e804117d None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.650278 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d09b7-71af-479c-be30-2ddab0f51199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.652390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d09b7-71af-479c-be30-2ddab0f51199 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.652882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d09b7-71af-479c-be30-2ddab0f51199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.654374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d09b7-71af-479c-be30-2ddab0f51199 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.655588 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d09b7-71af-479c-be30-2ddab0f51199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:44.657001 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d09b7-71af-479c-be30-2ddab0f51199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.661008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d09b7-71af-479c-be30-2ddab0f51199 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.677680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:44.714272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb447b0-32d8-4dbd-ac47-3252521b237d None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.717503 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 997/1995] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:44.727023 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb447b0-32d8-4dbd-ac47-3252521b237d None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.738853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd816033-5e12-4078-8660-de6ed6f5c1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.739829 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd816033-5e12-4078-8660-de6ed6f5c1da admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.740461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd816033-5e12-4078-8660-de6ed6f5c1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.740797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd816033-5e12-4078-8660-de6ed6f5c1da admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.741548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd816033-5e12-4078-8660-de6ed6f5c1da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.746498 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd816033-5e12-4078-8660-de6ed6f5c1da admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.781201 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 999/1996] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:44 2022] POST /identity/v3/projects => generated 389 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:44.785766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d09b7-71af-479c-be30-2ddab0f51199 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.801245 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d09b7-71af-479c-be30-2ddab0f51199 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.888346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c475b4-89a3-482a-bdd5-d3dafbc750ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.888989 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c475b4-89a3-482a-bdd5-d3dafbc750ec admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.889305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c475b4-89a3-482a-bdd5-d3dafbc750ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.889571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c475b4-89a3-482a-bdd5-d3dafbc750ec admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.890229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c475b4-89a3-482a-bdd5-d3dafbc750ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.892151 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c475b4-89a3-482a-bdd5-d3dafbc750ec admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.919037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 998/1997] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:44 2022] POST /identity/v3/users => generated 295 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:44.923182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd816033-5e12-4078-8660-de6ed6f5c1da admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.928728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:44.936335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd816033-5e12-4078-8660-de6ed6f5c1da admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.942359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9759fcc-5a6b-49b4-a34a-9c57ec37cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.943157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9759fcc-5a6b-49b4-a34a-9c57ec37cde3 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.943933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9759fcc-5a6b-49b4-a34a-9c57ec37cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.944143 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9759fcc-5a6b-49b4-a34a-9c57ec37cde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.945008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9759fcc-5a6b-49b4-a34a-9c57ec37cde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.947220 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9759fcc-5a6b-49b4-a34a-9c57ec37cde3 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.959534 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1000/1998] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:44.964032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c475b4-89a3-482a-bdd5-d3dafbc750ec admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.974715 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c475b4-89a3-482a-bdd5-d3dafbc750ec admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.979670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d88ba-49f2-47d2-81f8-6e08f19dd52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.980286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d88ba-49f2-47d2-81f8-6e08f19dd52c admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.980561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d88ba-49f2-47d2-81f8-6e08f19dd52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.980832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d88ba-49f2-47d2-81f8-6e08f19dd52c admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.981518 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d88ba-49f2-47d2-81f8-6e08f19dd52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.983155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d88ba-49f2-47d2-81f8-6e08f19dd52c admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.993791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 999/1999] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:44.998846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9759fcc-5a6b-49b4-a34a-9c57ec37cde3 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:45.012172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9759fcc-5a6b-49b4-a34a-9c57ec37cde3 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:45.019911 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87a99b-1740-4d05-bab9-d067fdb42347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:45.021270 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87a99b-1740-4d05-bab9-d067fdb42347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.021626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87a99b-1740-4d05-bab9-d067fdb42347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.022009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87a99b-1740-4d05-bab9-d067fdb42347 admin admin] PATH_INFO: `/v3/projects/dcc081fe8da248b5b6c0633b320f51f2/users/6227cdb4f6894fc6bece8340d32420bd/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.038940 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87a99b-1740-4d05-bab9-d067fdb42347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcc081fe8da248b5b6c0633b320f51f2, user_id=6227cdb4f6894fc6bece8340d32420bd, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:45.041659 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87a99b-1740-4d05-bab9-d067fdb42347 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:45.056761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1001/2000] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:44 2022] PUT /identity/v3/projects/dcc081fe8da248b5b6c0633b320f51f2/users/6227cdb4f6894fc6bece8340d32420bd/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:45.068373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e8545-26c0-4631-a608-88ac6351b29e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.068653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e8545-26c0-4631-a608-88ac6351b29e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.068919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e8545-26c0-4631-a608-88ac6351b29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.102253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-da6e8545-26c0-4631-a608-88ac6351b29e None None] MFA Rules not processed for user `6227cdb4f6894fc6bece8340d32420bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:45.104118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-da6e8545-26c0-4631-a608-88ac6351b29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:45.188288 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1000/2001] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:45.192982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87a99b-1740-4d05-bab9-d067fdb42347 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:45.258675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87a99b-1740-4d05-bab9-d067fdb42347 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:45.267449 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39297d7-1db3-464c-b9a7-9c1ff00fd430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:45.268060 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39297d7-1db3-464c-b9a7-9c1ff00fd430 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.268338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39297d7-1db3-464c-b9a7-9c1ff00fd430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.268610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39297d7-1db3-464c-b9a7-9c1ff00fd430 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.269276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39297d7-1db3-464c-b9a7-9c1ff00fd430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:45.271610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39297d7-1db3-464c-b9a7-9c1ff00fd430 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:45.302213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1002/2002] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:45 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:45.306241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e8545-26c0-4631-a608-88ac6351b29e None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:45.317293 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e8545-26c0-4631-a608-88ac6351b29e None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:45.374300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dedd2-10c7-4e93-982f-01f081d34354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:45.374952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dedd2-10c7-4e93-982f-01f081d34354 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.375234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dedd2-10c7-4e93-982f-01f081d34354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.375500 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dedd2-10c7-4e93-982f-01f081d34354 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.376165 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dedd2-10c7-4e93-982f-01f081d34354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:45.378141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dedd2-10c7-4e93-982f-01f081d34354 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:45.395636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:45.402875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1001/2003] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:45 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:45.406862 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39297d7-1db3-464c-b9a7-9c1ff00fd430 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:45.417379 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39297d7-1db3-464c-b9a7-9c1ff00fd430 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:45.422289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15eb86-b20e-4397-b37f-2c2ac3d73b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:45.422973 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15eb86-b20e-4397-b37f-2c2ac3d73b6a admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.423313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15eb86-b20e-4397-b37f-2c2ac3d73b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.423644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15eb86-b20e-4397-b37f-2c2ac3d73b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.424447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15eb86-b20e-4397-b37f-2c2ac3d73b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:45.426065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15eb86-b20e-4397-b37f-2c2ac3d73b6a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:45.437578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1003/2004] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:45.441925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dedd2-10c7-4e93-982f-01f081d34354 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:45.454752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dedd2-10c7-4e93-982f-01f081d34354 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:45.459811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901d588-9e1a-4ab9-918a-c72f4e2aaf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:45.460591 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901d588-9e1a-4ab9-918a-c72f4e2aaf6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.460951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901d588-9e1a-4ab9-918a-c72f4e2aaf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.461321 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901d588-9e1a-4ab9-918a-c72f4e2aaf6e admin admin] PATH_INFO: `/v3/projects/023fa8f157e94026a243b2a14827b7a4/users/56fa10b3e2bb4ce193e30453adc7ba04/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.477396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901d588-9e1a-4ab9-918a-c72f4e2aaf6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=023fa8f157e94026a243b2a14827b7a4, user_id=56fa10b3e2bb4ce193e30453adc7ba04, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:45.480162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901d588-9e1a-4ab9-918a-c72f4e2aaf6e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:45.494232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1002/2005] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:45 2022] PUT /identity/v3/projects/023fa8f157e94026a243b2a14827b7a4/users/56fa10b3e2bb4ce193e30453adc7ba04/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:45.498751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15eb86-b20e-4397-b37f-2c2ac3d73b6a admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:45.508607 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15eb86-b20e-4397-b37f-2c2ac3d73b6a admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:45.572335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba9a73-bacb-477c-87c5-c08f0f2f413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:45.573014 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba9a73-bacb-477c-87c5-c08f0f2f413b admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.573325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba9a73-bacb-477c-87c5-c08f0f2f413b admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.573695 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba9a73-bacb-477c-87c5-c08f0f2f413b admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.574340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba9a73-bacb-477c-87c5-c08f0f2f413b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:45.575942 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba9a73-bacb-477c-87c5-c08f0f2f413b admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:45.585718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1004/2006] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:45.590189 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901d588-9e1a-4ab9-918a-c72f4e2aaf6e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:45.601772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901d588-9e1a-4ab9-918a-c72f4e2aaf6e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:45.606706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ce747-8420-42c3-a857-1eceef126e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:45.607365 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ce747-8420-42c3-a857-1eceef126e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.607756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ce747-8420-42c3-a857-1eceef126e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.608030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ce747-8420-42c3-a857-1eceef126e9f admin admin] PATH_INFO: `/v3/projects/023fa8f157e94026a243b2a14827b7a4/users/56fa10b3e2bb4ce193e30453adc7ba04/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.610034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ce747-8420-42c3-a857-1eceef126e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=023fa8f157e94026a243b2a14827b7a4, user_id=56fa10b3e2bb4ce193e30453adc7ba04, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:45.612695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ce747-8420-42c3-a857-1eceef126e9f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:45.624015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1003/2007] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:45 2022] PUT /identity/v3/projects/023fa8f157e94026a243b2a14827b7a4/users/56fa10b3e2bb4ce193e30453adc7ba04/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:45.634603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cacb93-8ea5-490c-bac8-f403a9c00a25 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.634968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cacb93-8ea5-490c-bac8-f403a9c00a25 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.635294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cacb93-8ea5-490c-bac8-f403a9c00a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.664645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d8cacb93-8ea5-490c-bac8-f403a9c00a25 None None] MFA Rules not processed for user `56fa10b3e2bb4ce193e30453adc7ba04`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:45.665894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d8cacb93-8ea5-490c-bac8-f403a9c00a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:45.692793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:45.747327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1005/2008] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:45 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:45.760866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ce747-8420-42c3-a857-1eceef126e9f admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:45.762976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f17ce747-8420-42c3-a857-1eceef126e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:45.831838 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ce747-8420-42c3-a857-1eceef126e9f admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:45.836011 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942b5ac-88f6-4ebb-b0e6-9ea4dad270c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:45.836729 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942b5ac-88f6-4ebb-b0e6-9ea4dad270c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.837071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942b5ac-88f6-4ebb-b0e6-9ea4dad270c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.837456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942b5ac-88f6-4ebb-b0e6-9ea4dad270c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.848296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942b5ac-88f6-4ebb-b0e6-9ea4dad270c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:45.850075 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942b5ac-88f6-4ebb-b0e6-9ea4dad270c3 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:45.869494 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1004/2009] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:45 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:46.005121 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cacb93-8ea5-490c-bac8-f403a9c00a25 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:46.076069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cacb93-8ea5-490c-bac8-f403a9c00a25 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:46.080904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:46.081591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:46.081858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:46.082122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] PATH_INFO: `/v3/users/6227cdb4f6894fc6bece8340d32420bd` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:46.095878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6227cdb4f6894fc6bece8340d32420bd)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:46.095878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:46.143087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6227cdb4f6894fc6bece8340d32420bd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:46.155950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6227cdb4f6894fc6bece8340d32420bd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:46.156661 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6227cdb4f6894fc6bece8340d32420bd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:46.157289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6227cdb4f6894fc6bece8340d32420bd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:46.165660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6227cdb4f6894fc6bece8340d32420bd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:46.178462 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1006/2010] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:46 2022] DELETE /identity/v3/users/6227cdb4f6894fc6bece8340d32420bd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:46.184568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9fe4d-18cd-4eb2-8817-ff974ab7c9ae None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:46.184987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9fe4d-18cd-4eb2-8817-ff974ab7c9ae None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:46.185460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9fe4d-18cd-4eb2-8817-ff974ab7c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:46.233897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-87d9fe4d-18cd-4eb2-8817-ff974ab7c9ae None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:46.238195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-87d9fe4d-18cd-4eb2-8817-ff974ab7c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:46.316573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1005/2011] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:46.326256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:46.327771 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:46.400298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:46.423711 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9030e-207b-4763-994e-0d6ad5be22fe admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:46.428015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4405-a8a7-41b6-b506-ab9ce107f536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:46.428920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4405-a8a7-41b6-b506-ab9ce107f536 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:46.430233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4405-a8a7-41b6-b506-ab9ce107f536 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:46.430640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4405-a8a7-41b6-b506-ab9ce107f536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:46.445632 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4405-a8a7-41b6-b506-ab9ce107f536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:46.447701 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4405-a8a7-41b6-b506-ab9ce107f536 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:46.495623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1007/2012] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:47.018604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9fe4d-18cd-4eb2-8817-ff974ab7c9ae None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:47.020436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-87d9fe4d-18cd-4eb2-8817-ff974ab7c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:47.033816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9fe4d-18cd-4eb2-8817-ff974ab7c9ae None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:47.042067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:47.043236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:47.043774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:47.044310 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] PATH_INFO: `/v3/projects/dcc081fe8da248b5b6c0633b320f51f2` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:47.046330 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcc081fe8da248b5b6c0633b320f51f2)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:47.048112 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:47.162791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcc081fe8da248b5b6c0633b320f51f2', 'request_id': 'req-60eb08ee-c588-4b4c-b7da-78d0d784aa92'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:47.181784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcc081fe8da248b5b6c0633b320f51f2', 'request_id': 'req-60eb08ee-c588-4b4c-b7da-78d0d784aa92'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:47.185669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:47.197763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcc081fe8da248b5b6c0633b320f51f2', 'request_id': 'req-60eb08ee-c588-4b4c-b7da-78d0d784aa92'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:47.211943 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] The token cache is being invalidate because project dcc081fe8da248b5b6c0633b320f51f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:47.212296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:47.213183 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:47.215666 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1006/2013] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:47 2022] DELETE /identity/v3/projects/dcc081fe8da248b5b6c0633b320f51f2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:47.220347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4405-a8a7-41b6-b506-ab9ce107f536 service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:47.242222 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4405-a8a7-41b6-b506-ab9ce107f536 service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:47.399338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2901a2-6e4f-4161-a918-faf564b3ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:47.400641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2901a2-6e4f-4161-a918-faf564b3ae10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:47.400936 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2901a2-6e4f-4161-a918-faf564b3ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:47.401490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2901a2-6e4f-4161-a918-faf564b3ae10 admin admin] PATH_INFO: `/v3/users/56fa10b3e2bb4ce193e30453adc7ba04` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:47.403613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2901a2-6e4f-4161-a918-faf564b3ae10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56fa10b3e2bb4ce193e30453adc7ba04)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:47.406279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2901a2-6e4f-4161-a918-faf564b3ae10 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:47.488832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dc2901a2-6e4f-4161-a918-faf564b3ae10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56fa10b3e2bb4ce193e30453adc7ba04'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:47.509170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dc2901a2-6e4f-4161-a918-faf564b3ae10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56fa10b3e2bb4ce193e30453adc7ba04'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:47.514373 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dc2901a2-6e4f-4161-a918-faf564b3ae10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56fa10b3e2bb4ce193e30453adc7ba04'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:47.518300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dc2901a2-6e4f-4161-a918-faf564b3ae10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56fa10b3e2bb4ce193e30453adc7ba04'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:47.531225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dc2901a2-6e4f-4161-a918-faf564b3ae10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56fa10b3e2bb4ce193e30453adc7ba04'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:47.558518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1008/2014] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:47 2022] DELETE /identity/v3/users/56fa10b3e2bb4ce193e30453adc7ba04 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:48.361747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:48.364166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:48.399106 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb08ee-c588-4b4c-b7da-78d0d784aa92 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:48.498362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:48.499049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.499322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.499592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5 admin admin] PATH_INFO: `/v3/projects/023fa8f157e94026a243b2a14827b7a4` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.500857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=023fa8f157e94026a243b2a14827b7a4)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:48.503266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:48.561689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023fa8f157e94026a243b2a14827b7a4', 'request_id': 'req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:48.570397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023fa8f157e94026a243b2a14827b7a4', 'request_id': 'req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:48.578123 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023fa8f157e94026a243b2a14827b7a4', 'request_id': 'req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:48.589439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5 admin admin] The token cache is being invalidate because project 023fa8f157e94026a243b2a14827b7a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:48.589787 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:48.590446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c83b656e-db8a-49fc-bbf3-e9104ad3c1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:48.592857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1007/2015] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:48 2022] DELETE /identity/v3/projects/023fa8f157e94026a243b2a14827b7a4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:48.597922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9f8c1-d8cf-4352-a9a0-e28b11b05ea8 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.598466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9f8c1-d8cf-4352-a9a0-e28b11b05ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.598559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9f8c1-d8cf-4352-a9a0-e28b11b05ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.624477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-9dd9f8c1-d8cf-4352-a9a0-e28b11b05ea8 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:48.625904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-9dd9f8c1-d8cf-4352-a9a0-e28b11b05ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:48.708995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1009/2016] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:48.711427 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d61f0-8bea-4919-bb4a-45b812bb5913 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.711427 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d61f0-8bea-4919-bb4a-45b812bb5913 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.711814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d61f0-8bea-4919-bb4a-45b812bb5913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.740983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-f38d61f0-8bea-4919-bb4a-45b812bb5913 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:48.742320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f38d61f0-8bea-4919-bb4a-45b812bb5913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:48.752587 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1008/2017] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:48.759639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9f8c1-d8cf-4352-a9a0-e28b11b05ea8 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:48.766308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:48.771213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9f8c1-d8cf-4352-a9a0-e28b11b05ea8 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:48.777311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdf7e6-b3ed-4e1b-82bb-05e0963a1ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:48.778495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdf7e6-b3ed-4e1b-82bb-05e0963a1ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.779202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdf7e6-b3ed-4e1b-82bb-05e0963a1ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.779576 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdf7e6-b3ed-4e1b-82bb-05e0963a1ad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.780872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdf7e6-b3ed-4e1b-82bb-05e0963a1ad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:48.780872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdf7e6-b3ed-4e1b-82bb-05e0963a1ad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:48.783946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdf7e6-b3ed-4e1b-82bb-05e0963a1ad4 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:48.804815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1010/2018] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:48.806562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d61f0-8bea-4919-bb4a-45b812bb5913 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:48.816426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d61f0-8bea-4919-bb4a-45b812bb5913 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:48.823737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c273c34-29b3-4b97-9663-724a5d811003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:48.824242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c273c34-29b3-4b97-9663-724a5d811003 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.824517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c273c34-29b3-4b97-9663-724a5d811003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.824781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c273c34-29b3-4b97-9663-724a5d811003 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.825450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c273c34-29b3-4b97-9663-724a5d811003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:48.827540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c273c34-29b3-4b97-9663-724a5d811003 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:48.858482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1009/2019] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:48 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:48.863251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdf7e6-b3ed-4e1b-82bb-05e0963a1ad4 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:48.874374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdf7e6-b3ed-4e1b-82bb-05e0963a1ad4 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:48.943168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78492e73-e230-4d2e-9f8b-860b3ce4bf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:48.943836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78492e73-e230-4d2e-9f8b-860b3ce4bf14 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.944111 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78492e73-e230-4d2e-9f8b-860b3ce4bf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.944385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78492e73-e230-4d2e-9f8b-860b3ce4bf14 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.945048 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78492e73-e230-4d2e-9f8b-860b3ce4bf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:48.947346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78492e73-e230-4d2e-9f8b-860b3ce4bf14 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:48.972437 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1011/2020] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:48 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:48.976485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c273c34-29b3-4b97-9663-724a5d811003 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:48.987329 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c273c34-29b3-4b97-9663-724a5d811003 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:49.009530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a6ff-6bbe-4835-a8db-0b53d5d0a0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.010270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a6ff-6bbe-4835-a8db-0b53d5d0a0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.010536 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a6ff-6bbe-4835-a8db-0b53d5d0a0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.010804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a6ff-6bbe-4835-a8db-0b53d5d0a0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.015644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936a6ff-6bbe-4835-a8db-0b53d5d0a0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.017439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936a6ff-6bbe-4835-a8db-0b53d5d0a0b2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.045186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1010/2021] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:16:49.049935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78492e73-e230-4d2e-9f8b-860b3ce4bf14 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.063446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78492e73-e230-4d2e-9f8b-860b3ce4bf14 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:49.071332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8f8ed-1c8f-4b78-b896-8babc302adf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.072082 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8f8ed-1c8f-4b78-b896-8babc302adf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.072479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8f8ed-1c8f-4b78-b896-8babc302adf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.073020 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8f8ed-1c8f-4b78-b896-8babc302adf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.074343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8f8ed-1c8f-4b78-b896-8babc302adf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.075918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8f8ed-1c8f-4b78-b896-8babc302adf0 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.111408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1012/2022] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:49.115020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a6ff-6bbe-4835-a8db-0b53d5d0a0b2 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.128264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a6ff-6bbe-4835-a8db-0b53d5d0a0b2 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:49.135957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78500b7e-d0f8-44f7-a78e-ca24573fa890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.137728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78500b7e-d0f8-44f7-a78e-ca24573fa890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.138390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78500b7e-d0f8-44f7-a78e-ca24573fa890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.139057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78500b7e-d0f8-44f7-a78e-ca24573fa890 admin admin] PATH_INFO: `/v3/projects/ea6650ec479c400190d659acd5abc706/users/70b354c44e244f908ae2e510d0f23699/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.158415 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78500b7e-d0f8-44f7-a78e-ca24573fa890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6650ec479c400190d659acd5abc706, user_id=70b354c44e244f908ae2e510d0f23699, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.162723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78500b7e-d0f8-44f7-a78e-ca24573fa890 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.182231 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1011/2023] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:49 2022] PUT /identity/v3/projects/ea6650ec479c400190d659acd5abc706/users/70b354c44e244f908ae2e510d0f23699/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:49.193895 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016acc2b-a02d-4714-a401-e3ffd9e29d7d None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.194190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016acc2b-a02d-4714-a401-e3ffd9e29d7d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.194445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016acc2b-a02d-4714-a401-e3ffd9e29d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.227100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-016acc2b-a02d-4714-a401-e3ffd9e29d7d None None] MFA Rules not processed for user `70b354c44e244f908ae2e510d0f23699`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:49.228423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-016acc2b-a02d-4714-a401-e3ffd9e29d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:49.321067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1013/2024] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:49.321371 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78500b7e-d0f8-44f7-a78e-ca24573fa890 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.334830 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:49.403388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78500b7e-d0f8-44f7-a78e-ca24573fa890 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:49.408802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e6687-448d-45ad-984a-9e19ee2a8598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.409384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e6687-448d-45ad-984a-9e19ee2a8598 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.409756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e6687-448d-45ad-984a-9e19ee2a8598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.410117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e6687-448d-45ad-984a-9e19ee2a8598 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.410850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e6687-448d-45ad-984a-9e19ee2a8598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.412993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e6687-448d-45ad-984a-9e19ee2a8598 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.443302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1012/2025] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:49 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:49.447498 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016acc2b-a02d-4714-a401-e3ffd9e29d7d None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.481039 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016acc2b-a02d-4714-a401-e3ffd9e29d7d None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:49.572012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7422c0d-c22d-402c-a950-ab3754f3c90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.573580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7422c0d-c22d-402c-a950-ab3754f3c90f admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.574278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7422c0d-c22d-402c-a950-ab3754f3c90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.574278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7422c0d-c22d-402c-a950-ab3754f3c90f admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.575827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7422c0d-c22d-402c-a950-ab3754f3c90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.579137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7422c0d-c22d-402c-a950-ab3754f3c90f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.590142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:49.609860 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1014/2026] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:49 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:49.613947 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e6687-448d-45ad-984a-9e19ee2a8598 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.626117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e6687-448d-45ad-984a-9e19ee2a8598 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:49.631773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712db57-1f1f-4f54-8201-ef0fe4d5111d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.632396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712db57-1f1f-4f54-8201-ef0fe4d5111d admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.632661 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712db57-1f1f-4f54-8201-ef0fe4d5111d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.632923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712db57-1f1f-4f54-8201-ef0fe4d5111d admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.633960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712db57-1f1f-4f54-8201-ef0fe4d5111d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.635222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712db57-1f1f-4f54-8201-ef0fe4d5111d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.650222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1013/2027] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:49.651627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7422c0d-c22d-402c-a950-ab3754f3c90f admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.662218 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7422c0d-c22d-402c-a950-ab3754f3c90f admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:49.667543 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f16ace-4143-400b-ac64-218922e6ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.668245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f16ace-4143-400b-ac64-218922e6ab35 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.668578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f16ace-4143-400b-ac64-218922e6ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.668915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f16ace-4143-400b-ac64-218922e6ab35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.669658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f16ace-4143-400b-ac64-218922e6ab35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.671323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f16ace-4143-400b-ac64-218922e6ab35 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.685462 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1015/2028] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:49.689666 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712db57-1f1f-4f54-8201-ef0fe4d5111d admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.705028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712db57-1f1f-4f54-8201-ef0fe4d5111d admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:49.716641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3515cad-a07c-4a42-a93e-284f9197e9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.717396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3515cad-a07c-4a42-a93e-284f9197e9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.717671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3515cad-a07c-4a42-a93e-284f9197e9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.717946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3515cad-a07c-4a42-a93e-284f9197e9d5 admin admin] PATH_INFO: `/v3/projects/73b9db9dce614e509817f0fabbdb3b3b/users/ed189d69209f44c892988518e7d59eff/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.751036 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3515cad-a07c-4a42-a93e-284f9197e9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b9db9dce614e509817f0fabbdb3b3b, user_id=ed189d69209f44c892988518e7d59eff, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.753761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3515cad-a07c-4a42-a93e-284f9197e9d5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.775129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1014/2029] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:49 2022] PUT /identity/v3/projects/73b9db9dce614e509817f0fabbdb3b3b/users/ed189d69209f44c892988518e7d59eff/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:49.785557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec7b9a-bdb4-4c4c-8827-297c54864635 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.785851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec7b9a-bdb4-4c4c-8827-297c54864635 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.786132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec7b9a-bdb4-4c4c-8827-297c54864635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.835920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-86ec7b9a-bdb4-4c4c-8827-297c54864635 None None] MFA Rules not processed for user `ed189d69209f44c892988518e7d59eff`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:49.837359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-86ec7b9a-bdb4-4c4c-8827-297c54864635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:49.996826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3515cad-a07c-4a42-a93e-284f9197e9d5 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.998950 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a3515cad-a07c-4a42-a93e-284f9197e9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:50.029251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1016/2030] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:50.032160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec7b9a-bdb4-4c4c-8827-297c54864635 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:50.118238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3515cad-a07c-4a42-a93e-284f9197e9d5 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:50.123361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ca76e-f903-4cf4-9e29-53ad82ba2c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:50.124249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ca76e-f903-4cf4-9e29-53ad82ba2c94 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:50.124695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ca76e-f903-4cf4-9e29-53ad82ba2c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:50.125133 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ca76e-f903-4cf4-9e29-53ad82ba2c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:50.127317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ae1ca76e-f903-4cf4-9e29-53ad82ba2c94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:50.156812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec7b9a-bdb4-4c4c-8827-297c54864635 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:50.174682 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf40e74-6a0a-4b9d-a91f-78d4edafe343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:50.176331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf40e74-6a0a-4b9d-a91f-78d4edafe343 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:50.176856 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf40e74-6a0a-4b9d-a91f-78d4edafe343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:50.177254 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf40e74-6a0a-4b9d-a91f-78d4edafe343 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:50.178343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf40e74-6a0a-4b9d-a91f-78d4edafe343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:50.181139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf40e74-6a0a-4b9d-a91f-78d4edafe343 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:50.207276 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ca76e-f903-4cf4-9e29-53ad82ba2c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:50.209028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ca76e-f903-4cf4-9e29-53ad82ba2c94 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:50.216748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1017/2031] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:50 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:50.219890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1015/2032] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:50.220748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ca76e-f903-4cf4-9e29-53ad82ba2c94 service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:50.233502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ca76e-f903-4cf4-9e29-53ad82ba2c94 service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:50.244479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:50.304223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b730ce5-de61-405c-b59f-c6766f19bb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:50.304978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b730ce5-de61-405c-b59f-c6766f19bb69 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:50.305357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b730ce5-de61-405c-b59f-c6766f19bb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:50.305695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b730ce5-de61-405c-b59f-c6766f19bb69 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:50.306500 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b730ce5-de61-405c-b59f-c6766f19bb69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:50.308584 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b730ce5-de61-405c-b59f-c6766f19bb69 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:50.341179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1016/2033] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:50 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:50.342106 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf40e74-6a0a-4b9d-a91f-78d4edafe343 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:50.352534 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf40e74-6a0a-4b9d-a91f-78d4edafe343 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:50.365111 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70748c22-8f5e-4650-b604-239a0e77cd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:50.365853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70748c22-8f5e-4650-b604-239a0e77cd3e admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:50.367450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70748c22-8f5e-4650-b604-239a0e77cd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:50.368463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70748c22-8f5e-4650-b604-239a0e77cd3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:50.369172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70748c22-8f5e-4650-b604-239a0e77cd3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:50.372791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70748c22-8f5e-4650-b604-239a0e77cd3e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:50.387727 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1018/2034] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:50.391469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b730ce5-de61-405c-b59f-c6766f19bb69 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:50.408631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b730ce5-de61-405c-b59f-c6766f19bb69 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:50.417121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbe810-8c91-45fe-9438-5b889e80f89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:50.418343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbe810-8c91-45fe-9438-5b889e80f89a admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:50.418940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbe810-8c91-45fe-9438-5b889e80f89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:50.419454 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbe810-8c91-45fe-9438-5b889e80f89a admin admin] PATH_INFO: `/v3/projects/cdb5d0124bd8418b890c0f9d0ecc6ed8/users/8e6d67f720254cd8b21c7fa9f5a4b666/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:50.442224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbe810-8c91-45fe-9438-5b889e80f89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb5d0124bd8418b890c0f9d0ecc6ed8, user_id=8e6d67f720254cd8b21c7fa9f5a4b666, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:50.446046 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbe810-8c91-45fe-9438-5b889e80f89a admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:50.465622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1017/2035] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:50 2022] PUT /identity/v3/projects/cdb5d0124bd8418b890c0f9d0ecc6ed8/users/8e6d67f720254cd8b21c7fa9f5a4b666/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:50.469633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70748c22-8f5e-4650-b604-239a0e77cd3e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:50.483606 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70748c22-8f5e-4650-b604-239a0e77cd3e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:50.568714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:50.632058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424d2f6-7c00-4eb5-8abc-b5a9c92f5387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:50.634805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424d2f6-7c00-4eb5-8abc-b5a9c92f5387 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:50.634805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424d2f6-7c00-4eb5-8abc-b5a9c92f5387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:50.634805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424d2f6-7c00-4eb5-8abc-b5a9c92f5387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:50.635868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424d2f6-7c00-4eb5-8abc-b5a9c92f5387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:50.637460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424d2f6-7c00-4eb5-8abc-b5a9c92f5387 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:50.662845 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1019/2036] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:50.667575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbe810-8c91-45fe-9438-5b889e80f89a admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:50.683422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbe810-8c91-45fe-9438-5b889e80f89a admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:50.688470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b857e0-d6bf-4437-a394-86b147fdf034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:50.689177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b857e0-d6bf-4437-a394-86b147fdf034 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:50.689482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b857e0-d6bf-4437-a394-86b147fdf034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:50.689751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b857e0-d6bf-4437-a394-86b147fdf034 admin admin] PATH_INFO: `/v3/projects/cdb5d0124bd8418b890c0f9d0ecc6ed8/users/8e6d67f720254cd8b21c7fa9f5a4b666/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:50.691793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b857e0-d6bf-4437-a394-86b147fdf034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb5d0124bd8418b890c0f9d0ecc6ed8, user_id=8e6d67f720254cd8b21c7fa9f5a4b666, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:50.694904 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b857e0-d6bf-4437-a394-86b147fdf034 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:50.707408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1018/2037] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:50 2022] PUT /identity/v3/projects/cdb5d0124bd8418b890c0f9d0ecc6ed8/users/8e6d67f720254cd8b21c7fa9f5a4b666/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:50.718990 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90bb9-3629-48c1-b660-e121c3c09fb4 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:50.719366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90bb9-3629-48c1-b660-e121c3c09fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:50.719591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90bb9-3629-48c1-b660-e121c3c09fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:50.758305 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-96a90bb9-3629-48c1-b660-e121c3c09fb4 None None] MFA Rules not processed for user `8e6d67f720254cd8b21c7fa9f5a4b666`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:50.766835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-96a90bb9-3629-48c1-b660-e121c3c09fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:50.856667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1020/2038] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:50.868199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b857e0-d6bf-4437-a394-86b147fdf034 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:50.929847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b857e0-d6bf-4437-a394-86b147fdf034 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:50.933662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d5e8b-25f4-4136-b2a1-5d56ea268ef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:50.934248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d5e8b-25f4-4136-b2a1-5d56ea268ef3 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:50.934525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d5e8b-25f4-4136-b2a1-5d56ea268ef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:50.934791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d5e8b-25f4-4136-b2a1-5d56ea268ef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:50.944358 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d5e8b-25f4-4136-b2a1-5d56ea268ef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:50.947231 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d5e8b-25f4-4136-b2a1-5d56ea268ef3 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:50.956086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1019/2039] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:51.002365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90bb9-3629-48c1-b660-e121c3c09fb4 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:51.003834 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-96a90bb9-3629-48c1-b660-e121c3c09fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:51.022410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90bb9-3629-48c1-b660-e121c3c09fb4 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:51.027273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3e2f6-2fdd-4845-a218-ff764d2a1d4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:51.028024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3e2f6-2fdd-4845-a218-ff764d2a1d4a service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:51.028299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3e2f6-2fdd-4845-a218-ff764d2a1d4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:51.028641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3e2f6-2fdd-4845-a218-ff764d2a1d4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:51.106335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3e2f6-2fdd-4845-a218-ff764d2a1d4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:51.107833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3e2f6-2fdd-4845-a218-ff764d2a1d4a service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:51.120095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1021/2040] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:54.541610 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d5e8b-25f4-4136-b2a1-5d56ea268ef3 service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:54.639661 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d5e8b-25f4-4136-b2a1-5d56ea268ef3 service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:54.653246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:54.654559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:54.654559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:54.654918 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] PATH_INFO: `/v3/users/70b354c44e244f908ae2e510d0f23699` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:54.656198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b354c44e244f908ae2e510d0f23699)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:54.658547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:54.671121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:54.751603 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b354c44e244f908ae2e510d0f23699'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:54.763456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b354c44e244f908ae2e510d0f23699'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:54.764436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b354c44e244f908ae2e510d0f23699'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:54.774830 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b354c44e244f908ae2e510d0f23699'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:54.791600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b354c44e244f908ae2e510d0f23699'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:54.799318 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1020/2041] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:54 2022] DELETE /identity/v3/users/70b354c44e244f908ae2e510d0f23699 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:54.804183 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f770d3-d5ab-42a9-bbbd-dc6eac464037 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:54.804654 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f770d3-d5ab-42a9-bbbd-dc6eac464037 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:54.804864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f770d3-d5ab-42a9-bbbd-dc6eac464037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:54.827240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-23f770d3-d5ab-42a9-bbbd-dc6eac464037 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:54.830042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-23f770d3-d5ab-42a9-bbbd-dc6eac464037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:54.940196 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1022/2042] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:54.951962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:54.953575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:55.056675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0700dae-61dd-439e-8202-13adf96ecda0 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:55.066225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a5998-6e6f-4749-8143-352fc6b3c304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:55.066890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a5998-6e6f-4749-8143-352fc6b3c304 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:55.067163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a5998-6e6f-4749-8143-352fc6b3c304 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:55.067434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a5998-6e6f-4749-8143-352fc6b3c304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:55.102634 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a5998-6e6f-4749-8143-352fc6b3c304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:55.104488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a5998-6e6f-4749-8143-352fc6b3c304 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:55.115314 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1021/2043] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:55.497026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f770d3-d5ab-42a9-bbbd-dc6eac464037 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:55.498480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-23f770d3-d5ab-42a9-bbbd-dc6eac464037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:55.509899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:55.524946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f770d3-d5ab-42a9-bbbd-dc6eac464037 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:55.550205 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:55.551736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:55.552017 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:55.552294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] PATH_INFO: `/v3/users/434dad1233324d1c951ea9e9a60bc5ab` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:55.557549 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=434dad1233324d1c951ea9e9a60bc5ab)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:55.570445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:55.672837 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434dad1233324d1c951ea9e9a60bc5ab'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:55.693658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434dad1233324d1c951ea9e9a60bc5ab'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:55.694894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434dad1233324d1c951ea9e9a60bc5ab'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:55.695719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434dad1233324d1c951ea9e9a60bc5ab'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:55.717638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434dad1233324d1c951ea9e9a60bc5ab'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:55.756983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1023/2044] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:55 2022] DELETE /identity/v3/users/434dad1233324d1c951ea9e9a60bc5ab => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:55.761661 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9707590-2430-4f2b-9b31-5968156789ee None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:55.762164 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9707590-2430-4f2b-9b31-5968156789ee None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:55.762350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9707590-2430-4f2b-9b31-5968156789ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:55.786803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-f9707590-2430-4f2b-9b31-5968156789ee None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:55.788210 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f9707590-2430-4f2b-9b31-5968156789ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:55.830130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:55.834277 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:55.914979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1022/2045] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:55.924359 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9707590-2430-4f2b-9b31-5968156789ee None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:55.925802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f9707590-2430-4f2b-9b31-5968156789ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:55.975289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:55.987846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad61a3-0416-4f34-af78-230859c5a49e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:55.993270 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:55.994176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:55.994919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:55.995984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] PATH_INFO: `/v3/projects/ea6650ec479c400190d659acd5abc706` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:56.000386 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea6650ec479c400190d659acd5abc706)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:56.002362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:56.016931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9707590-2430-4f2b-9b31-5968156789ee None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:56.023397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69040014-4452-437b-bcc1-312020214792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:56.024041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69040014-4452-437b-bcc1-312020214792 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:56.024564 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69040014-4452-437b-bcc1-312020214792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:56.024838 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69040014-4452-437b-bcc1-312020214792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:56.057185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69040014-4452-437b-bcc1-312020214792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:56.059031 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69040014-4452-437b-bcc1-312020214792 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:56.084181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1023/2046] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:56.141887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6650ec479c400190d659acd5abc706', 'request_id': 'req-b5de91b7-8a4b-48e1-91d8-53e605a21075'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.156067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6650ec479c400190d659acd5abc706', 'request_id': 'req-b5de91b7-8a4b-48e1-91d8-53e605a21075'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.165995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6650ec479c400190d659acd5abc706', 'request_id': 'req-b5de91b7-8a4b-48e1-91d8-53e605a21075'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.182647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] The token cache is being invalidate because project ea6650ec479c400190d659acd5abc706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:56.183191 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.184115 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.189421 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1024/2047] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:55 2022] DELETE /identity/v3/projects/ea6650ec479c400190d659acd5abc706 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:56.190700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69040014-4452-437b-bcc1-312020214792 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:56.206431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69040014-4452-437b-bcc1-312020214792 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:56.291655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:56.292537 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:56.292887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:56.293158 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] PATH_INFO: `/v3/users/ed189d69209f44c892988518e7d59eff` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:56.294407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed189d69209f44c892988518e7d59eff)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:56.296768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:56.378709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed189d69209f44c892988518e7d59eff'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.413837 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed189d69209f44c892988518e7d59eff'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.414660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed189d69209f44c892988518e7d59eff'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.423529 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed189d69209f44c892988518e7d59eff'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.443888 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed189d69209f44c892988518e7d59eff'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.452883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1024/2048] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:56 2022] DELETE /identity/v3/users/ed189d69209f44c892988518e7d59eff => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:56.606550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:56.609970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:56.621697 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:56.626806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de91b7-8a4b-48e1-91d8-53e605a21075 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:56.763526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:56.764264 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:56.764604 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:56.764942 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] PATH_INFO: `/v3/projects/994e2b0fda524823baeff7f0c8c6dc31` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:56.768242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=994e2b0fda524823baeff7f0c8c6dc31)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:56.772501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:56.811521 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:56.812966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:56.833256 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dbc29-ef2e-4cf0-aca2-0bddf1a3718d admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:56.839808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:56.840653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:56.841091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:56.841462 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] PATH_INFO: `/v3/projects/73b9db9dce614e509817f0fabbdb3b3b` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:56.843567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b9db9dce614e509817f0fabbdb3b3b)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:56.845637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:56.864341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '994e2b0fda524823baeff7f0c8c6dc31', 'request_id': 'req-2083b1a1-1d2b-4d57-9d21-84bb725422bd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.878643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '994e2b0fda524823baeff7f0c8c6dc31', 'request_id': 'req-2083b1a1-1d2b-4d57-9d21-84bb725422bd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.890348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '994e2b0fda524823baeff7f0c8c6dc31', 'request_id': 'req-2083b1a1-1d2b-4d57-9d21-84bb725422bd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.906780 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] The token cache is being invalidate because project 994e2b0fda524823baeff7f0c8c6dc31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:56.907222 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.907967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.909818 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1025/2049] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:56 2022] DELETE /identity/v3/projects/994e2b0fda524823baeff7f0c8c6dc31 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:56.914036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:56.915626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:56.930153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:56.931671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b9db9dce614e509817f0fabbdb3b3b', 'request_id': 'req-12da4eb8-a626-483a-ad19-91057dca2407'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.942751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b9db9dce614e509817f0fabbdb3b3b', 'request_id': 'req-12da4eb8-a626-483a-ad19-91057dca2407'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.952656 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b9db9dce614e509817f0fabbdb3b3b', 'request_id': 'req-12da4eb8-a626-483a-ad19-91057dca2407'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.970672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] The token cache is being invalidate because project 73b9db9dce614e509817f0fabbdb3b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:56.970967 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.973061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:56.977265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1025/2050] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:56 2022] DELETE /identity/v3/projects/73b9db9dce614e509817f0fabbdb3b3b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:56.978995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:56.980789 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:57.004055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083b1a1-1d2b-4d57-9d21-84bb725422bd admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:57.057107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:57.067730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da4eb8-a626-483a-ad19-91057dca2407 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:57.073440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:57.074092 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:57.074364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:57.074629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] PATH_INFO: `/v3/users/8e6d67f720254cd8b21c7fa9f5a4b666` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:57.076234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6d67f720254cd8b21c7fa9f5a4b666)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:57.078290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:57.101061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:57.101745 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:57.102197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:57.102473 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] PATH_INFO: `/v3/users/5f8190c116c44b64a9691b2ba131db3d` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:57.104852 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f8190c116c44b64a9691b2ba131db3d)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:57.107363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:57.160805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6d67f720254cd8b21c7fa9f5a4b666'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.172373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6d67f720254cd8b21c7fa9f5a4b666'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.173486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6d67f720254cd8b21c7fa9f5a4b666'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.180286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f8190c116c44b64a9691b2ba131db3d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.181444 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6d67f720254cd8b21c7fa9f5a4b666'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.192837 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f8190c116c44b64a9691b2ba131db3d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.193730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f8190c116c44b64a9691b2ba131db3d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.194364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f8190c116c44b64a9691b2ba131db3d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.195355 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6d67f720254cd8b21c7fa9f5a4b666'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.203092 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1026/2051] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:56 2022] DELETE /identity/v3/users/8e6d67f720254cd8b21c7fa9f5a4b666 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:57.203818 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f8190c116c44b64a9691b2ba131db3d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.217266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1026/2052] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:56 2022] DELETE /identity/v3/users/5f8190c116c44b64a9691b2ba131db3d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:57.576649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:57.580207 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:57.670293 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:57.677104 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da4dba-4426-4588-91eb-5678b6cf6e2a admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:57.743938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:57.744810 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:57.745271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:57.745636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0 admin admin] PATH_INFO: `/v3/projects/5aa686142fac4412901f287c3ef53dce` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:57.746849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa686142fac4412901f287c3ef53dce)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:57.748753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:57.793065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:57.795443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:57.814634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449edb6-bf87-4db3-b733-9b14fb0eb7d0 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:57.820445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa686142fac4412901f287c3ef53dce', 'request_id': 'req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.830666 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa686142fac4412901f287c3ef53dce', 'request_id': 'req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.837440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa686142fac4412901f287c3ef53dce', 'request_id': 'req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.848841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0 admin admin] The token cache is being invalidate because project 5aa686142fac4412901f287c3ef53dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:57.849135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.849902 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7dc9c850-d853-47d3-9a2a-66f0bf2f44a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.851768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1027/2053] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:57 2022] DELETE /identity/v3/projects/5aa686142fac4412901f287c3ef53dce => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:57.857928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866fdb-f7bf-4276-bfce-8bfd25dc8459 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:57.858291 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866fdb-f7bf-4276-bfce-8bfd25dc8459 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:57.858636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866fdb-f7bf-4276-bfce-8bfd25dc8459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:57.877672 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc61a92-8cce-4c7b-8783-095ab3079983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:57.878349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc61a92-8cce-4c7b-8783-095ab3079983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:57.878626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc61a92-8cce-4c7b-8783-095ab3079983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:57.878725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7f866fdb-f7bf-4276-bfce-8bfd25dc8459 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:57.878889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc61a92-8cce-4c7b-8783-095ab3079983 admin admin] PATH_INFO: `/v3/projects/cdb5d0124bd8418b890c0f9d0ecc6ed8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:57.879875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7f866fdb-f7bf-4276-bfce-8bfd25dc8459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:57.880013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc61a92-8cce-4c7b-8783-095ab3079983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb5d0124bd8418b890c0f9d0ecc6ed8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:57.881944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc61a92-8cce-4c7b-8783-095ab3079983 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:57.888076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1028/2054] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:57.897848 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb021905-8570-4bdd-b368-d5bea02ae09c None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:57.898055 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb021905-8570-4bdd-b368-d5bea02ae09c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:57.898320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb021905-8570-4bdd-b368-d5bea02ae09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:57.920634 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-cb021905-8570-4bdd-b368-d5bea02ae09c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:57.921884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-cb021905-8570-4bdd-b368-d5bea02ae09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:57.932387 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-fbc61a92-8cce-4c7b-8783-095ab3079983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb5d0124bd8418b890c0f9d0ecc6ed8', 'request_id': 'req-fbc61a92-8cce-4c7b-8783-095ab3079983'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.942094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-fbc61a92-8cce-4c7b-8783-095ab3079983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb5d0124bd8418b890c0f9d0ecc6ed8', 'request_id': 'req-fbc61a92-8cce-4c7b-8783-095ab3079983'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.950404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-fbc61a92-8cce-4c7b-8783-095ab3079983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb5d0124bd8418b890c0f9d0ecc6ed8', 'request_id': 'req-fbc61a92-8cce-4c7b-8783-095ab3079983'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.953773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:57.966211 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-fbc61a92-8cce-4c7b-8783-095ab3079983 admin admin] The token cache is being invalidate because project cdb5d0124bd8418b890c0f9d0ecc6ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:57.966495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-fbc61a92-8cce-4c7b-8783-095ab3079983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.967205 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-fbc61a92-8cce-4c7b-8783-095ab3079983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:57.968684 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1027/2055] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:57 2022] DELETE /identity/v3/projects/cdb5d0124bd8418b890c0f9d0ecc6ed8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:57.974481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c901-0656-40ac-95aa-aed1938c32f4 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:57.974763 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c901-0656-40ac-95aa-aed1938c32f4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:57.975038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c901-0656-40ac-95aa-aed1938c32f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:57.988136 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1029/2056] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:57.992233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb021905-8570-4bdd-b368-d5bea02ae09c None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:57.996773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-e270c901-0656-40ac-95aa-aed1938c32f4 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:57.998004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e270c901-0656-40ac-95aa-aed1938c32f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:58.002436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb021905-8570-4bdd-b368-d5bea02ae09c None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.005977 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1028/2057] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:58.008109 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cf242-9bff-4703-bb36-3b261a11df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.008810 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf242-9bff-4703-bb36-3b261a11df28 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.009056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf242-9bff-4703-bb36-3b261a11df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.009351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf242-9bff-4703-bb36-3b261a11df28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.010355 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cf242-9bff-4703-bb36-3b261a11df28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:58.010733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cf242-9bff-4703-bb36-3b261a11df28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.012445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cf242-9bff-4703-bb36-3b261a11df28 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.014631 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96316be-62ba-4184-8581-41c4bcfee009 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.014912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96316be-62ba-4184-8581-41c4bcfee009 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.015183 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96316be-62ba-4184-8581-41c4bcfee009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.026299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1030/2058] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:58.030823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cf242-9bff-4703-bb36-3b261a11df28 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.035416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-b96316be-62ba-4184-8581-41c4bcfee009 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:58.036607 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b96316be-62ba-4184-8581-41c4bcfee009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:58.040908 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cf242-9bff-4703-bb36-3b261a11df28 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.044865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1029/2059] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:58.046178 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7496c9-a2f6-4143-8276-2d82337f656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.046780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7496c9-a2f6-4143-8276-2d82337f656b admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.047055 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7496c9-a2f6-4143-8276-2d82337f656b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.047320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7496c9-a2f6-4143-8276-2d82337f656b admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.048039 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7496c9-a2f6-4143-8276-2d82337f656b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.049152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96316be-62ba-4184-8581-41c4bcfee009 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.050184 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7496c9-a2f6-4143-8276-2d82337f656b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.059559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96316be-62ba-4184-8581-41c4bcfee009 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.062417 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:58.064667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50843c9-d829-4147-986f-ee53a6bb200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.065331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50843c9-d829-4147-986f-ee53a6bb200e admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.065629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50843c9-d829-4147-986f-ee53a6bb200e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.065904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50843c9-d829-4147-986f-ee53a6bb200e admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.066547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50843c9-d829-4147-986f-ee53a6bb200e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:58.066847 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50843c9-d829-4147-986f-ee53a6bb200e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.068648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50843c9-d829-4147-986f-ee53a6bb200e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.081787 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1031/2060] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:58 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:58.085768 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1030/2061] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:58.086372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7496c9-a2f6-4143-8276-2d82337f656b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.090966 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50843c9-d829-4147-986f-ee53a6bb200e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.102443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50843c9-d829-4147-986f-ee53a6bb200e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.153051 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7496c9-a2f6-4143-8276-2d82337f656b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.157680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a9ed2-efc7-41ad-b06a-25efd81199c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.158310 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a9ed2-efc7-41ad-b06a-25efd81199c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.158540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a9ed2-efc7-41ad-b06a-25efd81199c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.158811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a9ed2-efc7-41ad-b06a-25efd81199c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.159439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a9ed2-efc7-41ad-b06a-25efd81199c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.161423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a9ed2-efc7-41ad-b06a-25efd81199c9 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.165104 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faac1c2-0c55-4841-87c0-fb1be21c4a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.165865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faac1c2-0c55-4841-87c0-fb1be21c4a90 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.166138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faac1c2-0c55-4841-87c0-fb1be21c4a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.166703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faac1c2-0c55-4841-87c0-fb1be21c4a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.167379 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faac1c2-0c55-4841-87c0-fb1be21c4a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.169335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faac1c2-0c55-4841-87c0-fb1be21c4a90 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.187276 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1032/2062] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:58 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:58.191578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a9ed2-efc7-41ad-b06a-25efd81199c9 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.209351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a9ed2-efc7-41ad-b06a-25efd81199c9 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.209457 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1031/2063] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:58 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:58.210743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faac1c2-0c55-4841-87c0-fb1be21c4a90 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.212212 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860af8b-3c43-475e-8dcb-8374eaf66f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.212827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860af8b-3c43-475e-8dcb-8374eaf66f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.213562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860af8b-3c43-475e-8dcb-8374eaf66f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.213843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860af8b-3c43-475e-8dcb-8374eaf66f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.214583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860af8b-3c43-475e-8dcb-8374eaf66f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.216181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860af8b-3c43-475e-8dcb-8374eaf66f72 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.228493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1033/2064] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:58.232314 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860af8b-3c43-475e-8dcb-8374eaf66f72 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.245983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860af8b-3c43-475e-8dcb-8374eaf66f72 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.297445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faac1c2-0c55-4841-87c0-fb1be21c4a90 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.302710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502103a4-019a-4afd-b3ec-8eb7309a6c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.303517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502103a4-019a-4afd-b3ec-8eb7309a6c4f admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.303868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502103a4-019a-4afd-b3ec-8eb7309a6c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.304208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502103a4-019a-4afd-b3ec-8eb7309a6c4f admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.305032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502103a4-019a-4afd-b3ec-8eb7309a6c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.307258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502103a4-019a-4afd-b3ec-8eb7309a6c4f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.328175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d16b1-b9be-4b14-a294-bcb9bd2aa039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.328175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d16b1-b9be-4b14-a294-bcb9bd2aa039 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.328175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d16b1-b9be-4b14-a294-bcb9bd2aa039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.328175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d16b1-b9be-4b14-a294-bcb9bd2aa039 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.329381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d16b1-b9be-4b14-a294-bcb9bd2aa039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.330043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d16b1-b9be-4b14-a294-bcb9bd2aa039 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.347042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1034/2065] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:16:58.349856 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1032/2066] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:58 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:58.350698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d16b1-b9be-4b14-a294-bcb9bd2aa039 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.353903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502103a4-019a-4afd-b3ec-8eb7309a6c4f admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.364746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502103a4-019a-4afd-b3ec-8eb7309a6c4f admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.365147 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d16b1-b9be-4b14-a294-bcb9bd2aa039 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.370715 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585ee45-c94b-4783-a9d3-6e4b4dddf1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.371608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585ee45-c94b-4783-a9d3-6e4b4dddf1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.371841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc815e0-686c-45f7-9c0b-2f247e116aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.372634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc815e0-686c-45f7-9c0b-2f247e116aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.372998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc815e0-686c-45f7-9c0b-2f247e116aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.373424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc815e0-686c-45f7-9c0b-2f247e116aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.374183 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc815e0-686c-45f7-9c0b-2f247e116aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.374622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585ee45-c94b-4783-a9d3-6e4b4dddf1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.374928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585ee45-c94b-4783-a9d3-6e4b4dddf1dc admin admin] PATH_INFO: `/v3/projects/c1951db5daa944c492752773359539b4/users/5a6f75168d804581b00428d790354dbb/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.376588 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc815e0-686c-45f7-9c0b-2f247e116aa6 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.392866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1033/2067] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:16:58.394044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc815e0-686c-45f7-9c0b-2f247e116aa6 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.395286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585ee45-c94b-4783-a9d3-6e4b4dddf1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1951db5daa944c492752773359539b4, user_id=5a6f75168d804581b00428d790354dbb, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.398929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585ee45-c94b-4783-a9d3-6e4b4dddf1dc admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.408863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc815e0-686c-45f7-9c0b-2f247e116aa6 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.427800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1035/2068] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:58 2022] PUT /identity/v3/projects/c1951db5daa944c492752773359539b4/users/5a6f75168d804581b00428d790354dbb/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:58.435327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5024e62-ed6b-4664-aec3-29a6b4f9a716 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.435687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5024e62-ed6b-4664-aec3-29a6b4f9a716 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.436068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5024e62-ed6b-4664-aec3-29a6b4f9a716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.462974 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:58.499168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-a5024e62-ed6b-4664-aec3-29a6b4f9a716 None None] MFA Rules not processed for user `5a6f75168d804581b00428d790354dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:58.500377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a5024e62-ed6b-4664-aec3-29a6b4f9a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:58.502297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296d34e-b11a-495a-bd3f-c9d79b171418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.503022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296d34e-b11a-495a-bd3f-c9d79b171418 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.503335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296d34e-b11a-495a-bd3f-c9d79b171418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.503609 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296d34e-b11a-495a-bd3f-c9d79b171418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.504277 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296d34e-b11a-495a-bd3f-c9d79b171418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.506114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296d34e-b11a-495a-bd3f-c9d79b171418 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.524185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1034/2069] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:58.526738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296d34e-b11a-495a-bd3f-c9d79b171418 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.537627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:58.549189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296d34e-b11a-495a-bd3f-c9d79b171418 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.557924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855ff5c-e659-4180-b1c7-1e6d5f207cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.558644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855ff5c-e659-4180-b1c7-1e6d5f207cad admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.558921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855ff5c-e659-4180-b1c7-1e6d5f207cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.559831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855ff5c-e659-4180-b1c7-1e6d5f207cad admin admin] PATH_INFO: `/v3/projects/bfe9844d1ac04e7383c93dd50fcf1a29/users/6609fd0d407d403b9baf5746bf18a258/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.586761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855ff5c-e659-4180-b1c7-1e6d5f207cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe9844d1ac04e7383c93dd50fcf1a29, user_id=6609fd0d407d403b9baf5746bf18a258, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.591546 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855ff5c-e659-4180-b1c7-1e6d5f207cad admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.598206 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1036/2070] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:58.612823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5024e62-ed6b-4664-aec3-29a6b4f9a716 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.617260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1035/2071] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:58 2022] PUT /identity/v3/projects/bfe9844d1ac04e7383c93dd50fcf1a29/users/6609fd0d407d403b9baf5746bf18a258/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:58.617422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a5024e62-ed6b-4664-aec3-29a6b4f9a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:58.625568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bdf89-d3d4-4b16-87f5-61c9813b33e3 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.626824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bdf89-d3d4-4b16-87f5-61c9813b33e3 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.627352 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bdf89-d3d4-4b16-87f5-61c9813b33e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.673418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-8b0bdf89-d3d4-4b16-87f5-61c9813b33e3 None None] MFA Rules not processed for user `6609fd0d407d403b9baf5746bf18a258`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:58.675734 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8b0bdf89-d3d4-4b16-87f5-61c9813b33e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:58.695822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5024e62-ed6b-4664-aec3-29a6b4f9a716 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.751720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1036/2072] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:16:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:16:58.754100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60411a0d-13c6-4747-be7c-8dd025414424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.754753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60411a0d-13c6-4747-be7c-8dd025414424 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.755056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60411a0d-13c6-4747-be7c-8dd025414424 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.755324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60411a0d-13c6-4747-be7c-8dd025414424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.763956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bdf89-d3d4-4b16-87f5-61c9813b33e3 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.766321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8b0bdf89-d3d4-4b16-87f5-61c9813b33e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:58.779680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bdf89-d3d4-4b16-87f5-61c9813b33e3 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.784004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d29659-9b9f-4827-a89a-5149f2c2c621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.784839 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d29659-9b9f-4827-a89a-5149f2c2c621 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.785180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d29659-9b9f-4827-a89a-5149f2c2c621 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.785572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d29659-9b9f-4827-a89a-5149f2c2c621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.796350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d29659-9b9f-4827-a89a-5149f2c2c621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.797897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d29659-9b9f-4827-a89a-5149f2c2c621 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.808353 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1037/2073] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:16:58.831713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60411a0d-13c6-4747-be7c-8dd025414424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.833641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60411a0d-13c6-4747-be7c-8dd025414424 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.846714 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1037/2074] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:17:02.760667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d29659-9b9f-4827-a89a-5149f2c2c621 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:02.828049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d29659-9b9f-4827-a89a-5149f2c2c621 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:02.833119 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:02.833835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:02.834114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:02.834387 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] PATH_INFO: `/v3/users/5a6f75168d804581b00428d790354dbb` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:02.835537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6f75168d804581b00428d790354dbb)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:02.837508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:02.860426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:02.897702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6f75168d804581b00428d790354dbb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:02.913874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6f75168d804581b00428d790354dbb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:02.914638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6f75168d804581b00428d790354dbb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:02.915245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6f75168d804581b00428d790354dbb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:02.925490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6f75168d804581b00428d790354dbb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:02.939128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1038/2075] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:17:02 2022] DELETE /identity/v3/users/5a6f75168d804581b00428d790354dbb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:02.943572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb2c3-0395-406a-9119-b6abcd746ea0 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:02.944415 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb2c3-0395-406a-9119-b6abcd746ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:02.944686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb2c3-0395-406a-9119-b6abcd746ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:02.969410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:02.971422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:02.977010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e74eb2c3-0395-406a-9119-b6abcd746ea0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:02.978244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e74eb2c3-0395-406a-9119-b6abcd746ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:03.022698 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:03.046334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5ee89-3ba4-4aef-aaef-4dd9391bbb1e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:03.049633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1038/2076] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:03.051243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:03.051961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.052306 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.052656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] PATH_INFO: `/v3/users/4e3d035086914b88a3756a6b7ca20a70` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.053957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e3d035086914b88a3756a6b7ca20a70)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:03.055921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:03.060792 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eb2c3-0395-406a-9119-b6abcd746ea0 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:03.062197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e74eb2c3-0395-406a-9119-b6abcd746ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:03.118159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e3d035086914b88a3756a6b7ca20a70'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:03.124907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eb2c3-0395-406a-9119-b6abcd746ea0 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:03.131679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72621d26-7565-4999-bca8-aa30a42c3189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:03.132552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72621d26-7565-4999-bca8-aa30a42c3189 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.132552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72621d26-7565-4999-bca8-aa30a42c3189 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.132744 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72621d26-7565-4999-bca8-aa30a42c3189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.143706 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e3d035086914b88a3756a6b7ca20a70'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:03.143981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72621d26-7565-4999-bca8-aa30a42c3189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:03.144909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e3d035086914b88a3756a6b7ca20a70'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:03.146179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e3d035086914b88a3756a6b7ca20a70'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:03.146510 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72621d26-7565-4999-bca8-aa30a42c3189 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:03.157435 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e3d035086914b88a3756a6b7ca20a70'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:03.160919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1039/2077] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:03.179674 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1039/2078] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:17:02 2022] DELETE /identity/v3/users/4e3d035086914b88a3756a6b7ca20a70 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:17:03.184561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e7ac6-fafa-4939-bc5c-f0a48410ea5e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.184837 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e7ac6-fafa-4939-bc5c-f0a48410ea5e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.185098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e7ac6-fafa-4939-bc5c-f0a48410ea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.220866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-f28e7ac6-fafa-4939-bc5c-f0a48410ea5e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:03.222324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f28e7ac6-fafa-4939-bc5c-f0a48410ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:03.298790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1040/2079] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:03.309175 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:03.318327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:03.339360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:03.393391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a4e4d-d20f-44ba-9231-0ec6a58fc658 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:03.398521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e7cc0-a497-4488-87ea-04cd491c869e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:03.399137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e7cc0-a497-4488-87ea-04cd491c869e service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.399404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e7cc0-a497-4488-87ea-04cd491c869e service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.399668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e7cc0-a497-4488-87ea-04cd491c869e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.409752 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e7cc0-a497-4488-87ea-04cd491c869e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:03.411323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e7cc0-a497-4488-87ea-04cd491c869e service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:03.441724 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1040/2080] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:17:03.619170 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e7ac6-fafa-4939-bc5c-f0a48410ea5e None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:03.621086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f28e7ac6-fafa-4939-bc5c-f0a48410ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:03.634128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e7ac6-fafa-4939-bc5c-f0a48410ea5e None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:03.639856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f5bb1-605e-442e-bc10-219a3786afba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:03.641297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5bb1-605e-442e-bc10-219a3786afba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.641551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5bb1-605e-442e-bc10-219a3786afba admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.641841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5bb1-605e-442e-bc10-219a3786afba admin admin] PATH_INFO: `/v3/projects/c1951db5daa944c492752773359539b4` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.643168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f5bb1-605e-442e-bc10-219a3786afba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1951db5daa944c492752773359539b4)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:03.645134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f5bb1-605e-442e-bc10-219a3786afba admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:03.743092 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ab1f5bb1-605e-442e-bc10-219a3786afba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1951db5daa944c492752773359539b4', 'request_id': 'req-ab1f5bb1-605e-442e-bc10-219a3786afba'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:03.752465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ab1f5bb1-605e-442e-bc10-219a3786afba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1951db5daa944c492752773359539b4', 'request_id': 'req-ab1f5bb1-605e-442e-bc10-219a3786afba'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:03.761070 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ab1f5bb1-605e-442e-bc10-219a3786afba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1951db5daa944c492752773359539b4', 'request_id': 'req-ab1f5bb1-605e-442e-bc10-219a3786afba'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:03.773357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ab1f5bb1-605e-442e-bc10-219a3786afba admin admin] The token cache is being invalidate because project c1951db5daa944c492752773359539b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:17:03.773680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ab1f5bb1-605e-442e-bc10-219a3786afba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:03.774314 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ab1f5bb1-605e-442e-bc10-219a3786afba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:03.776195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1041/2081] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:17:03 2022] DELETE /identity/v3/projects/c1951db5daa944c492752773359539b4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:03.780940 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03227ab6-bc2b-48d9-851b-21350f44e843 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.781506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03227ab6-bc2b-48d9-851b-21350f44e843 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.781690 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03227ab6-bc2b-48d9-851b-21350f44e843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.804289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-03227ab6-bc2b-48d9-851b-21350f44e843 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:03.806045 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-03227ab6-bc2b-48d9-851b-21350f44e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:03.882018 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1041/2082] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:03.889785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c41329-a413-4e89-b8d3-4cd6cf206b47 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.890137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c41329-a413-4e89-b8d3-4cd6cf206b47 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.890534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c41329-a413-4e89-b8d3-4cd6cf206b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.912838 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-63c41329-a413-4e89-b8d3-4cd6cf206b47 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:03.917446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-63c41329-a413-4e89-b8d3-4cd6cf206b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:03.923858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03227ab6-bc2b-48d9-851b-21350f44e843 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:03.925146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-03227ab6-bc2b-48d9-851b-21350f44e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:03.928812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1042/2083] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:03.933562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c41329-a413-4e89-b8d3-4cd6cf206b47 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:03.945121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:03.960785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03227ab6-bc2b-48d9-851b-21350f44e843 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:03.967434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c41329-a413-4e89-b8d3-4cd6cf206b47 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:03.972970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3803ad-f169-49e3-b3df-6dad83595dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:03.973785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3803ad-f169-49e3-b3df-6dad83595dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.974012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3803ad-f169-49e3-b3df-6dad83595dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.974176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3803ad-f169-49e3-b3df-6dad83595dc7 admin admin] PATH_INFO: `/v3/projects/0c17b8138b004bc2ac17b84338ef9a2b` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.975314 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3803ad-f169-49e3-b3df-6dad83595dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c17b8138b004bc2ac17b84338ef9a2b)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:03.979743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3803ad-f169-49e3-b3df-6dad83595dc7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:03.984397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e44b9-870b-46d7-8c45-befdf4c9507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:03.986869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e44b9-870b-46d7-8c45-befdf4c9507f admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.987155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e44b9-870b-46d7-8c45-befdf4c9507f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.987418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e44b9-870b-46d7-8c45-befdf4c9507f admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.992348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e44b9-870b-46d7-8c45-befdf4c9507f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:03.992694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e44b9-870b-46d7-8c45-befdf4c9507f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:03.997548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e44b9-870b-46d7-8c45-befdf4c9507f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.021310 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1043/2084] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:04.027448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e44b9-870b-46d7-8c45-befdf4c9507f admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.046770 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e44b9-870b-46d7-8c45-befdf4c9507f admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.071629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6c3803ad-f169-49e3-b3df-6dad83595dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c17b8138b004bc2ac17b84338ef9a2b', 'request_id': 'req-6c3803ad-f169-49e3-b3df-6dad83595dc7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:04.086206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6c3803ad-f169-49e3-b3df-6dad83595dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c17b8138b004bc2ac17b84338ef9a2b', 'request_id': 'req-6c3803ad-f169-49e3-b3df-6dad83595dc7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:04.098723 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6c3803ad-f169-49e3-b3df-6dad83595dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c17b8138b004bc2ac17b84338ef9a2b', 'request_id': 'req-6c3803ad-f169-49e3-b3df-6dad83595dc7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:04.118349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6c3803ad-f169-49e3-b3df-6dad83595dc7 admin admin] The token cache is being invalidate because project 0c17b8138b004bc2ac17b84338ef9a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:17:04.118657 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6c3803ad-f169-49e3-b3df-6dad83595dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:04.119616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6c3803ad-f169-49e3-b3df-6dad83595dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:04.121735 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1042/2085] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:17:03 2022] DELETE /identity/v3/projects/0c17b8138b004bc2ac17b84338ef9a2b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:04.131323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17539f-ba34-4df7-8e3a-7467cb9f9803 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.131638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17539f-ba34-4df7-8e3a-7467cb9f9803 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.132141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17539f-ba34-4df7-8e3a-7467cb9f9803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.142799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaee11-add0-4862-b771-79f73bcbf219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.143794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaee11-add0-4862-b771-79f73bcbf219 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.144253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaee11-add0-4862-b771-79f73bcbf219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.144738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaee11-add0-4862-b771-79f73bcbf219 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.146706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaee11-add0-4862-b771-79f73bcbf219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.148687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaee11-add0-4862-b771-79f73bcbf219 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.160761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ad17539f-ba34-4df7-8e3a-7467cb9f9803 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:04.161942 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ad17539f-ba34-4df7-8e3a-7467cb9f9803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:04.170084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1043/2086] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:04.180707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917d7d8-fad1-4ea6-9de1-54216d6241f4 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.181131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917d7d8-fad1-4ea6-9de1-54216d6241f4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.181520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917d7d8-fad1-4ea6-9de1-54216d6241f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.188578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1044/2087] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:17:04 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:17:04.189850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaee11-add0-4862-b771-79f73bcbf219 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.191654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-92eaee11-add0-4862-b771-79f73bcbf219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:04.210429 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-9917d7d8-fad1-4ea6-9de1-54216d6241f4 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:04.211676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-9917d7d8-fad1-4ea6-9de1-54216d6241f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:04.247180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:04.279584 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaee11-add0-4862-b771-79f73bcbf219 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.284459 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558e669-37ac-40d4-aa13-62744fe52c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.285358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1044/2088] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:04.285483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558e669-37ac-40d4-aa13-62744fe52c59 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.285738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558e669-37ac-40d4-aa13-62744fe52c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.286359 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558e669-37ac-40d4-aa13-62744fe52c59 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.288621 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558e669-37ac-40d4-aa13-62744fe52c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.289394 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558e669-37ac-40d4-aa13-62744fe52c59 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.289994 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917d7d8-fad1-4ea6-9de1-54216d6241f4 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.300112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917d7d8-fad1-4ea6-9de1-54216d6241f4 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.305065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3be1d4-cb30-47da-8778-0e70f6eb6059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.305967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3be1d4-cb30-47da-8778-0e70f6eb6059 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.306499 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3be1d4-cb30-47da-8778-0e70f6eb6059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.307408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3be1d4-cb30-47da-8778-0e70f6eb6059 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.308224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3be1d4-cb30-47da-8778-0e70f6eb6059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:04.308516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3be1d4-cb30-47da-8778-0e70f6eb6059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.310161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3be1d4-cb30-47da-8778-0e70f6eb6059 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.320706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1045/2089] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:17:04 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:04.321932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558e669-37ac-40d4-aa13-62744fe52c59 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.328177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1045/2090] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:04.332402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3be1d4-cb30-47da-8778-0e70f6eb6059 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.343316 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558e669-37ac-40d4-aa13-62744fe52c59 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.343516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3be1d4-cb30-47da-8778-0e70f6eb6059 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.349012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f2870-cd51-47ed-ac15-f97c4b9921ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.349737 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f2870-cd51-47ed-ac15-f97c4b9921ae admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.350116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f2870-cd51-47ed-ac15-f97c4b9921ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.350454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f2870-cd51-47ed-ac15-f97c4b9921ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.350664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a5611-07fc-4aeb-8393-280b37c5a702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.351220 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f2870-cd51-47ed-ac15-f97c4b9921ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.351332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5611-07fc-4aeb-8393-280b37c5a702 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.351565 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5611-07fc-4aeb-8393-280b37c5a702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.351887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5611-07fc-4aeb-8393-280b37c5a702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.352662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a5611-07fc-4aeb-8393-280b37c5a702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.353130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f2870-cd51-47ed-ac15-f97c4b9921ae admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.354360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a5611-07fc-4aeb-8393-280b37c5a702 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.369991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1046/2091] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:17:04.370978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a5611-07fc-4aeb-8393-280b37c5a702 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.382902 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a5611-07fc-4aeb-8393-280b37c5a702 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.394001 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942f4d4-b07b-4557-84d2-9b9446c9fdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.395161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942f4d4-b07b-4557-84d2-9b9446c9fdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.396627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942f4d4-b07b-4557-84d2-9b9446c9fdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.397094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942f4d4-b07b-4557-84d2-9b9446c9fdd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.398157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942f4d4-b07b-4557-84d2-9b9446c9fdd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.400759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942f4d4-b07b-4557-84d2-9b9446c9fdd0 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.410735 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1046/2092] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:17:04 2022] POST /identity/v3/projects => generated 363 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:17:04.414666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f2870-cd51-47ed-ac15-f97c4b9921ae admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.422295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1047/2093] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:04.425976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942f4d4-b07b-4557-84d2-9b9446c9fdd0 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.443934 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942f4d4-b07b-4557-84d2-9b9446c9fdd0 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.502678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:04.521826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f2870-cd51-47ed-ac15-f97c4b9921ae admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.524921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca43c9d-6f9f-4b7d-a7b9-8ec2a11f14ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.526504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca43c9d-6f9f-4b7d-a7b9-8ec2a11f14ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.526504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca43c9d-6f9f-4b7d-a7b9-8ec2a11f14ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.526504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca43c9d-6f9f-4b7d-a7b9-8ec2a11f14ce admin admin] PATH_INFO: `/v3/projects/b539f1973256490da2d9a99167dac4b0/users/31e2263402034209b9038509514b9e83/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.527841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707eef4d-e5eb-484f-827b-9478a8459181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.528713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eef4d-e5eb-484f-827b-9478a8459181 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.529129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eef4d-e5eb-484f-827b-9478a8459181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.529862 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eef4d-e5eb-484f-827b-9478a8459181 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.530782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707eef4d-e5eb-484f-827b-9478a8459181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.534331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707eef4d-e5eb-484f-827b-9478a8459181 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.543826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca43c9d-6f9f-4b7d-a7b9-8ec2a11f14ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b539f1973256490da2d9a99167dac4b0, user_id=31e2263402034209b9038509514b9e83, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.547171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca43c9d-6f9f-4b7d-a7b9-8ec2a11f14ce admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.566504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1048/2094] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:17:04 2022] PUT /identity/v3/projects/b539f1973256490da2d9a99167dac4b0/users/31e2263402034209b9038509514b9e83/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:17:04.567309 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1047/2095] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:17:04 2022] POST /identity/v3/users => generated 282 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:04.574576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca43c9d-6f9f-4b7d-a7b9-8ec2a11f14ce admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.579184 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646b73-e44d-4729-b12e-2f6cb6d45143 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.580511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646b73-e44d-4729-b12e-2f6cb6d45143 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.581626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646b73-e44d-4729-b12e-2f6cb6d45143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.622236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-85646b73-e44d-4729-b12e-2f6cb6d45143 None None] MFA Rules not processed for user `31e2263402034209b9038509514b9e83`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:04.623519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-85646b73-e44d-4729-b12e-2f6cb6d45143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:04.651739 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca43c9d-6f9f-4b7d-a7b9-8ec2a11f14ce admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.656412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbd99a-a459-479f-919a-ecad314bdb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.657021 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbd99a-a459-479f-919a-ecad314bdb39 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.657334 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbd99a-a459-479f-919a-ecad314bdb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.657605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbd99a-a459-479f-919a-ecad314bdb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.658271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbd99a-a459-479f-919a-ecad314bdb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.660199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbd99a-a459-479f-919a-ecad314bdb39 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.670393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1049/2096] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:04.674487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbd99a-a459-479f-919a-ecad314bdb39 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.684681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbd99a-a459-479f-919a-ecad314bdb39 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.689287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9d4f3-4903-4a96-88c4-41d2f566569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.689862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9d4f3-4903-4a96-88c4-41d2f566569f admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.690130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9d4f3-4903-4a96-88c4-41d2f566569f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.690390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9d4f3-4903-4a96-88c4-41d2f566569f admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.691020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9d4f3-4903-4a96-88c4-41d2f566569f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.692585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9d4f3-4903-4a96-88c4-41d2f566569f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.692689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1048/2097] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:04.703143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1050/2098] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:17:04.704529 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85646b73-e44d-4729-b12e-2f6cb6d45143 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.705893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-85646b73-e44d-4729-b12e-2f6cb6d45143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:04.707050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9d4f3-4903-4a96-88c4-41d2f566569f admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.727214 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9d4f3-4903-4a96-88c4-41d2f566569f admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.730014 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:04.732949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a93eb-7f43-483e-a5c7-acebb95e24c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.733687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a93eb-7f43-483e-a5c7-acebb95e24c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.734453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a93eb-7f43-483e-a5c7-acebb95e24c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.734453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a93eb-7f43-483e-a5c7-acebb95e24c1 admin admin] PATH_INFO: `/v3/projects/636cc861de5546048c75227000cd1d9a/users/1b129bc12f9d43bb9df6e3ae625b6863/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.752041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a93eb-7f43-483e-a5c7-acebb95e24c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636cc861de5546048c75227000cd1d9a, user_id=1b129bc12f9d43bb9df6e3ae625b6863, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.755984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a93eb-7f43-483e-a5c7-acebb95e24c1 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.776173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85646b73-e44d-4729-b12e-2f6cb6d45143 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.779777 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1051/2099] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:17:04 2022] PUT /identity/v3/projects/636cc861de5546048c75227000cd1d9a/users/1b129bc12f9d43bb9df6e3ae625b6863/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:17:04.790367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff757257-8c8b-4571-b8b2-2e61e6abdc33 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.790921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff757257-8c8b-4571-b8b2-2e61e6abdc33 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.790921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff757257-8c8b-4571-b8b2-2e61e6abdc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.821164 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-ff757257-8c8b-4571-b8b2-2e61e6abdc33 None None] MFA Rules not processed for user `1b129bc12f9d43bb9df6e3ae625b6863`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:04.822898 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ff757257-8c8b-4571-b8b2-2e61e6abdc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:04.838574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763009d-cf0d-4342-a365-b6c89d494cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.839315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763009d-cf0d-4342-a365-b6c89d494cab service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.839684 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763009d-cf0d-4342-a365-b6c89d494cab service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.840073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763009d-cf0d-4342-a365-b6c89d494cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.904688 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1052/2100] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:17:04.912848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763009d-cf0d-4342-a365-b6c89d494cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.914398 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763009d-cf0d-4342-a365-b6c89d494cab service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.922381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff757257-8c8b-4571-b8b2-2e61e6abdc33 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.922381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ff757257-8c8b-4571-b8b2-2e61e6abdc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:04.926031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1049/2101] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:17:04.933225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff757257-8c8b-4571-b8b2-2e61e6abdc33 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.936933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ba0a6-51cf-49b9-ad69-737a9d0b4df6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.937576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ba0a6-51cf-49b9-ad69-737a9d0b4df6 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.937854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ba0a6-51cf-49b9-ad69-737a9d0b4df6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.938122 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ba0a6-51cf-49b9-ad69-737a9d0b4df6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.947377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ba0a6-51cf-49b9-ad69-737a9d0b4df6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.953913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763009d-cf0d-4342-a365-b6c89d494cab service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.954946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ba0a6-51cf-49b9-ad69-737a9d0b4df6 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.966832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1053/2102] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:17:05.038523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763009d-cf0d-4342-a365-b6c89d494cab service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:05.044347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:05.045060 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.045390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.045615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] PATH_INFO: `/v3/users/31e2263402034209b9038509514b9e83` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.046776 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e2263402034209b9038509514b9e83)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:05.048731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:05.098139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:05.116081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e2263402034209b9038509514b9e83'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:05.133791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e2263402034209b9038509514b9e83'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:05.135468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e2263402034209b9038509514b9e83'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:05.135681 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e2263402034209b9038509514b9e83'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:05.148736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e2263402034209b9038509514b9e83'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:05.165260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1050/2103] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:17:04 2022] DELETE /identity/v3/users/31e2263402034209b9038509514b9e83 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:05.172154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e19b06-b946-4730-8478-f8a9ae04e17d None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.178721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e19b06-b946-4730-8478-f8a9ae04e17d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.179149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e19b06-b946-4730-8478-f8a9ae04e17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.188272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:05.206008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e4e19b06-b946-4730-8478-f8a9ae04e17d None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:05.207385 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e4e19b06-b946-4730-8478-f8a9ae04e17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:05.290774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1054/2104] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:05.303948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:05.305708 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:05.396717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2c857-f1ff-447b-882a-93c21e97358a admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:05.400360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586b3c2-d0de-4972-9b71-65f5aa49d4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:05.402185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586b3c2-d0de-4972-9b71-65f5aa49d4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.402185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586b3c2-d0de-4972-9b71-65f5aa49d4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.402185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586b3c2-d0de-4972-9b71-65f5aa49d4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.413580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586b3c2-d0de-4972-9b71-65f5aa49d4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:05.415104 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586b3c2-d0de-4972-9b71-65f5aa49d4b6 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:05.426957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1051/2105] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:17:05.753004 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e19b06-b946-4730-8478-f8a9ae04e17d None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:05.754165 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e4e19b06-b946-4730-8478-f8a9ae04e17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:05.768724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e19b06-b946-4730-8478-f8a9ae04e17d None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:05.774854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:05.775939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.776219 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.776472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34 admin admin] PATH_INFO: `/v3/projects/b539f1973256490da2d9a99167dac4b0` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.777803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b539f1973256490da2d9a99167dac4b0)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:05.779824 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:05.847145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b539f1973256490da2d9a99167dac4b0', 'request_id': 'req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:05.858125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b539f1973256490da2d9a99167dac4b0', 'request_id': 'req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:05.865582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b539f1973256490da2d9a99167dac4b0', 'request_id': 'req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:05.876690 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34 admin admin] The token cache is being invalidate because project b539f1973256490da2d9a99167dac4b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:17:05.876971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:05.877730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-17b486ed-0852-4ddc-a66b-b0c92ebd9a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:05.881161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1055/2106] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:17:05 2022] DELETE /identity/v3/projects/b539f1973256490da2d9a99167dac4b0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:05.888362 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a50cc4-85c5-45f2-a832-d488b2c71157 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.889853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a50cc4-85c5-45f2-a832-d488b2c71157 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.890174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a50cc4-85c5-45f2-a832-d488b2c71157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.918823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-24a50cc4-85c5-45f2-a832-d488b2c71157 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:05.920290 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-24a50cc4-85c5-45f2-a832-d488b2c71157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:05.995591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1052/2107] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:06.007660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83421585-d569-4f91-985b-82669276f9e8 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.008223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83421585-d569-4f91-985b-82669276f9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.008386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83421585-d569-4f91-985b-82669276f9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.036942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-83421585-d569-4f91-985b-82669276f9e8 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:06.038200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-83421585-d569-4f91-985b-82669276f9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:06.048285 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1056/2108] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:06.053334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a50cc4-85c5-45f2-a832-d488b2c71157 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:06.064567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a50cc4-85c5-45f2-a832-d488b2c71157 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:06.070379 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc44ffc-fe4d-4983-8ed6-2ccb8c2e5252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:06.071153 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44ffc-fe4d-4983-8ed6-2ccb8c2e5252 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.071466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44ffc-fe4d-4983-8ed6-2ccb8c2e5252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.071771 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44ffc-fe4d-4983-8ed6-2ccb8c2e5252 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.072702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc44ffc-fe4d-4983-8ed6-2ccb8c2e5252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:06.073310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc44ffc-fe4d-4983-8ed6-2ccb8c2e5252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:06.075174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc44ffc-fe4d-4983-8ed6-2ccb8c2e5252 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:06.095147 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1053/2109] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:06.100320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83421585-d569-4f91-985b-82669276f9e8 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:06.115162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83421585-d569-4f91-985b-82669276f9e8 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:06.123309 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc584f-5552-464a-8ac8-308da77964cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:06.124513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc584f-5552-464a-8ac8-308da77964cf admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.124849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc584f-5552-464a-8ac8-308da77964cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.125981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc584f-5552-464a-8ac8-308da77964cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.127689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc584f-5552-464a-8ac8-308da77964cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:06.131370 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc584f-5552-464a-8ac8-308da77964cf admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:06.175822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1057/2110] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:17:06 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:06.177341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc44ffc-fe4d-4983-8ed6-2ccb8c2e5252 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:06.188552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc44ffc-fe4d-4983-8ed6-2ccb8c2e5252 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:06.249933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:06.290665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373acb4-6518-45fa-a43d-16baa5869ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:06.291488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373acb4-6518-45fa-a43d-16baa5869ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.291694 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373acb4-6518-45fa-a43d-16baa5869ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.291952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373acb4-6518-45fa-a43d-16baa5869ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.292656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373acb4-6518-45fa-a43d-16baa5869ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:06.294915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373acb4-6518-45fa-a43d-16baa5869ca3 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:06.321255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1054/2111] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:17:06 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:06.323480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc584f-5552-464a-8ac8-308da77964cf admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:06.335564 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc584f-5552-464a-8ac8-308da77964cf admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:06.341338 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d25864-2544-4a0e-8c6a-4072b76c237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:06.341987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d25864-2544-4a0e-8c6a-4072b76c237f admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.342271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d25864-2544-4a0e-8c6a-4072b76c237f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.342541 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d25864-2544-4a0e-8c6a-4072b76c237f admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.343238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d25864-2544-4a0e-8c6a-4072b76c237f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:06.345007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d25864-2544-4a0e-8c6a-4072b76c237f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:06.359859 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1058/2112] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:06.362128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373acb4-6518-45fa-a43d-16baa5869ca3 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:06.377705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373acb4-6518-45fa-a43d-16baa5869ca3 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:06.385539 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a9e73-ef65-402c-9e57-27b84909edba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:06.386386 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a9e73-ef65-402c-9e57-27b84909edba admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.386758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a9e73-ef65-402c-9e57-27b84909edba admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.387125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a9e73-ef65-402c-9e57-27b84909edba admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.387926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a9e73-ef65-402c-9e57-27b84909edba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:06.389690 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a9e73-ef65-402c-9e57-27b84909edba admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:06.402842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1055/2113] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:06.409033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d25864-2544-4a0e-8c6a-4072b76c237f admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:06.423436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d25864-2544-4a0e-8c6a-4072b76c237f admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:06.428443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7ac0-3bc6-42b1-b2de-b0c0c915a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:06.429151 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7ac0-3bc6-42b1-b2de-b0c0c915a9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.429624 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7ac0-3bc6-42b1-b2de-b0c0c915a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.429916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7ac0-3bc6-42b1-b2de-b0c0c915a9bb admin admin] PATH_INFO: `/v3/projects/da592dd9fc5b435cad100ceb6cd9c912/users/cbc13eb415d444debe85eb97b7879749/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.446996 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7ac0-3bc6-42b1-b2de-b0c0c915a9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=da592dd9fc5b435cad100ceb6cd9c912, user_id=cbc13eb415d444debe85eb97b7879749, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:06.450485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7ac0-3bc6-42b1-b2de-b0c0c915a9bb admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:06.455301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a9e73-ef65-402c-9e57-27b84909edba admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:06.457405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0e9a9e73-ef65-402c-9e57-27b84909edba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:06.467968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1059/2114] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:17:06 2022] PUT /identity/v3/projects/da592dd9fc5b435cad100ceb6cd9c912/users/cbc13eb415d444debe85eb97b7879749/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:06.473147 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78450d6-07a6-49e1-9905-b77cab2fe54f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.473515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78450d6-07a6-49e1-9905-b77cab2fe54f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.473803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78450d6-07a6-49e1-9905-b77cab2fe54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.494403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d78450d6-07a6-49e1-9905-b77cab2fe54f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:06.495742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d78450d6-07a6-49e1-9905-b77cab2fe54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:06.515117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:06.524680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a9e73-ef65-402c-9e57-27b84909edba admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:06.589433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1060/2115] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:17:06.595092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b3721-f1ef-458e-ba1a-f9bb806ac3b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:06.595798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b3721-f1ef-458e-ba1a-f9bb806ac3b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.596136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b3721-f1ef-458e-ba1a-f9bb806ac3b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.596369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b3721-f1ef-458e-ba1a-f9bb806ac3b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.598642 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a38b3721-f1ef-458e-ba1a-f9bb806ac3b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:06.600090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78450d6-07a6-49e1-9905-b77cab2fe54f None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:06.601543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d78450d6-07a6-49e1-9905-b77cab2fe54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:06.671367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78450d6-07a6-49e1-9905-b77cab2fe54f None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:06.676142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7825de3-86f7-4be4-b94d-0a7503e65850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:06.676768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825de3-86f7-4be4-b94d-0a7503e65850 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.677046 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825de3-86f7-4be4-b94d-0a7503e65850 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.677350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825de3-86f7-4be4-b94d-0a7503e65850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.688426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7825de3-86f7-4be4-b94d-0a7503e65850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:06.689963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7825de3-86f7-4be4-b94d-0a7503e65850 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:06.700873 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1061/2116] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:17:06.706444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b3721-f1ef-458e-ba1a-f9bb806ac3b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:06.708694 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b3721-f1ef-458e-ba1a-f9bb806ac3b6 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:06.721962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1056/2117] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:17:11.598295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec10f6-3f2f-4a1a-9f15-57c7526ee363 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:11.598778 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec10f6-3f2f-4a1a-9f15-57c7526ee363 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:11.598854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec10f6-3f2f-4a1a-9f15-57c7526ee363 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:11.600189 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1062/2118] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:11.622472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc5b7d-f0a7-413a-9a8f-f6678bba71fd None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:11.622981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc5b7d-f0a7-413a-9a8f-f6678bba71fd None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:11.622981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc5b7d-f0a7-413a-9a8f-f6678bba71fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:11.665015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-c9bc5b7d-f0a7-413a-9a8f-f6678bba71fd None None] MFA Rules not processed for user `227f958b82a446e19a4d5b29d74193bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:11.667640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c9bc5b7d-f0a7-413a-9a8f-f6678bba71fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:11.704613 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:11.719816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec10f6-3f2f-4a1a-9f15-57c7526ee363 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:11.721969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c5ec10f6-3f2f-4a1a-9f15-57c7526ee363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:11.741078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec10f6-3f2f-4a1a-9f15-57c7526ee363 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:11.748909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:11.749545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:11.749820 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:11.750091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] PATH_INFO: `/v3/users/8b0b97cdcb0d4f2ea660bd04ae305f73` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:11.751317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0b97cdcb0d4f2ea660bd04ae305f73)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:11.753485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:11.815297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1057/2119] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:17:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:11.823762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc5b7d-f0a7-413a-9a8f-f6678bba71fd None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:11.825661 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c9bc5b7d-f0a7-413a-9a8f-f6678bba71fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:11.839497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0b97cdcb0d4f2ea660bd04ae305f73'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:11.851025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc5b7d-f0a7-413a-9a8f-f6678bba71fd None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:11.857048 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0b97cdcb0d4f2ea660bd04ae305f73'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:11.857752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0b97cdcb0d4f2ea660bd04ae305f73'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:11.859076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fbcef-287f-476f-9e52-fd37e87d0733 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227f958b82a446e19a4d5b29d74193bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:11.860304 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fbcef-287f-476f-9e52-fd37e87d0733 service placement] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:11.861234 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fbcef-287f-476f-9e52-fd37e87d0733 service placement] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:11.862435 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fbcef-287f-476f-9e52-fd37e87d0733 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:11.868106 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0b97cdcb0d4f2ea660bd04ae305f73'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:11.875189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fbcef-287f-476f-9e52-fd37e87d0733 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:11.878737 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fbcef-287f-476f-9e52-fd37e87d0733 service placement] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:11.885505 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0b97cdcb0d4f2ea660bd04ae305f73'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:11.909310 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1063/2120] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:17:11 2022] DELETE /identity/v3/users/8b0b97cdcb0d4f2ea660bd04ae305f73 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:17:11.912928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1058/2121] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:17:12.215044 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:12.216824 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:12.317098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:12.409056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b8c0f-5b63-440b-85b5-991ac4588e08 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:12.428752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf096030-c7de-42e1-a8b3-eb91585d3035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:12.430194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf096030-c7de-42e1-a8b3-eb91585d3035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:12.430194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf096030-c7de-42e1-a8b3-eb91585d3035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:12.430194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf096030-c7de-42e1-a8b3-eb91585d3035 admin admin] PATH_INFO: `/v3/projects/c73042a79e92414aa8af1f7483a68884` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:12.437740 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf096030-c7de-42e1-a8b3-eb91585d3035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73042a79e92414aa8af1f7483a68884)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:12.439724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf096030-c7de-42e1-a8b3-eb91585d3035 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:12.527144 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-bf096030-c7de-42e1-a8b3-eb91585d3035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73042a79e92414aa8af1f7483a68884', 'request_id': 'req-bf096030-c7de-42e1-a8b3-eb91585d3035'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:12.555595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-bf096030-c7de-42e1-a8b3-eb91585d3035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73042a79e92414aa8af1f7483a68884', 'request_id': 'req-bf096030-c7de-42e1-a8b3-eb91585d3035'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:12.579199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-bf096030-c7de-42e1-a8b3-eb91585d3035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73042a79e92414aa8af1f7483a68884', 'request_id': 'req-bf096030-c7de-42e1-a8b3-eb91585d3035'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:12.595607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-bf096030-c7de-42e1-a8b3-eb91585d3035 admin admin] The token cache is being invalidate because project c73042a79e92414aa8af1f7483a68884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:17:12.596077 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-bf096030-c7de-42e1-a8b3-eb91585d3035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:12.596960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-bf096030-c7de-42e1-a8b3-eb91585d3035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:12.599868 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1064/2122] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:17:12 2022] DELETE /identity/v3/projects/c73042a79e92414aa8af1f7483a68884 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:12.605302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b40bf-dbea-46e8-9240-2aef612d59ac None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:12.605641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b40bf-dbea-46e8-9240-2aef612d59ac None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:12.605915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b40bf-dbea-46e8-9240-2aef612d59ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:12.632902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-809b40bf-dbea-46e8-9240-2aef612d59ac None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:12.634371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-809b40bf-dbea-46e8-9240-2aef612d59ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:12.734107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1059/2123] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:12.741695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14c750-fcab-4a18-8713-d9808aabe6cd None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:12.742332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14c750-fcab-4a18-8713-d9808aabe6cd None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:12.742795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14c750-fcab-4a18-8713-d9808aabe6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:12.766316 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-0a14c750-fcab-4a18-8713-d9808aabe6cd None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:12.767886 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0a14c750-fcab-4a18-8713-d9808aabe6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:12.778098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1065/2124] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:12.782641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b40bf-dbea-46e8-9240-2aef612d59ac None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:12.793869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b40bf-dbea-46e8-9240-2aef612d59ac None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:12.801941 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8500638-3e3b-48b7-afcf-9e2c6176b7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:12.802624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8500638-3e3b-48b7-afcf-9e2c6176b7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:12.802978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8500638-3e3b-48b7-afcf-9e2c6176b7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:12.803284 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8500638-3e3b-48b7-afcf-9e2c6176b7c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:12.804065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8500638-3e3b-48b7-afcf-9e2c6176b7c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:12.804496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8500638-3e3b-48b7-afcf-9e2c6176b7c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:12.806407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8500638-3e3b-48b7-afcf-9e2c6176b7c5 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:12.820339 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1060/2125] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:12.825287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14c750-fcab-4a18-8713-d9808aabe6cd None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:12.834768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14c750-fcab-4a18-8713-d9808aabe6cd None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:12.841147 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09d2a6-651e-4832-b304-c8be6b188e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:12.842021 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09d2a6-651e-4832-b304-c8be6b188e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:12.842273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09d2a6-651e-4832-b304-c8be6b188e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:12.842537 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09d2a6-651e-4832-b304-c8be6b188e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:12.843184 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09d2a6-651e-4832-b304-c8be6b188e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:12.845241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09d2a6-651e-4832-b304-c8be6b188e55 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:12.878312 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1066/2126] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:17:12 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:12.882573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8500638-3e3b-48b7-afcf-9e2c6176b7c5 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:12.894291 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8500638-3e3b-48b7-afcf-9e2c6176b7c5 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:12.980322 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf19d3f-4ccb-4374-9ace-62463149ab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:12.981337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19d3f-4ccb-4374-9ace-62463149ab53 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:12.981645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19d3f-4ccb-4374-9ace-62463149ab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:12.981982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19d3f-4ccb-4374-9ace-62463149ab53 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:12.982696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19d3f-4ccb-4374-9ace-62463149ab53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:12.984668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19d3f-4ccb-4374-9ace-62463149ab53 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:13.019090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1061/2127] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:17:12 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:13.020396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09d2a6-651e-4832-b304-c8be6b188e55 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:13.042270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09d2a6-651e-4832-b304-c8be6b188e55 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:13.051021 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae1e67-8797-447f-87ca-d4afea58d0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:13.051908 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae1e67-8797-447f-87ca-d4afea58d0bb admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.052362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae1e67-8797-447f-87ca-d4afea58d0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.052770 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae1e67-8797-447f-87ca-d4afea58d0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.053605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae1e67-8797-447f-87ca-d4afea58d0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:13.055375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae1e67-8797-447f-87ca-d4afea58d0bb admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:13.067629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1067/2128] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:13.071901 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf19d3f-4ccb-4374-9ace-62463149ab53 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:13.090555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf19d3f-4ccb-4374-9ace-62463149ab53 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:13.107986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2ed81-24d7-4e8b-9f13-2aaaaf9f160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:13.108649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2ed81-24d7-4e8b-9f13-2aaaaf9f160b admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.108933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2ed81-24d7-4e8b-9f13-2aaaaf9f160b admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.109198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2ed81-24d7-4e8b-9f13-2aaaaf9f160b admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.110181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2ed81-24d7-4e8b-9f13-2aaaaf9f160b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:13.111538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2ed81-24d7-4e8b-9f13-2aaaaf9f160b admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:13.132209 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae1e67-8797-447f-87ca-d4afea58d0bb admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:13.140140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1062/2129] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:13.145324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae1e67-8797-447f-87ca-d4afea58d0bb admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:13.154941 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302686e-ac87-4ffe-bb70-c32fcf5ecba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:13.155756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302686e-ac87-4ffe-bb70-c32fcf5ecba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.156043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302686e-ac87-4ffe-bb70-c32fcf5ecba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.156291 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302686e-ac87-4ffe-bb70-c32fcf5ecba9 admin admin] PATH_INFO: `/v3/projects/5dd1d873f5e24ecfaa18d02bdf682b52/users/c4ea453d044840f5aa1d5d89ba5a942d/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.175812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302686e-ac87-4ffe-bb70-c32fcf5ecba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd1d873f5e24ecfaa18d02bdf682b52, user_id=c4ea453d044840f5aa1d5d89ba5a942d, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:13.178684 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302686e-ac87-4ffe-bb70-c32fcf5ecba9 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:13.206148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1068/2130] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:17:13 2022] PUT /identity/v3/projects/5dd1d873f5e24ecfaa18d02bdf682b52/users/c4ea453d044840f5aa1d5d89ba5a942d/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:13.213854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f7140-2f76-40b5-ac93-5928bd8f4550 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.213854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f7140-2f76-40b5-ac93-5928bd8f4550 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.213854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f7140-2f76-40b5-ac93-5928bd8f4550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.253567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-e22f7140-2f76-40b5-ac93-5928bd8f4550 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:13.254804 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e22f7140-2f76-40b5-ac93-5928bd8f4550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:13.271381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:13.341531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1063/2131] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:13.352871 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302686e-ac87-4ffe-bb70-c32fcf5ecba9 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:13.365152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0302686e-ac87-4ffe-bb70-c32fcf5ecba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:13.375842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedef53d-45c2-4e4f-a766-6d6602263e20 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.376200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedef53d-45c2-4e4f-a766-6d6602263e20 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.376478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedef53d-45c2-4e4f-a766-6d6602263e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.421648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-eedef53d-45c2-4e4f-a766-6d6602263e20 None None] MFA Rules not processed for user `cbc13eb415d444debe85eb97b7879749`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:13.424259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-eedef53d-45c2-4e4f-a766-6d6602263e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:13.466216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302686e-ac87-4ffe-bb70-c32fcf5ecba9 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:13.470269 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d63f3-8b10-42c8-80f1-806fc5a00d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:13.471207 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d63f3-8b10-42c8-80f1-806fc5a00d6d service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.471555 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d63f3-8b10-42c8-80f1-806fc5a00d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.471893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d63f3-8b10-42c8-80f1-806fc5a00d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.484375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d63f3-8b10-42c8-80f1-806fc5a00d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:13.486464 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d63f3-8b10-42c8-80f1-806fc5a00d6d service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:13.501772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1069/2132] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:13.543514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1064/2133] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:13.548624 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d63f3-8b10-42c8-80f1-806fc5a00d6d service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:13.550981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c23d63f3-8b10-42c8-80f1-806fc5a00d6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:13.596560 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d63f3-8b10-42c8-80f1-806fc5a00d6d service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:13.608930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4023b05-ce62-400f-9f25-041cca45dc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:13.609588 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4023b05-ce62-400f-9f25-041cca45dc44 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.609829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4023b05-ce62-400f-9f25-041cca45dc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.610095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4023b05-ce62-400f-9f25-041cca45dc44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.613956 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4023b05-ce62-400f-9f25-041cca45dc44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:13.618823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4023b05-ce62-400f-9f25-041cca45dc44 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:13.631711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:13.686208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1070/2134] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:17:13 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:13.691906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedef53d-45c2-4e4f-a766-6d6602263e20 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:13.720420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedef53d-45c2-4e4f-a766-6d6602263e20 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:13.877026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ce0c3-e436-4abb-ad99-e830af2b4905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:13.877789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ce0c3-e436-4abb-ad99-e830af2b4905 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.878018 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ce0c3-e436-4abb-ad99-e830af2b4905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.878326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ce0c3-e436-4abb-ad99-e830af2b4905 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.879730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ce0c3-e436-4abb-ad99-e830af2b4905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:13.884762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ce0c3-e436-4abb-ad99-e830af2b4905 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:13.943580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1065/2135] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:17:13 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:13.947990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4023b05-ce62-400f-9f25-041cca45dc44 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:13.965131 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4023b05-ce62-400f-9f25-041cca45dc44 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:13.977921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ff8ed-430d-4307-a4ec-b9ca7af37525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:13.981460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff8ed-430d-4307-a4ec-b9ca7af37525 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.981724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff8ed-430d-4307-a4ec-b9ca7af37525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.982598 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff8ed-430d-4307-a4ec-b9ca7af37525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.984106 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ff8ed-430d-4307-a4ec-b9ca7af37525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:13.989574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ff8ed-430d-4307-a4ec-b9ca7af37525 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:14.024178 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1071/2136] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:14.028131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ce0c3-e436-4abb-ad99-e830af2b4905 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:14.041795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ce0c3-e436-4abb-ad99-e830af2b4905 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:14.077537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b3445-afc6-4f9a-8ca9-a5b6b64a1e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:14.078693 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b3445-afc6-4f9a-8ca9-a5b6b64a1e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:14.078990 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b3445-afc6-4f9a-8ca9-a5b6b64a1e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:14.079322 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b3445-afc6-4f9a-8ca9-a5b6b64a1e71 admin admin] PATH_INFO: `/v3/projects/c476695077de41fc9b1a0e304e3e6acb/users/8b326571262b4faaa4ff17f72e7a8513/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:14.124715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b3445-afc6-4f9a-8ca9-a5b6b64a1e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c476695077de41fc9b1a0e304e3e6acb, user_id=8b326571262b4faaa4ff17f72e7a8513, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:14.127416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b3445-afc6-4f9a-8ca9-a5b6b64a1e71 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:14.156971 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1066/2137] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:17:14 2022] PUT /identity/v3/projects/c476695077de41fc9b1a0e304e3e6acb/users/8b326571262b4faaa4ff17f72e7a8513/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:14.160984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ff8ed-430d-4307-a4ec-b9ca7af37525 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:14.178239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ff8ed-430d-4307-a4ec-b9ca7af37525 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:14.330255 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baffaae-eb22-4e1c-953f-1f590adf6483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:14.331163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baffaae-eb22-4e1c-953f-1f590adf6483 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:14.331474 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baffaae-eb22-4e1c-953f-1f590adf6483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:14.331752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baffaae-eb22-4e1c-953f-1f590adf6483 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:14.332470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baffaae-eb22-4e1c-953f-1f590adf6483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:14.334202 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baffaae-eb22-4e1c-953f-1f590adf6483 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:14.363848 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1072/2138] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:14.369289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b3445-afc6-4f9a-8ca9-a5b6b64a1e71 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:14.391154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b3445-afc6-4f9a-8ca9-a5b6b64a1e71 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:14.402203 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddca1b-47ed-49ea-bcef-0fc3721c2e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:14.403867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddca1b-47ed-49ea-bcef-0fc3721c2e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:14.404167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddca1b-47ed-49ea-bcef-0fc3721c2e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:14.404418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddca1b-47ed-49ea-bcef-0fc3721c2e02 admin admin] PATH_INFO: `/v3/projects/c476695077de41fc9b1a0e304e3e6acb/users/8b326571262b4faaa4ff17f72e7a8513/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:14.414701 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddca1b-47ed-49ea-bcef-0fc3721c2e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c476695077de41fc9b1a0e304e3e6acb, user_id=8b326571262b4faaa4ff17f72e7a8513, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:14.418138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddca1b-47ed-49ea-bcef-0fc3721c2e02 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:14.424653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:14.442746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1067/2139] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:17:14 2022] PUT /identity/v3/projects/c476695077de41fc9b1a0e304e3e6acb/users/8b326571262b4faaa4ff17f72e7a8513/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:17.695114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baffaae-eb22-4e1c-953f-1f590adf6483 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:17.698361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8baffaae-eb22-4e1c-953f-1f590adf6483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:17.727872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baffaae-eb22-4e1c-953f-1f590adf6483 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:17.884013 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:17.884968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:17.885504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:17.887008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] PATH_INFO: `/v3/users/6609fd0d407d403b9baf5746bf18a258` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:17.888571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6609fd0d407d403b9baf5746bf18a258)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:17.891221 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:18.050967 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6609fd0d407d403b9baf5746bf18a258'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:18.062316 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6609fd0d407d403b9baf5746bf18a258'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:18.063649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6609fd0d407d403b9baf5746bf18a258'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:18.104216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6609fd0d407d403b9baf5746bf18a258'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:18.114940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:18.125738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6609fd0d407d403b9baf5746bf18a258'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:18.146942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1073/2140] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:17:17 2022] DELETE /identity/v3/users/6609fd0d407d403b9baf5746bf18a258 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:18.148863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4ab44-a7a6-45ee-bd2f-8bc672dc6208 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:18.149416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4ab44-a7a6-45ee-bd2f-8bc672dc6208 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:18.149501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4ab44-a7a6-45ee-bd2f-8bc672dc6208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:18.191441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-1ad4ab44-a7a6-45ee-bd2f-8bc672dc6208 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:18.192627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1ad4ab44-a7a6-45ee-bd2f-8bc672dc6208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:18.346524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1068/2141] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:18.372532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:18.376943 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:18.525194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bf466-7e82-486e-b09c-101fbc09834b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:18.542550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddf84c-370e-4d90-8b3e-9de38c6c15b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:18.543691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddf84c-370e-4d90-8b3e-9de38c6c15b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:18.545732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddf84c-370e-4d90-8b3e-9de38c6c15b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:18.545732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddf84c-370e-4d90-8b3e-9de38c6c15b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:18.573665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddf84c-370e-4d90-8b3e-9de38c6c15b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:18.575142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddf84c-370e-4d90-8b3e-9de38c6c15b7 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:18.605982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1074/2142] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:20.122888 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4ab44-a7a6-45ee-bd2f-8bc672dc6208 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:20.124434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1ad4ab44-a7a6-45ee-bd2f-8bc672dc6208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:20.144722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4ab44-a7a6-45ee-bd2f-8bc672dc6208 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:20.159269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:20.159990 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:20.160316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:20.160590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9 admin admin] PATH_INFO: `/v3/projects/bfe9844d1ac04e7383c93dd50fcf1a29` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:20.163021 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe9844d1ac04e7383c93dd50fcf1a29)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:20.164963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:20.269388 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe9844d1ac04e7383c93dd50fcf1a29', 'request_id': 'req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:20.293542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe9844d1ac04e7383c93dd50fcf1a29', 'request_id': 'req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:20.305495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe9844d1ac04e7383c93dd50fcf1a29', 'request_id': 'req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:20.336665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9 admin admin] The token cache is being invalidate because project bfe9844d1ac04e7383c93dd50fcf1a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:17:20.339029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:20.340284 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ec3f2ae3-9534-4bd8-b1f5-de5789513bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:20.361530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1069/2143] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:17:20 2022] DELETE /identity/v3/projects/bfe9844d1ac04e7383c93dd50fcf1a29 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:22.046203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde40dcd-c593-4047-a0c4-0d268c649181 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:22.046673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde40dcd-c593-4047-a0c4-0d268c649181 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:22.046673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde40dcd-c593-4047-a0c4-0d268c649181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:22.106130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-dde40dcd-c593-4047-a0c4-0d268c649181 None None] MFA Rules not processed for user `8b326571262b4faaa4ff17f72e7a8513`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:22.107611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-dde40dcd-c593-4047-a0c4-0d268c649181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:22.118132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506528-d0ca-4791-875a-312b5ad70792 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:22.118711 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506528-d0ca-4791-875a-312b5ad70792 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:22.119844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506528-d0ca-4791-875a-312b5ad70792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:22.224978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-7b506528-d0ca-4791-875a-312b5ad70792 None None] MFA Rules not processed for user `c4ea453d044840f5aa1d5d89ba5a942d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:22.237903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7b506528-d0ca-4791-875a-312b5ad70792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:22.342660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1075/2144] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:22.343897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde40dcd-c593-4047-a0c4-0d268c649181 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:22.348515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-dde40dcd-c593-4047-a0c4-0d268c649181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:22.349781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1070/2145] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:17:22.362314 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7887b5-71b2-4f72-a66c-e87df8082c4d None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:22.362955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7887b5-71b2-4f72-a66c-e87df8082c4d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:22.363875 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7887b5-71b2-4f72-a66c-e87df8082c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:22.418490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ae7887b5-71b2-4f72-a66c-e87df8082c4d None None] MFA Rules not processed for user `c4ea453d044840f5aa1d5d89ba5a942d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:22.420892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ae7887b5-71b2-4f72-a66c-e87df8082c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:22.445802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1071/2146] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:17:22.457946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7887b5-71b2-4f72-a66c-e87df8082c4d None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:22.459679 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ae7887b5-71b2-4f72-a66c-e87df8082c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:22.467996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:22.552888 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde40dcd-c593-4047-a0c4-0d268c649181 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:22.567243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5a6d5-223c-45cf-9eb7-c62c36df1177 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:22.568007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a6d5-223c-45cf-9eb7-c62c36df1177 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:22.568541 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a6d5-223c-45cf-9eb7-c62c36df1177 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:22.568670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a6d5-223c-45cf-9eb7-c62c36df1177 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:22.571005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b5d5a6d5-223c-45cf-9eb7-c62c36df1177 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:22.593166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:22.629716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7887b5-71b2-4f72-a66c-e87df8082c4d None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:22.638907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca68cf-a69a-415e-897f-5579b26bbc0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:22.640172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca68cf-a69a-415e-897f-5579b26bbc0b service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:22.640714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca68cf-a69a-415e-897f-5579b26bbc0b service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:22.641087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca68cf-a69a-415e-897f-5579b26bbc0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:22.654481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca68cf-a69a-415e-897f-5579b26bbc0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:22.656332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca68cf-a69a-415e-897f-5579b26bbc0b service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:22.669824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1072/2147] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:17:22.679205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5a6d5-223c-45cf-9eb7-c62c36df1177 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:22.681815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5a6d5-223c-45cf-9eb7-c62c36df1177 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:22.695902 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1076/2148] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:23.607941 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7c744-7824-46b7-a74e-779db5b2d087 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:23.608469 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7c744-7824-46b7-a74e-779db5b2d087 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:23.608469 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7c744-7824-46b7-a74e-779db5b2d087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:23.676668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-9ac7c744-7824-46b7-a74e-779db5b2d087 None None] MFA Rules not processed for user `c4ea453d044840f5aa1d5d89ba5a942d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:23.678011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-9ac7c744-7824-46b7-a74e-779db5b2d087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:23.697666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1073/2149] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:24.343520 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d86cf-7664-4533-8e86-8719b07aaf22 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:24.344037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d86cf-7664-4533-8e86-8719b07aaf22 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:24.344121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d86cf-7664-4533-8e86-8719b07aaf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:24.364229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d28d86cf-7664-4533-8e86-8719b07aaf22 None None] MFA Rules not processed for user `cbc13eb415d444debe85eb97b7879749`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:24.365574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d28d86cf-7664-4533-8e86-8719b07aaf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:24.372982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1077/2150] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:32.742125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7c744-7824-46b7-a74e-779db5b2d087 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:32.743689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-9ac7c744-7824-46b7-a74e-779db5b2d087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:32.846796 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7c744-7824-46b7-a74e-779db5b2d087 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:32.852419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:32.854078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:32.854580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:32.855123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] PATH_INFO: `/v3/users/ddb4469edcd54987a3549fd83ec41fac` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:32.858908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb4469edcd54987a3549fd83ec41fac)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:32.861083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:32.971548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb4469edcd54987a3549fd83ec41fac'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:32.994939 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb4469edcd54987a3549fd83ec41fac'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:32.996043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb4469edcd54987a3549fd83ec41fac'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:32.996700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb4469edcd54987a3549fd83ec41fac'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:33.009554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb4469edcd54987a3549fd83ec41fac'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:33.022404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:33.028632 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1074/2151] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:17:32 2022] DELETE /identity/v3/users/ddb4469edcd54987a3549fd83ec41fac => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:33.379640 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d86cf-7664-4533-8e86-8719b07aaf22 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:33.422009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d86cf-7664-4533-8e86-8719b07aaf22 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:33.534373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:33.535042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:33.535322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:33.535578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] PATH_INFO: `/v3/projects/f297ce3f457a4b238c429c529d33f816` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:33.536711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f297ce3f457a4b238c429c529d33f816)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:33.538771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:33.594783 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f297ce3f457a4b238c429c529d33f816', 'request_id': 'req-6843b154-b92c-4561-8483-23446869bcc8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:33.603688 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f297ce3f457a4b238c429c529d33f816', 'request_id': 'req-6843b154-b92c-4561-8483-23446869bcc8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:33.610781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f297ce3f457a4b238c429c529d33f816', 'request_id': 'req-6843b154-b92c-4561-8483-23446869bcc8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:33.621372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] The token cache is being invalidate because project f297ce3f457a4b238c429c529d33f816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:17:33.621662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:33.622309 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:33.623862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1078/2152] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:17:33 2022] DELETE /identity/v3/projects/f297ce3f457a4b238c429c529d33f816 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:33.628019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:33.629654 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:33.643817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070373e7-0184-446f-9846-9ee9116f6bde admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:33.759639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee537c5-630b-463f-941a-4f81f343d77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:33.760579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee537c5-630b-463f-941a-4f81f343d77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:33.760850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee537c5-630b-463f-941a-4f81f343d77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:33.761801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee537c5-630b-463f-941a-4f81f343d77b admin admin] PATH_INFO: `/v3/users/5608f7156d3a420b837f48d40c69f4a7` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:33.762602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee537c5-630b-463f-941a-4f81f343d77b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5608f7156d3a420b837f48d40c69f4a7)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:33.764537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee537c5-630b-463f-941a-4f81f343d77b admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:33.818782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4ee537c5-630b-463f-941a-4f81f343d77b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5608f7156d3a420b837f48d40c69f4a7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:33.834903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4ee537c5-630b-463f-941a-4f81f343d77b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5608f7156d3a420b837f48d40c69f4a7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:33.835620 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4ee537c5-630b-463f-941a-4f81f343d77b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5608f7156d3a420b837f48d40c69f4a7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:33.836233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4ee537c5-630b-463f-941a-4f81f343d77b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5608f7156d3a420b837f48d40c69f4a7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:33.851862 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4ee537c5-630b-463f-941a-4f81f343d77b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5608f7156d3a420b837f48d40c69f4a7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:33.865751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1075/2153] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:17:33 2022] DELETE /identity/v3/users/5608f7156d3a420b837f48d40c69f4a7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:34.055849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:34.058176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:34.073982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843b154-b92c-4561-8483-23446869bcc8 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:34.123479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:34.150993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef246098-7576-4add-8bb2-9cbb31e86ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:34.152540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef246098-7576-4add-8bb2-9cbb31e86ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.157200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef246098-7576-4add-8bb2-9cbb31e86ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.157603 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef246098-7576-4add-8bb2-9cbb31e86ff8 admin admin] PATH_INFO: `/v3/projects/49761b4bc85c4eaf98e133521ee9b1d4` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.159110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef246098-7576-4add-8bb2-9cbb31e86ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49761b4bc85c4eaf98e133521ee9b1d4)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:34.161021 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef246098-7576-4add-8bb2-9cbb31e86ff8 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:34.218236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ef246098-7576-4add-8bb2-9cbb31e86ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49761b4bc85c4eaf98e133521ee9b1d4', 'request_id': 'req-ef246098-7576-4add-8bb2-9cbb31e86ff8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:34.227254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ef246098-7576-4add-8bb2-9cbb31e86ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49761b4bc85c4eaf98e133521ee9b1d4', 'request_id': 'req-ef246098-7576-4add-8bb2-9cbb31e86ff8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:34.234635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ef246098-7576-4add-8bb2-9cbb31e86ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49761b4bc85c4eaf98e133521ee9b1d4', 'request_id': 'req-ef246098-7576-4add-8bb2-9cbb31e86ff8'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:34.248844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ef246098-7576-4add-8bb2-9cbb31e86ff8 admin admin] The token cache is being invalidate because project 49761b4bc85c4eaf98e133521ee9b1d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:17:34.249163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ef246098-7576-4add-8bb2-9cbb31e86ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:34.249883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ef246098-7576-4add-8bb2-9cbb31e86ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:34.251505 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1079/2154] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:17:34 2022] DELETE /identity/v3/projects/49761b4bc85c4eaf98e133521ee9b1d4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:34.256551 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e00431-594d-43c0-9db7-8bc1517398e7 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.256814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e00431-594d-43c0-9db7-8bc1517398e7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.257083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e00431-594d-43c0-9db7-8bc1517398e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.282220 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-73e00431-594d-43c0-9db7-8bc1517398e7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:34.283425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-73e00431-594d-43c0-9db7-8bc1517398e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:34.346144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1076/2155] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:34.353872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c2961-f8eb-491f-a64e-14b4bcb51037 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.354304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c2961-f8eb-491f-a64e-14b4bcb51037 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.354669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c2961-f8eb-491f-a64e-14b4bcb51037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.375939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-392c2961-f8eb-491f-a64e-14b4bcb51037 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:34.377424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-392c2961-f8eb-491f-a64e-14b4bcb51037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:34.389101 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1080/2156] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:17:34.393668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e00431-594d-43c0-9db7-8bc1517398e7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:34.404407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e00431-594d-43c0-9db7-8bc1517398e7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:34.409611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeef73-f533-4fd4-874e-9558653daa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:34.410243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeef73-f533-4fd4-874e-9558653daa97 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.410515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeef73-f533-4fd4-874e-9558653daa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.410787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeef73-f533-4fd4-874e-9558653daa97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.411490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbeef73-f533-4fd4-874e-9558653daa97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:34.411791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbeef73-f533-4fd4-874e-9558653daa97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:34.413443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbeef73-f533-4fd4-874e-9558653daa97 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:34.429156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1077/2157] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:34.433896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c2961-f8eb-491f-a64e-14b4bcb51037 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:34.443351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c2961-f8eb-491f-a64e-14b4bcb51037 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:34.448575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c03d8c-50f7-45a5-9b14-043609d48f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:34.449395 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c03d8c-50f7-45a5-9b14-043609d48f25 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.449675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c03d8c-50f7-45a5-9b14-043609d48f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.449948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c03d8c-50f7-45a5-9b14-043609d48f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.450589 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c03d8c-50f7-45a5-9b14-043609d48f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:34.452494 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c03d8c-50f7-45a5-9b14-043609d48f25 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:34.498541 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1081/2158] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:17:34 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:34.499928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeef73-f533-4fd4-874e-9558653daa97 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:34.510500 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeef73-f533-4fd4-874e-9558653daa97 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:34.514667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:34.588383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333520cb-132f-4eaa-acfe-a5ef19ff5e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:34.589076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333520cb-132f-4eaa-acfe-a5ef19ff5e95 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.589324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333520cb-132f-4eaa-acfe-a5ef19ff5e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.589324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333520cb-132f-4eaa-acfe-a5ef19ff5e95 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.590225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333520cb-132f-4eaa-acfe-a5ef19ff5e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:34.592126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333520cb-132f-4eaa-acfe-a5ef19ff5e95 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:34.617636 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1078/2159] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:17:34 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:17:34.622107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c03d8c-50f7-45a5-9b14-043609d48f25 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:34.633071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c03d8c-50f7-45a5-9b14-043609d48f25 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:34.639385 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf8fa1-4f6d-4da3-8077-af47c7794e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:34.640010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf8fa1-4f6d-4da3-8077-af47c7794e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.640286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf8fa1-4f6d-4da3-8077-af47c7794e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.640566 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf8fa1-4f6d-4da3-8077-af47c7794e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.641251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf8fa1-4f6d-4da3-8077-af47c7794e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:34.642845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf8fa1-4f6d-4da3-8077-af47c7794e40 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:34.654297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1082/2160] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:34.658678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333520cb-132f-4eaa-acfe-a5ef19ff5e95 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:34.670540 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333520cb-132f-4eaa-acfe-a5ef19ff5e95 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:34.675664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d51f7c-d3ee-4415-acb8-77101d032c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:34.676397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d51f7c-d3ee-4415-acb8-77101d032c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.676666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d51f7c-d3ee-4415-acb8-77101d032c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.676937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d51f7c-d3ee-4415-acb8-77101d032c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.677692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d51f7c-d3ee-4415-acb8-77101d032c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:34.679350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d51f7c-d3ee-4415-acb8-77101d032c64 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:34.691964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1079/2161] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:34.696330 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf8fa1-4f6d-4da3-8077-af47c7794e40 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:34.708038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf8fa1-4f6d-4da3-8077-af47c7794e40 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:34.713525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3a674-a295-4c47-9907-a2da34b62f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:34.714981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a674-a295-4c47-9907-a2da34b62f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.715361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a674-a295-4c47-9907-a2da34b62f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.715632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a674-a295-4c47-9907-a2da34b62f43 admin admin] PATH_INFO: `/v3/projects/afb0f395bb9f4b9d933d8fefd21f0ed5/users/ecb8990f939d47cfa9dd29230577fead/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.731819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3a674-a295-4c47-9907-a2da34b62f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb0f395bb9f4b9d933d8fefd21f0ed5, user_id=ecb8990f939d47cfa9dd29230577fead, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:34.737328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3a674-a295-4c47-9907-a2da34b62f43 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:34.754752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1083/2162] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:17:34 2022] PUT /identity/v3/projects/afb0f395bb9f4b9d933d8fefd21f0ed5/users/ecb8990f939d47cfa9dd29230577fead/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:34.766649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9ea2e-8ace-46c6-a7b9-f50aa510011b None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.767353 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9ea2e-8ace-46c6-a7b9-f50aa510011b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.767353 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9ea2e-8ace-46c6-a7b9-f50aa510011b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.800242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-90c9ea2e-8ace-46c6-a7b9-f50aa510011b None None] MFA Rules not processed for user `ecb8990f939d47cfa9dd29230577fead`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:34.801524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-90c9ea2e-8ace-46c6-a7b9-f50aa510011b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:34.878369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1080/2163] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:17:34.891317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3a674-a295-4c47-9907-a2da34b62f43 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:34.894667 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e0a3a674-a295-4c47-9907-a2da34b62f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:34.961249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3a674-a295-4c47-9907-a2da34b62f43 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:34.966097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff08d2-2174-4ba1-93a6-379a0911601c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:34.966932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff08d2-2174-4ba1-93a6-379a0911601c service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.967220 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff08d2-2174-4ba1-93a6-379a0911601c service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.967684 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff08d2-2174-4ba1-93a6-379a0911601c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.977458 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff08d2-2174-4ba1-93a6-379a0911601c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:34.978895 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff08d2-2174-4ba1-93a6-379a0911601c service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:34.988367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1084/2164] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:41.566021 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9ea2e-8ace-46c6-a7b9-f50aa510011b None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:41.642190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9ea2e-8ace-46c6-a7b9-f50aa510011b None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:41.648968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:41.649664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:41.649935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:41.650205 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] PATH_INFO: `/v3/users/ecb8990f939d47cfa9dd29230577fead` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:41.651407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb8990f939d47cfa9dd29230577fead)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:41.653466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:41.671363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:41.720676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb8990f939d47cfa9dd29230577fead'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:41.742567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb8990f939d47cfa9dd29230577fead'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:41.743422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb8990f939d47cfa9dd29230577fead'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:41.744096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb8990f939d47cfa9dd29230577fead'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:41.753227 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb8990f939d47cfa9dd29230577fead'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:41.766149 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1081/2165] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:17:41 2022] DELETE /identity/v3/users/ecb8990f939d47cfa9dd29230577fead => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:41.770994 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb2aae-21c8-4a53-a8c4-1ec3194994b0 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:41.771472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb2aae-21c8-4a53-a8c4-1ec3194994b0 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:41.771557 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb2aae-21c8-4a53-a8c4-1ec3194994b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:41.785240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:41.791934 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-8dbb2aae-21c8-4a53-a8c4-1ec3194994b0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:41.793669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8dbb2aae-21c8-4a53-a8c4-1ec3194994b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:41.855024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1085/2166] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:41.865237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:41.866794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:41.929497 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732144d-1d58-4b05-83ee-98c7373dfc84 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:41.933323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05702f3f-4f93-4147-ab36-68320818f568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:41.933931 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05702f3f-4f93-4147-ab36-68320818f568 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:41.934206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05702f3f-4f93-4147-ab36-68320818f568 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:41.934858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05702f3f-4f93-4147-ab36-68320818f568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:41.945808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05702f3f-4f93-4147-ab36-68320818f568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:41.947288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05702f3f-4f93-4147-ab36-68320818f568 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:41.957876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1082/2167] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:42.242412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb2aae-21c8-4a53-a8c4-1ec3194994b0 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:42.243933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8dbb2aae-21c8-4a53-a8c4-1ec3194994b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:42.259419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb2aae-21c8-4a53-a8c4-1ec3194994b0 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:42.265611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65e1a9-df4a-4349-8069-f050bb0df2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:42.266600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e1a9-df4a-4349-8069-f050bb0df2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:42.266882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e1a9-df4a-4349-8069-f050bb0df2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:42.267150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e1a9-df4a-4349-8069-f050bb0df2cb admin admin] PATH_INFO: `/v3/projects/afb0f395bb9f4b9d933d8fefd21f0ed5` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:42.268492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65e1a9-df4a-4349-8069-f050bb0df2cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb0f395bb9f4b9d933d8fefd21f0ed5)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:42.270910 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65e1a9-df4a-4349-8069-f050bb0df2cb admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:42.332524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ba65e1a9-df4a-4349-8069-f050bb0df2cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb0f395bb9f4b9d933d8fefd21f0ed5', 'request_id': 'req-ba65e1a9-df4a-4349-8069-f050bb0df2cb'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:42.341868 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ba65e1a9-df4a-4349-8069-f050bb0df2cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb0f395bb9f4b9d933d8fefd21f0ed5', 'request_id': 'req-ba65e1a9-df4a-4349-8069-f050bb0df2cb'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:42.348373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ba65e1a9-df4a-4349-8069-f050bb0df2cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb0f395bb9f4b9d933d8fefd21f0ed5', 'request_id': 'req-ba65e1a9-df4a-4349-8069-f050bb0df2cb'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:42.359152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ba65e1a9-df4a-4349-8069-f050bb0df2cb admin admin] The token cache is being invalidate because project afb0f395bb9f4b9d933d8fefd21f0ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:17:42.359438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ba65e1a9-df4a-4349-8069-f050bb0df2cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:42.360082 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ba65e1a9-df4a-4349-8069-f050bb0df2cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:42.361596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1086/2168] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:17:42 2022] DELETE /identity/v3/projects/afb0f395bb9f4b9d933d8fefd21f0ed5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:42.366683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13dbf0-66f8-41ae-818a-17e4fb50eeca None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:42.366955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13dbf0-66f8-41ae-818a-17e4fb50eeca None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:42.367242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13dbf0-66f8-41ae-818a-17e4fb50eeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:42.387810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ee13dbf0-66f8-41ae-818a-17e4fb50eeca None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:42.389033 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ee13dbf0-66f8-41ae-818a-17e4fb50eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:42.451341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1083/2169] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:42.461196 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7f738-b5bc-4856-bb5b-68b973b61c10 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:42.461615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7f738-b5bc-4856-bb5b-68b973b61c10 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:42.461988 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7f738-b5bc-4856-bb5b-68b973b61c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:42.485139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-8dd7f738-b5bc-4856-bb5b-68b973b61c10 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:42.487015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8dd7f738-b5bc-4856-bb5b-68b973b61c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:42.496110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1087/2170] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:42.501141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13dbf0-66f8-41ae-818a-17e4fb50eeca None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:42.511699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13dbf0-66f8-41ae-818a-17e4fb50eeca None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:42.517097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93bec4-5903-4688-83e9-4a0ab4add9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:42.517741 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93bec4-5903-4688-83e9-4a0ab4add9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:42.518012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93bec4-5903-4688-83e9-4a0ab4add9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:42.518279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93bec4-5903-4688-83e9-4a0ab4add9a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:42.519160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93bec4-5903-4688-83e9-4a0ab4add9a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:42.519413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93bec4-5903-4688-83e9-4a0ab4add9a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:42.521648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93bec4-5903-4688-83e9-4a0ab4add9a5 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:42.534532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1084/2171] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:42.539561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7f738-b5bc-4856-bb5b-68b973b61c10 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:42.549687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7f738-b5bc-4856-bb5b-68b973b61c10 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:42.554786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6bccb-f32a-4d81-af7f-6fb3885ee152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:42.555394 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6bccb-f32a-4d81-af7f-6fb3885ee152 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:42.555668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6bccb-f32a-4d81-af7f-6fb3885ee152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:42.555935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6bccb-f32a-4d81-af7f-6fb3885ee152 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:42.556567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6bccb-f32a-4d81-af7f-6fb3885ee152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:42.558488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6bccb-f32a-4d81-af7f-6fb3885ee152 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:42.589765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1088/2172] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:17:42 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:42.594295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93bec4-5903-4688-83e9-4a0ab4add9a5 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:42.604721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93bec4-5903-4688-83e9-4a0ab4add9a5 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:42.625923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:42.664944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65b502-115d-4e1f-88c0-b4867dc58f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:42.665572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b502-115d-4e1f-88c0-b4867dc58f83 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:42.665841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b502-115d-4e1f-88c0-b4867dc58f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:42.666105 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b502-115d-4e1f-88c0-b4867dc58f83 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:42.666919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65b502-115d-4e1f-88c0-b4867dc58f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:42.668787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65b502-115d-4e1f-88c0-b4867dc58f83 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:42.695612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1085/2173] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:17:42 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:42.699954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6bccb-f32a-4d81-af7f-6fb3885ee152 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:42.712252 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6bccb-f32a-4d81-af7f-6fb3885ee152 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:42.718090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ff52b-82ce-4dfa-b8c6-419ce05442d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:42.718665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ff52b-82ce-4dfa-b8c6-419ce05442d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:42.718963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ff52b-82ce-4dfa-b8c6-419ce05442d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:42.719220 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ff52b-82ce-4dfa-b8c6-419ce05442d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:42.719854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ff52b-82ce-4dfa-b8c6-419ce05442d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:42.721482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ff52b-82ce-4dfa-b8c6-419ce05442d6 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:42.732030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1089/2174] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:17:42.736530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65b502-115d-4e1f-88c0-b4867dc58f83 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:42.747482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65b502-115d-4e1f-88c0-b4867dc58f83 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:42.752951 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b65ee-2945-442c-9746-16b1bde31bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:42.753597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b65ee-2945-442c-9746-16b1bde31bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:42.753876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b65ee-2945-442c-9746-16b1bde31bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:42.754145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b65ee-2945-442c-9746-16b1bde31bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:42.754861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b65ee-2945-442c-9746-16b1bde31bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:42.756492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b65ee-2945-442c-9746-16b1bde31bc4 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:42.767897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1086/2175] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:42.772626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ff52b-82ce-4dfa-b8c6-419ce05442d6 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:42.783537 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ff52b-82ce-4dfa-b8c6-419ce05442d6 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:42.788986 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53515318-849a-49b5-a90f-ab6ea2153ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:42.789651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53515318-849a-49b5-a90f-ab6ea2153ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:42.789946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53515318-849a-49b5-a90f-ab6ea2153ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:42.790214 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53515318-849a-49b5-a90f-ab6ea2153ae4 admin admin] PATH_INFO: `/v3/projects/4d7db3d6d3d04cc2838d52556c69898d/users/94e032ef83ef4895961e6d41701097f2/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:42.806596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53515318-849a-49b5-a90f-ab6ea2153ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7db3d6d3d04cc2838d52556c69898d, user_id=94e032ef83ef4895961e6d41701097f2, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:42.809373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53515318-849a-49b5-a90f-ab6ea2153ae4 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:42.827115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1090/2176] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:17:42 2022] PUT /identity/v3/projects/4d7db3d6d3d04cc2838d52556c69898d/users/94e032ef83ef4895961e6d41701097f2/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:42.838836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5ad25-1746-4936-8e85-e6fb1a341781 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:42.839337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5ad25-1746-4936-8e85-e6fb1a341781 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:42.840439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5ad25-1746-4936-8e85-e6fb1a341781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:42.870057 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-2ff5ad25-1746-4936-8e85-e6fb1a341781 None None] MFA Rules not processed for user `94e032ef83ef4895961e6d41701097f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:42.871319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2ff5ad25-1746-4936-8e85-e6fb1a341781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:42.939246 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1087/2177] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:42.944080 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53515318-849a-49b5-a90f-ab6ea2153ae4 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:42.974196 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:43.009501 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53515318-849a-49b5-a90f-ab6ea2153ae4 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:43.014330 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46fcfc-4fae-4f44-89c1-ea58b32aa533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:43.014966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fcfc-4fae-4f44-89c1-ea58b32aa533 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:43.015245 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fcfc-4fae-4f44-89c1-ea58b32aa533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:43.015516 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fcfc-4fae-4f44-89c1-ea58b32aa533 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:43.016230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46fcfc-4fae-4f44-89c1-ea58b32aa533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:43.018176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46fcfc-4fae-4f44-89c1-ea58b32aa533 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:43.046893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1091/2178] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:17:42 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:43.051197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5ad25-1746-4936-8e85-e6fb1a341781 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:43.062898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5ad25-1746-4936-8e85-e6fb1a341781 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:43.125259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf01d8-39f3-4d54-8acf-955ed424e21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:43.126223 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf01d8-39f3-4d54-8acf-955ed424e21a admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:43.126496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf01d8-39f3-4d54-8acf-955ed424e21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:43.126762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf01d8-39f3-4d54-8acf-955ed424e21a admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:43.127404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf01d8-39f3-4d54-8acf-955ed424e21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:43.129347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf01d8-39f3-4d54-8acf-955ed424e21a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:43.156767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1088/2179] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:17:43 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:17:43.160880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46fcfc-4fae-4f44-89c1-ea58b32aa533 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:43.171994 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46fcfc-4fae-4f44-89c1-ea58b32aa533 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:43.177229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a6b2d-f796-450c-a953-99a09bc33002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:43.177860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a6b2d-f796-450c-a953-99a09bc33002 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:43.178166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a6b2d-f796-450c-a953-99a09bc33002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:43.178447 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a6b2d-f796-450c-a953-99a09bc33002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:43.179085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a6b2d-f796-450c-a953-99a09bc33002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:43.180749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a6b2d-f796-450c-a953-99a09bc33002 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:43.195648 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1092/2180] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:17:43.196576 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf01d8-39f3-4d54-8acf-955ed424e21a admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:43.210214 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf01d8-39f3-4d54-8acf-955ed424e21a admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:43.216765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05dab9-6552-4956-bf72-055dd70a0f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:43.218056 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05dab9-6552-4956-bf72-055dd70a0f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:43.218503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05dab9-6552-4956-bf72-055dd70a0f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:43.219321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05dab9-6552-4956-bf72-055dd70a0f15 admin admin] PATH_INFO: `/v3/projects/f1d16c752a9143219164b54029b7c4a3/users/1ef7501b44f14bc293e62cda2754532d/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:43.236555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05dab9-6552-4956-bf72-055dd70a0f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d16c752a9143219164b54029b7c4a3, user_id=1ef7501b44f14bc293e62cda2754532d, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:43.239464 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05dab9-6552-4956-bf72-055dd70a0f15 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:43.252826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:43.259418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1089/2181] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:17:43 2022] PUT /identity/v3/projects/f1d16c752a9143219164b54029b7c4a3/users/1ef7501b44f14bc293e62cda2754532d/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:17:43.263488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a6b2d-f796-450c-a953-99a09bc33002 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:43.275794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a6b2d-f796-450c-a953-99a09bc33002 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:43.336785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d62a9-0811-470e-82a8-02e250761b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:43.337433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d62a9-0811-470e-82a8-02e250761b55 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:43.337713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d62a9-0811-470e-82a8-02e250761b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:43.337979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d62a9-0811-470e-82a8-02e250761b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:43.338678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d62a9-0811-470e-82a8-02e250761b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:43.340240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d62a9-0811-470e-82a8-02e250761b55 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:43.350639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1093/2182] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:43.354923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05dab9-6552-4956-bf72-055dd70a0f15 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:43.365592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05dab9-6552-4956-bf72-055dd70a0f15 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:43.370307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e601ce-8da0-48eb-b0c6-22fc65506d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:43.370952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e601ce-8da0-48eb-b0c6-22fc65506d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:43.371233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e601ce-8da0-48eb-b0c6-22fc65506d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:43.371501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e601ce-8da0-48eb-b0c6-22fc65506d1d admin admin] PATH_INFO: `/v3/projects/f1d16c752a9143219164b54029b7c4a3/users/1ef7501b44f14bc293e62cda2754532d/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:43.373735 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e601ce-8da0-48eb-b0c6-22fc65506d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d16c752a9143219164b54029b7c4a3, user_id=1ef7501b44f14bc293e62cda2754532d, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:43.376397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e601ce-8da0-48eb-b0c6-22fc65506d1d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:43.386681 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1090/2183] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:17:43 2022] PUT /identity/v3/projects/f1d16c752a9143219164b54029b7c4a3/users/1ef7501b44f14bc293e62cda2754532d/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:17:43.397381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3c928-46e2-40e7-94dd-30e5768f9aeb None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:43.397663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3c928-46e2-40e7-94dd-30e5768f9aeb None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:43.397937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3c928-46e2-40e7-94dd-30e5768f9aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:43.428059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-a1c3c928-46e2-40e7-94dd-30e5768f9aeb None None] MFA Rules not processed for user `1ef7501b44f14bc293e62cda2754532d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:43.429293 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a1c3c928-46e2-40e7-94dd-30e5768f9aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:43.497239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1094/2184] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:17:43.508532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e601ce-8da0-48eb-b0c6-22fc65506d1d admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:43.510486 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c8e601ce-8da0-48eb-b0c6-22fc65506d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:43.573736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e601ce-8da0-48eb-b0c6-22fc65506d1d admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:43.578600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc8745-ac6b-442a-8774-5ec69ae8b2be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:43.579210 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc8745-ac6b-442a-8774-5ec69ae8b2be service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:43.579487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc8745-ac6b-442a-8774-5ec69ae8b2be service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:43.579744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc8745-ac6b-442a-8774-5ec69ae8b2be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:43.637865 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc8745-ac6b-442a-8774-5ec69ae8b2be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:43.639393 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc8745-ac6b-442a-8774-5ec69ae8b2be service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:43.648618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1091/2185] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:47.286247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3c928-46e2-40e7-94dd-30e5768f9aeb None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:47.314051 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:47.354380 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3c928-46e2-40e7-94dd-30e5768f9aeb None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:47.359813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:47.360452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:47.360733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:47.361000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] PATH_INFO: `/v3/users/94e032ef83ef4895961e6d41701097f2` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:47.362230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e032ef83ef4895961e6d41701097f2)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:47.364141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:47.421515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e032ef83ef4895961e6d41701097f2'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:47.431866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e032ef83ef4895961e6d41701097f2'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:47.432563 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e032ef83ef4895961e6d41701097f2'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:47.441060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e032ef83ef4895961e6d41701097f2'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:47.454621 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e032ef83ef4895961e6d41701097f2'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:47.461266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1095/2186] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:17:47 2022] DELETE /identity/v3/users/94e032ef83ef4895961e6d41701097f2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:17:47.466264 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b336ee2-1f3b-4cf0-8655-6ce3b7ea1ed7 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:47.466719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b336ee2-1f3b-4cf0-8655-6ce3b7ea1ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:47.466810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b336ee2-1f3b-4cf0-8655-6ce3b7ea1ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:47.489446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-6b336ee2-1f3b-4cf0-8655-6ce3b7ea1ed7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:47.489446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6b336ee2-1f3b-4cf0-8655-6ce3b7ea1ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:47.553749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1092/2187] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:47.563992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:47.565464 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:47.626596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d8641-7ae3-4b1a-86da-b7f0d1af9d86 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:47.630528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47df07-9876-427b-9a9c-3632c357aaac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:47.631203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47df07-9876-427b-9a9c-3632c357aaac service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:47.631483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47df07-9876-427b-9a9c-3632c357aaac service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:47.631745 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47df07-9876-427b-9a9c-3632c357aaac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:47.641479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47df07-9876-427b-9a9c-3632c357aaac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:47.642920 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47df07-9876-427b-9a9c-3632c357aaac service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:47.653173 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1096/2188] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:47.970524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b336ee2-1f3b-4cf0-8655-6ce3b7ea1ed7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:47.971858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6b336ee2-1f3b-4cf0-8655-6ce3b7ea1ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:47.984757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b336ee2-1f3b-4cf0-8655-6ce3b7ea1ed7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:47.991726 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:47.992570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:47.993029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:47.993287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] PATH_INFO: `/v3/projects/4d7db3d6d3d04cc2838d52556c69898d` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:47.994472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7db3d6d3d04cc2838d52556c69898d)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:47.996582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:48.042202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:48.052447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7db3d6d3d04cc2838d52556c69898d', 'request_id': 'req-73f3e155-2e1b-4978-b3df-e86271c8442e'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.061646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7db3d6d3d04cc2838d52556c69898d', 'request_id': 'req-73f3e155-2e1b-4978-b3df-e86271c8442e'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.068401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7db3d6d3d04cc2838d52556c69898d', 'request_id': 'req-73f3e155-2e1b-4978-b3df-e86271c8442e'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.079263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] The token cache is being invalidate because project 4d7db3d6d3d04cc2838d52556c69898d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:17:48.079536 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.080160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.081684 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1093/2189] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:17:47 2022] DELETE /identity/v3/projects/4d7db3d6d3d04cc2838d52556c69898d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:48.085744 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47df07-9876-427b-9a9c-3632c357aaac service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:48.095631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47df07-9876-427b-9a9c-3632c357aaac service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:48.139584 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:48.158111 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed474a-a658-41b9-8ff8-a19e416af40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:48.159004 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed474a-a658-41b9-8ff8-a19e416af40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:48.159398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed474a-a658-41b9-8ff8-a19e416af40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:48.159761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed474a-a658-41b9-8ff8-a19e416af40e admin admin] PATH_INFO: `/v3/users/1ef7501b44f14bc293e62cda2754532d` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:48.161679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed474a-a658-41b9-8ff8-a19e416af40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef7501b44f14bc293e62cda2754532d)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:48.164369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed474a-a658-41b9-8ff8-a19e416af40e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:48.219251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-74ed474a-a658-41b9-8ff8-a19e416af40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef7501b44f14bc293e62cda2754532d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.228305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-74ed474a-a658-41b9-8ff8-a19e416af40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef7501b44f14bc293e62cda2754532d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.228912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-74ed474a-a658-41b9-8ff8-a19e416af40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef7501b44f14bc293e62cda2754532d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.236282 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-74ed474a-a658-41b9-8ff8-a19e416af40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef7501b44f14bc293e62cda2754532d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.248514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-74ed474a-a658-41b9-8ff8-a19e416af40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef7501b44f14bc293e62cda2754532d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.254827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1097/2190] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:17:48 2022] DELETE /identity/v3/users/1ef7501b44f14bc293e62cda2754532d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:48.538049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:48.540096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:48.559174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3e155-2e1b-4978-b3df-e86271c8442e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:48.620800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f6808-57a9-4379-924f-b6208913b9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:48.621557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6808-57a9-4379-924f-b6208913b9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:48.621813 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6808-57a9-4379-924f-b6208913b9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:48.622365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6808-57a9-4379-924f-b6208913b9f7 admin admin] PATH_INFO: `/v3/projects/f1d16c752a9143219164b54029b7c4a3` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:48.623260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f6808-57a9-4379-924f-b6208913b9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d16c752a9143219164b54029b7c4a3)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:48.625186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f6808-57a9-4379-924f-b6208913b9f7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:48.679406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-cb5f6808-57a9-4379-924f-b6208913b9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d16c752a9143219164b54029b7c4a3', 'request_id': 'req-cb5f6808-57a9-4379-924f-b6208913b9f7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.689615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-cb5f6808-57a9-4379-924f-b6208913b9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d16c752a9143219164b54029b7c4a3', 'request_id': 'req-cb5f6808-57a9-4379-924f-b6208913b9f7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.696704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-cb5f6808-57a9-4379-924f-b6208913b9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d16c752a9143219164b54029b7c4a3', 'request_id': 'req-cb5f6808-57a9-4379-924f-b6208913b9f7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.708317 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-cb5f6808-57a9-4379-924f-b6208913b9f7 admin admin] The token cache is being invalidate because project f1d16c752a9143219164b54029b7c4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:17:48.708606 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-cb5f6808-57a9-4379-924f-b6208913b9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.709378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-cb5f6808-57a9-4379-924f-b6208913b9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:48.710940 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1094/2191] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:17:48 2022] DELETE /identity/v3/projects/f1d16c752a9143219164b54029b7c4a3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:48.715836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c4321-96f7-48c9-82f7-9287cbf3891f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:48.716335 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c4321-96f7-48c9-82f7-9287cbf3891f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:48.716429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c4321-96f7-48c9-82f7-9287cbf3891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:48.745147 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d73c4321-96f7-48c9-82f7-9287cbf3891f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:48.746566 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d73c4321-96f7-48c9-82f7-9287cbf3891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:48.811818 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1098/2192] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:48.821064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7de0b-a9e7-4541-b5d0-4bb9db89e064 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:48.821397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7de0b-a9e7-4541-b5d0-4bb9db89e064 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:48.821672 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7de0b-a9e7-4541-b5d0-4bb9db89e064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:48.843375 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-2ae7de0b-a9e7-4541-b5d0-4bb9db89e064 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:48.845260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2ae7de0b-a9e7-4541-b5d0-4bb9db89e064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:48.854062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1095/2193] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:48.858254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c4321-96f7-48c9-82f7-9287cbf3891f None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:48.868873 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c4321-96f7-48c9-82f7-9287cbf3891f None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:48.873666 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4d399-86ac-4f2c-9faf-b9ba6d137eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:48.874483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4d399-86ac-4f2c-9faf-b9ba6d137eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:48.874819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4d399-86ac-4f2c-9faf-b9ba6d137eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:48.875150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4d399-86ac-4f2c-9faf-b9ba6d137eb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:48.875866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4d399-86ac-4f2c-9faf-b9ba6d137eb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:48.876268 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4d399-86ac-4f2c-9faf-b9ba6d137eb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:48.877950 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4d399-86ac-4f2c-9faf-b9ba6d137eb8 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:48.893514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1099/2194] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:48.894838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7de0b-a9e7-4541-b5d0-4bb9db89e064 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:48.905066 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7de0b-a9e7-4541-b5d0-4bb9db89e064 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:48.911404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a6977-860b-4f59-b361-c294f3b1e954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:48.912107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a6977-860b-4f59-b361-c294f3b1e954 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:48.912386 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a6977-860b-4f59-b361-c294f3b1e954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:48.912650 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a6977-860b-4f59-b361-c294f3b1e954 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:48.913311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a6977-860b-4f59-b361-c294f3b1e954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:48.915261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a6977-860b-4f59-b361-c294f3b1e954 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:48.948935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1096/2195] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:17:48 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:48.953090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4d399-86ac-4f2c-9faf-b9ba6d137eb8 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:48.963601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4d399-86ac-4f2c-9faf-b9ba6d137eb8 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:49.022228 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:49.034872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4f9eb-f153-4dfa-8e24-fca0410c602e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:49.035615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4f9eb-f153-4dfa-8e24-fca0410c602e admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:49.035896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4f9eb-f153-4dfa-8e24-fca0410c602e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:49.036172 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4f9eb-f153-4dfa-8e24-fca0410c602e admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:49.036860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4f9eb-f153-4dfa-8e24-fca0410c602e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:49.039250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4f9eb-f153-4dfa-8e24-fca0410c602e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:49.063318 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1100/2196] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:17:48 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:49.067633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a6977-860b-4f59-b361-c294f3b1e954 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:49.078409 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a6977-860b-4f59-b361-c294f3b1e954 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:49.083539 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ac559-a284-4565-a309-4135e24d43dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:49.084166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ac559-a284-4565-a309-4135e24d43dd admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:49.084435 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ac559-a284-4565-a309-4135e24d43dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:49.084701 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ac559-a284-4565-a309-4135e24d43dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:49.085410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ac559-a284-4565-a309-4135e24d43dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:49.087037 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ac559-a284-4565-a309-4135e24d43dd admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:49.101378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1097/2197] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:17:49.102506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4f9eb-f153-4dfa-8e24-fca0410c602e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:49.113246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4f9eb-f153-4dfa-8e24-fca0410c602e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:49.119624 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55ece5-8735-48ce-a992-5b870dbc4ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:49.120253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55ece5-8735-48ce-a992-5b870dbc4ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:49.120534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55ece5-8735-48ce-a992-5b870dbc4ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:49.120805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55ece5-8735-48ce-a992-5b870dbc4ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:49.121516 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55ece5-8735-48ce-a992-5b870dbc4ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:49.123364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55ece5-8735-48ce-a992-5b870dbc4ab7 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:49.137297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1101/2198] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:17:49.141970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ac559-a284-4565-a309-4135e24d43dd admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:49.154327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ac559-a284-4565-a309-4135e24d43dd admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:49.178090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c35d43-8ddf-487e-8a9a-35bfbeaf94d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:49.178777 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35d43-8ddf-487e-8a9a-35bfbeaf94d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:49.179056 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35d43-8ddf-487e-8a9a-35bfbeaf94d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:49.179328 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35d43-8ddf-487e-8a9a-35bfbeaf94d8 admin admin] PATH_INFO: `/v3/projects/491f4440a14748d78054e3229ed55c2b/users/72a1893206b6442cbe0e3ca23101871a/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:49.192976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:49.200033 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c35d43-8ddf-487e-8a9a-35bfbeaf94d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=491f4440a14748d78054e3229ed55c2b, user_id=72a1893206b6442cbe0e3ca23101871a, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:49.203587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c35d43-8ddf-487e-8a9a-35bfbeaf94d8 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:49.224772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1098/2199] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:17:49 2022] PUT /identity/v3/projects/491f4440a14748d78054e3229ed55c2b/users/72a1893206b6442cbe0e3ca23101871a/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:49.229929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912f4b3-3c23-4c98-a169-b3f956c0a220 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:49.230210 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912f4b3-3c23-4c98-a169-b3f956c0a220 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:49.230573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912f4b3-3c23-4c98-a169-b3f956c0a220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:49.251871 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-9912f4b3-3c23-4c98-a169-b3f956c0a220 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:49.253136 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9912f4b3-3c23-4c98-a169-b3f956c0a220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:49.322568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1102/2200] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:17:49.353527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c35d43-8ddf-487e-8a9a-35bfbeaf94d8 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:49.355327 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f2c35d43-8ddf-487e-8a9a-35bfbeaf94d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:49.446432 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c35d43-8ddf-487e-8a9a-35bfbeaf94d8 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:49.450623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524461e-8c4f-4fb5-a45b-6c3f88c74c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:49.451245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524461e-8c4f-4fb5-a45b-6c3f88c74c27 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:49.451627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524461e-8c4f-4fb5-a45b-6c3f88c74c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:49.451977 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524461e-8c4f-4fb5-a45b-6c3f88c74c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:49.465426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524461e-8c4f-4fb5-a45b-6c3f88c74c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:49.466876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524461e-8c4f-4fb5-a45b-6c3f88c74c27 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:49.477723 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1099/2201] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:17:50.278453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87aaab-0fde-4175-a8b4-68d59d8ba471 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:50.279010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87aaab-0fde-4175-a8b4-68d59d8ba471 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:50.279010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87aaab-0fde-4175-a8b4-68d59d8ba471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:50.310696 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-ba87aaab-0fde-4175-a8b4-68d59d8ba471 None None] MFA Rules not processed for user `72a1893206b6442cbe0e3ca23101871a`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:50.312003 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ba87aaab-0fde-4175-a8b4-68d59d8ba471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:50.394968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1103/2202] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:50.408532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524461e-8c4f-4fb5-a45b-6c3f88c74c27 service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:50.410903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a524461e-8c4f-4fb5-a45b-6c3f88c74c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:50.497043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524461e-8c4f-4fb5-a45b-6c3f88c74c27 service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:50.500846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cb6fa-f579-4ef6-9577-1741bbe46612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:50.501752 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cb6fa-f579-4ef6-9577-1741bbe46612 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:50.502205 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cb6fa-f579-4ef6-9577-1741bbe46612 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:50.502500 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cb6fa-f579-4ef6-9577-1741bbe46612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:50.512738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cb6fa-f579-4ef6-9577-1741bbe46612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:50.514221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cb6fa-f579-4ef6-9577-1741bbe46612 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:50.524024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1100/2203] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:51.907266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cfdcb-b768-4092-a5a6-d0822a3b1959 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:51.908102 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cfdcb-b768-4092-a5a6-d0822a3b1959 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:51.908102 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cfdcb-b768-4092-a5a6-d0822a3b1959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:51.926948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-2b7cfdcb-b768-4092-a5a6-d0822a3b1959 None None] MFA Rules not processed for user `72a1893206b6442cbe0e3ca23101871a`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:51.928407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2b7cfdcb-b768-4092-a5a6-d0822a3b1959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:51.935488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1104/2204] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:56.649032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cb6fa-f579-4ef6-9577-1741bbe46612 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:56.651236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4e5cb6fa-f579-4ef6-9577-1741bbe46612 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:56.677028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cb6fa-f579-4ef6-9577-1741bbe46612 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:56.682536 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:56.683395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:56.683838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:56.684427 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] PATH_INFO: `/v3/users/1b129bc12f9d43bb9df6e3ae625b6863` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:56.686380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b129bc12f9d43bb9df6e3ae625b6863)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:56.690855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:56.760640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b129bc12f9d43bb9df6e3ae625b6863'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:56.781640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b129bc12f9d43bb9df6e3ae625b6863'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:56.783736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b129bc12f9d43bb9df6e3ae625b6863'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:56.784378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b129bc12f9d43bb9df6e3ae625b6863'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:56.794787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b129bc12f9d43bb9df6e3ae625b6863'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:56.814379 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1101/2205] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:17:56 2022] DELETE /identity/v3/users/1b129bc12f9d43bb9df6e3ae625b6863 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:56.819591 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894b3d3-6e2e-454e-97ba-9d054634e144 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:56.820399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894b3d3-6e2e-454e-97ba-9d054634e144 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:56.820842 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894b3d3-6e2e-454e-97ba-9d054634e144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:56.843636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-2894b3d3-6e2e-454e-97ba-9d054634e144 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:56.844858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2894b3d3-6e2e-454e-97ba-9d054634e144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:56.904696 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:56.920152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1105/2206] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:17:56.930402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:56.931945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:56.946223 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:56.999049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fce0e1-6ec7-455a-8511-7d0f855a1f84 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:57.006626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f71f7a-76bf-4bd2-9960-7cb733391888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:57.006998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f71f7a-76bf-4bd2-9960-7cb733391888 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:57.007360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f71f7a-76bf-4bd2-9960-7cb733391888 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:57.007741 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f71f7a-76bf-4bd2-9960-7cb733391888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:57.019273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f71f7a-76bf-4bd2-9960-7cb733391888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:57.021523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f71f7a-76bf-4bd2-9960-7cb733391888 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:57.032204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1102/2207] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:57.727168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894b3d3-6e2e-454e-97ba-9d054634e144 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:57.728948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2894b3d3-6e2e-454e-97ba-9d054634e144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:57.750595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894b3d3-6e2e-454e-97ba-9d054634e144 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:57.758189 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569d4b5-30f0-4c69-b124-7284eb515e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:57.759036 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569d4b5-30f0-4c69-b124-7284eb515e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:57.759352 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569d4b5-30f0-4c69-b124-7284eb515e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:57.759708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569d4b5-30f0-4c69-b124-7284eb515e70 admin admin] PATH_INFO: `/v3/projects/636cc861de5546048c75227000cd1d9a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:57.760971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569d4b5-30f0-4c69-b124-7284eb515e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=636cc861de5546048c75227000cd1d9a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:57.763211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569d4b5-30f0-4c69-b124-7284eb515e70 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:57.823410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-3569d4b5-30f0-4c69-b124-7284eb515e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636cc861de5546048c75227000cd1d9a', 'request_id': 'req-3569d4b5-30f0-4c69-b124-7284eb515e70'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:57.832405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-3569d4b5-30f0-4c69-b124-7284eb515e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636cc861de5546048c75227000cd1d9a', 'request_id': 'req-3569d4b5-30f0-4c69-b124-7284eb515e70'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:57.838995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-3569d4b5-30f0-4c69-b124-7284eb515e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636cc861de5546048c75227000cd1d9a', 'request_id': 'req-3569d4b5-30f0-4c69-b124-7284eb515e70'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:57.849583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-3569d4b5-30f0-4c69-b124-7284eb515e70 admin admin] The token cache is being invalidate because project 636cc861de5546048c75227000cd1d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:17:57.849951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-3569d4b5-30f0-4c69-b124-7284eb515e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:57.850643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-3569d4b5-30f0-4c69-b124-7284eb515e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:57.852183 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1106/2208] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:17:57 2022] DELETE /identity/v3/projects/636cc861de5546048c75227000cd1d9a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:57.857568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f35d7-4435-4961-8a94-14102d678d43 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:57.858079 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f35d7-4435-4961-8a94-14102d678d43 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:57.858242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f35d7-4435-4961-8a94-14102d678d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:57.878280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-2b0f35d7-4435-4961-8a94-14102d678d43 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:57.879478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2b0f35d7-4435-4961-8a94-14102d678d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:57.960179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1103/2209] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:57.973609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce7657-7a07-4d0b-aa79-b13734296b71 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:57.973903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce7657-7a07-4d0b-aa79-b13734296b71 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:57.974175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce7657-7a07-4d0b-aa79-b13734296b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:57.994945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-f8ce7657-7a07-4d0b-aa79-b13734296b71 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:57.996160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f8ce7657-7a07-4d0b-aa79-b13734296b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:58.006154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1107/2210] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:58.011570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f35d7-4435-4961-8a94-14102d678d43 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:58.026885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f35d7-4435-4961-8a94-14102d678d43 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:58.034521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be9054-20f8-4a16-957a-95b168155a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:58.035114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be9054-20f8-4a16-957a-95b168155a97 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:58.035384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be9054-20f8-4a16-957a-95b168155a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:58.035655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be9054-20f8-4a16-957a-95b168155a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:58.036294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be9054-20f8-4a16-957a-95b168155a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:58.036592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be9054-20f8-4a16-957a-95b168155a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:58.038221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be9054-20f8-4a16-957a-95b168155a97 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:58.051134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1104/2211] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:58.055598 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce7657-7a07-4d0b-aa79-b13734296b71 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:58.065584 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce7657-7a07-4d0b-aa79-b13734296b71 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:58.071670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ac033-28df-4e3a-bf4f-a8e1fd83a180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:58.072272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ac033-28df-4e3a-bf4f-a8e1fd83a180 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:58.072551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ac033-28df-4e3a-bf4f-a8e1fd83a180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:58.072813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ac033-28df-4e3a-bf4f-a8e1fd83a180 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:58.073492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ac033-28df-4e3a-bf4f-a8e1fd83a180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:58.075388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ac033-28df-4e3a-bf4f-a8e1fd83a180 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:58.107321 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1108/2212] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:17:58 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:58.111897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be9054-20f8-4a16-957a-95b168155a97 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:58.122658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be9054-20f8-4a16-957a-95b168155a97 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:58.182593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1848a87-26ea-40c0-887c-6e5753eebfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:58.183195 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1848a87-26ea-40c0-887c-6e5753eebfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:58.183467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1848a87-26ea-40c0-887c-6e5753eebfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:58.183735 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1848a87-26ea-40c0-887c-6e5753eebfd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:58.184360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1848a87-26ea-40c0-887c-6e5753eebfd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:58.186315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1848a87-26ea-40c0-887c-6e5753eebfd8 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:58.210833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1105/2213] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:17:58 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:58.216507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ac033-28df-4e3a-bf4f-a8e1fd83a180 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:58.227653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ac033-28df-4e3a-bf4f-a8e1fd83a180 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:58.233104 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41586d-12ae-44f1-afcd-6302c38daaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:58.233742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41586d-12ae-44f1-afcd-6302c38daaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:58.234014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41586d-12ae-44f1-afcd-6302c38daaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:58.234278 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41586d-12ae-44f1-afcd-6302c38daaf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:58.235059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41586d-12ae-44f1-afcd-6302c38daaf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:58.236879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41586d-12ae-44f1-afcd-6302c38daaf6 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:58.252149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1109/2214] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:58.259593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1848a87-26ea-40c0-887c-6e5753eebfd8 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:58.275047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1848a87-26ea-40c0-887c-6e5753eebfd8 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:58.283673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc03f38-5405-4b2f-bc4d-b212dc26ff3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:58.284359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc03f38-5405-4b2f-bc4d-b212dc26ff3d admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:58.284656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc03f38-5405-4b2f-bc4d-b212dc26ff3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:58.284919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc03f38-5405-4b2f-bc4d-b212dc26ff3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:58.285600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc03f38-5405-4b2f-bc4d-b212dc26ff3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:58.287200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc03f38-5405-4b2f-bc4d-b212dc26ff3d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:58.301633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1106/2215] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:58.302866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41586d-12ae-44f1-afcd-6302c38daaf6 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:58.313659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41586d-12ae-44f1-afcd-6302c38daaf6 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:58.319514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7c1c-833e-40db-98d4-420e4ad0f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:58.320195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7c1c-833e-40db-98d4-420e4ad0f5de admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:58.320473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7c1c-833e-40db-98d4-420e4ad0f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:58.320742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7c1c-833e-40db-98d4-420e4ad0f5de admin admin] PATH_INFO: `/v3/projects/b737f745ad6c456e9530a1a57f2f02c3/users/4f28bea40ae94d5dbc690822b604bd8f/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:58.336800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e7c1c-833e-40db-98d4-420e4ad0f5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b737f745ad6c456e9530a1a57f2f02c3, user_id=4f28bea40ae94d5dbc690822b604bd8f, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:58.339952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e7c1c-833e-40db-98d4-420e4ad0f5de admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:58.367138 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1110/2216] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:17:58 2022] PUT /identity/v3/projects/b737f745ad6c456e9530a1a57f2f02c3/users/4f28bea40ae94d5dbc690822b604bd8f/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:58.368929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f04379-d875-4f98-b5a9-2156e0dac83a None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:58.369237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f04379-d875-4f98-b5a9-2156e0dac83a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:58.369485 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f04379-d875-4f98-b5a9-2156e0dac83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:58.401255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d8f04379-d875-4f98-b5a9-2156e0dac83a None None] MFA Rules not processed for user `4f28bea40ae94d5dbc690822b604bd8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:58.402526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d8f04379-d875-4f98-b5a9-2156e0dac83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:58.406805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:58.480010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1107/2217] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:17:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:58.491290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7c1c-833e-40db-98d4-420e4ad0f5de admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:58.493055 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b91e7c1c-833e-40db-98d4-420e4ad0f5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:58.552982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7c1c-833e-40db-98d4-420e4ad0f5de admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:58.556560 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ece553-1149-41cc-ad40-46879fdafb49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:58.557172 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ece553-1149-41cc-ad40-46879fdafb49 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:58.557504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ece553-1149-41cc-ad40-46879fdafb49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:58.557775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ece553-1149-41cc-ad40-46879fdafb49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:58.566080 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ece553-1149-41cc-ad40-46879fdafb49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:58.567507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ece553-1149-41cc-ad40-46879fdafb49 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:58.576352 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1111/2218] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:08.477340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=25 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:08.572328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:08.927236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f04379-d875-4f98-b5a9-2156e0dac83a None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:08.997310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f04379-d875-4f98-b5a9-2156e0dac83a None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:09.001989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:09.002627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:09.002915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:09.003208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] PATH_INFO: `/v3/users/4f28bea40ae94d5dbc690822b604bd8f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:09.004334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f28bea40ae94d5dbc690822b604bd8f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:09.006299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:09.059283 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f28bea40ae94d5dbc690822b604bd8f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:09.072353 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f28bea40ae94d5dbc690822b604bd8f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:09.072616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f28bea40ae94d5dbc690822b604bd8f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:09.073511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f28bea40ae94d5dbc690822b604bd8f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:09.082898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f28bea40ae94d5dbc690822b604bd8f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:09.096007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1108/2219] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:18:08 2022] DELETE /identity/v3/users/4f28bea40ae94d5dbc690822b604bd8f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:09.100724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030aa73c-9c60-45aa-91c6-cbe656daceb5 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:09.101010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030aa73c-9c60-45aa-91c6-cbe656daceb5 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:09.101334 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030aa73c-9c60-45aa-91c6-cbe656daceb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:09.121271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-030aa73c-9c60-45aa-91c6-cbe656daceb5 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:09.122505 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-030aa73c-9c60-45aa-91c6-cbe656daceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:09.183242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1112/2220] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:09.193923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:09.195418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:09.255324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc50859-4711-42fe-bec2-eb921b772eb1 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:09.259190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a624e8-8389-4129-b225-b7772bafc612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:09.259808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a624e8-8389-4129-b225-b7772bafc612 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:09.260096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a624e8-8389-4129-b225-b7772bafc612 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:09.260344 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a624e8-8389-4129-b225-b7772bafc612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:09.269769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a624e8-8389-4129-b225-b7772bafc612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:09.271580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a624e8-8389-4129-b225-b7772bafc612 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:09.281377 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1109/2221] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:09.595032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030aa73c-9c60-45aa-91c6-cbe656daceb5 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:09.596534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-030aa73c-9c60-45aa-91c6-cbe656daceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:09.611540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030aa73c-9c60-45aa-91c6-cbe656daceb5 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:09.622012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673508d-cd1c-4e23-8769-c1ea3240ac86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:09.622667 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673508d-cd1c-4e23-8769-c1ea3240ac86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:09.622949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673508d-cd1c-4e23-8769-c1ea3240ac86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:09.623205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673508d-cd1c-4e23-8769-c1ea3240ac86 admin admin] PATH_INFO: `/v3/projects/b737f745ad6c456e9530a1a57f2f02c3` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:09.624445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673508d-cd1c-4e23-8769-c1ea3240ac86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b737f745ad6c456e9530a1a57f2f02c3)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:09.626414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673508d-cd1c-4e23-8769-c1ea3240ac86 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:09.676300 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e673508d-cd1c-4e23-8769-c1ea3240ac86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b737f745ad6c456e9530a1a57f2f02c3', 'request_id': 'req-e673508d-cd1c-4e23-8769-c1ea3240ac86'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:09.684839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e673508d-cd1c-4e23-8769-c1ea3240ac86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b737f745ad6c456e9530a1a57f2f02c3', 'request_id': 'req-e673508d-cd1c-4e23-8769-c1ea3240ac86'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:09.691467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e673508d-cd1c-4e23-8769-c1ea3240ac86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b737f745ad6c456e9530a1a57f2f02c3', 'request_id': 'req-e673508d-cd1c-4e23-8769-c1ea3240ac86'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:09.703229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e673508d-cd1c-4e23-8769-c1ea3240ac86 admin admin] The token cache is being invalidate because project b737f745ad6c456e9530a1a57f2f02c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:18:09.703522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e673508d-cd1c-4e23-8769-c1ea3240ac86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:09.704239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e673508d-cd1c-4e23-8769-c1ea3240ac86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:09.705901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1113/2222] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:18:09 2022] DELETE /identity/v3/projects/b737f745ad6c456e9530a1a57f2f02c3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:09.711227 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a95ef-7959-4d2a-9ccb-3d7e6354557c None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:09.711877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a95ef-7959-4d2a-9ccb-3d7e6354557c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:09.711877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a95ef-7959-4d2a-9ccb-3d7e6354557c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:09.735069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-f75a95ef-7959-4d2a-9ccb-3d7e6354557c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:09.736477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f75a95ef-7959-4d2a-9ccb-3d7e6354557c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:09.757096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:09.803996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1110/2223] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:09.812382 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e9bcb-1d89-4308-85b8-888f4d8407db None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:09.812712 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e9bcb-1d89-4308-85b8-888f4d8407db None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:09.813046 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e9bcb-1d89-4308-85b8-888f4d8407db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:09.834954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c22e9bcb-1d89-4308-85b8-888f4d8407db None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:09.836225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c22e9bcb-1d89-4308-85b8-888f4d8407db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:09.844833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1114/2224] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:09.849166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a95ef-7959-4d2a-9ccb-3d7e6354557c None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:09.859225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a95ef-7959-4d2a-9ccb-3d7e6354557c None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:09.870400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c3d3a-ec6b-4996-bf7b-b18a31db3336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:09.871017 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c3d3a-ec6b-4996-bf7b-b18a31db3336 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:09.871283 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c3d3a-ec6b-4996-bf7b-b18a31db3336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:09.871545 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c3d3a-ec6b-4996-bf7b-b18a31db3336 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:09.872353 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c3d3a-ec6b-4996-bf7b-b18a31db3336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:18:09.872656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c3d3a-ec6b-4996-bf7b-b18a31db3336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:09.874273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c3d3a-ec6b-4996-bf7b-b18a31db3336 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:09.886547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1111/2225] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:18:09.891018 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e9bcb-1d89-4308-85b8-888f4d8407db None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:09.900788 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e9bcb-1d89-4308-85b8-888f4d8407db None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:09.905549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e540ab-dee4-4e80-8e03-2e0c1369cbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:09.906130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e540ab-dee4-4e80-8e03-2e0c1369cbaa admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:09.906401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e540ab-dee4-4e80-8e03-2e0c1369cbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:09.906662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e540ab-dee4-4e80-8e03-2e0c1369cbaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:09.907323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e540ab-dee4-4e80-8e03-2e0c1369cbaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:09.909227 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e540ab-dee4-4e80-8e03-2e0c1369cbaa admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:09.937567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1115/2226] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:09 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:18:09.941821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c3d3a-ec6b-4996-bf7b-b18a31db3336 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:09.952584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c3d3a-ec6b-4996-bf7b-b18a31db3336 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:10.022159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b2db-4b7d-4014-9743-5e7e0a0db0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:10.022801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b2db-4b7d-4014-9743-5e7e0a0db0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:10.023075 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b2db-4b7d-4014-9743-5e7e0a0db0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:10.023332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b2db-4b7d-4014-9743-5e7e0a0db0d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:10.024034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b2db-4b7d-4014-9743-5e7e0a0db0d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:10.025989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b2db-4b7d-4014-9743-5e7e0a0db0d5 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:10.049661 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1112/2227] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:09 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:10.053887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e540ab-dee4-4e80-8e03-2e0c1369cbaa admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:10.064543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e540ab-dee4-4e80-8e03-2e0c1369cbaa admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:10.069746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7cc20-dfb2-4282-8fa7-15ed35be3188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:10.070380 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7cc20-dfb2-4282-8fa7-15ed35be3188 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:10.070667 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7cc20-dfb2-4282-8fa7-15ed35be3188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:10.070938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7cc20-dfb2-4282-8fa7-15ed35be3188 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:10.071578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7cc20-dfb2-4282-8fa7-15ed35be3188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:10.073238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7cc20-dfb2-4282-8fa7-15ed35be3188 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:10.083611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1116/2228] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:10.088167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b2db-4b7d-4014-9743-5e7e0a0db0d5 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:10.098759 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b2db-4b7d-4014-9743-5e7e0a0db0d5 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:10.104173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab5427-9f6c-46ca-ba33-1b457b6e832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:10.104774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab5427-9f6c-46ca-ba33-1b457b6e832a admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:10.105043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab5427-9f6c-46ca-ba33-1b457b6e832a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:10.105341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab5427-9f6c-46ca-ba33-1b457b6e832a admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:10.106011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab5427-9f6c-46ca-ba33-1b457b6e832a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:10.107576 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab5427-9f6c-46ca-ba33-1b457b6e832a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:10.118788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1113/2229] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:10.123190 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7cc20-dfb2-4282-8fa7-15ed35be3188 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:10.133958 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7cc20-dfb2-4282-8fa7-15ed35be3188 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:10.138622 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36734cd-698b-4d70-81fc-46d91a5ee9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:10.139294 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36734cd-698b-4d70-81fc-46d91a5ee9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:10.139570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36734cd-698b-4d70-81fc-46d91a5ee9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:10.139966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36734cd-698b-4d70-81fc-46d91a5ee9b2 admin admin] PATH_INFO: `/v3/projects/eec3a36c22d6467eba29edfcfca481c5/users/7594d9276d1d4dac9120501de26c836f/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:10.155590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36734cd-698b-4d70-81fc-46d91a5ee9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec3a36c22d6467eba29edfcfca481c5, user_id=7594d9276d1d4dac9120501de26c836f, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:10.158283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36734cd-698b-4d70-81fc-46d91a5ee9b2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:10.173398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1117/2230] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:10 2022] PUT /identity/v3/projects/eec3a36c22d6467eba29edfcfca481c5/users/7594d9276d1d4dac9120501de26c836f/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:10.181981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565f1ce-fb55-4f4b-becf-0b5306c0cff8 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:10.182263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565f1ce-fb55-4f4b-becf-0b5306c0cff8 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:10.182533 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565f1ce-fb55-4f4b-becf-0b5306c0cff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:10.201516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-c565f1ce-fb55-4f4b-becf-0b5306c0cff8 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:10.202712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c565f1ce-fb55-4f4b-becf-0b5306c0cff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:10.265356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1114/2231] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:10.276350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36734cd-698b-4d70-81fc-46d91a5ee9b2 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:10.279319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c36734cd-698b-4d70-81fc-46d91a5ee9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:10.306540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:10.344897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36734cd-698b-4d70-81fc-46d91a5ee9b2 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:10.348946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2057f-c5ca-4374-b72c-cc3dcc0e1e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:10.349619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2057f-c5ca-4374-b72c-cc3dcc0e1e88 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:10.349781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2057f-c5ca-4374-b72c-cc3dcc0e1e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:10.350041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2057f-c5ca-4374-b72c-cc3dcc0e1e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:10.360356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2057f-c5ca-4374-b72c-cc3dcc0e1e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:10.361845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2057f-c5ca-4374-b72c-cc3dcc0e1e88 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:10.371726 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1118/2232] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:13.651517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565f1ce-fb55-4f4b-becf-0b5306c0cff8 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:13.668274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565f1ce-fb55-4f4b-becf-0b5306c0cff8 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:13.679069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18445908-340f-4c23-8693-d049a29ac8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:13.680480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18445908-340f-4c23-8693-d049a29ac8ea service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:13.681116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18445908-340f-4c23-8693-d049a29ac8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:13.681645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18445908-340f-4c23-8693-d049a29ac8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:13.684924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-18445908-340f-4c23-8693-d049a29ac8ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:13.750411 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:13.806426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18445908-340f-4c23-8693-d049a29ac8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:13.808026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18445908-340f-4c23-8693-d049a29ac8ea service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:13.819375 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1115/2233] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:14.873422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159457b8-bd87-4f4c-9b4b-c7a73b6ecade None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:14.873878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159457b8-bd87-4f4c-9b4b-c7a73b6ecade None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:14.873956 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159457b8-bd87-4f4c-9b4b-c7a73b6ecade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:14.912485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-159457b8-bd87-4f4c-9b4b-c7a73b6ecade None None] MFA Rules not processed for user `72a1893206b6442cbe0e3ca23101871a`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:14.913756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-159457b8-bd87-4f4c-9b4b-c7a73b6ecade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:15.049409 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1119/2234] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:18:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:15.668092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d869013-d91b-425e-bbde-d285714d70d5 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:15.669320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d869013-d91b-425e-bbde-d285714d70d5 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:15.669831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d869013-d91b-425e-bbde-d285714d70d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:15.702253 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-8d869013-d91b-425e-bbde-d285714d70d5 None None] MFA Rules not processed for user `7594d9276d1d4dac9120501de26c836f`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:15.703491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8d869013-d91b-425e-bbde-d285714d70d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:15.802872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159457b8-bd87-4f4c-9b4b-c7a73b6ecade None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:15.805881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1116/2235] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:18:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:15.815615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159457b8-bd87-4f4c-9b4b-c7a73b6ecade None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:15.823457 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d689d-d6ff-46a4-8019-ff7042ff33fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:15.824109 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d689d-d6ff-46a4-8019-ff7042ff33fd admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:15.824357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d689d-d6ff-46a4-8019-ff7042ff33fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:15.825316 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d689d-d6ff-46a4-8019-ff7042ff33fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:15.825316 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d689d-d6ff-46a4-8019-ff7042ff33fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:15.827456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d689d-d6ff-46a4-8019-ff7042ff33fd admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:15.868577 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1120/2236] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:15 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:15.872634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d869013-d91b-425e-bbde-d285714d70d5 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:15.884674 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d869013-d91b-425e-bbde-d285714d70d5 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:15.950989 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21f086-06a2-4785-8406-2552ae974796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:15.951705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21f086-06a2-4785-8406-2552ae974796 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:15.952041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21f086-06a2-4785-8406-2552ae974796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:15.952368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21f086-06a2-4785-8406-2552ae974796 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:15.953083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21f086-06a2-4785-8406-2552ae974796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:15.955302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21f086-06a2-4785-8406-2552ae974796 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:15.987964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1117/2237] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:15 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:18:15.991932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d689d-d6ff-46a4-8019-ff7042ff33fd admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:16.004650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d689d-d6ff-46a4-8019-ff7042ff33fd admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:16.011527 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551d912-40ab-4e35-8dbe-d6604b5b1893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:16.012160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551d912-40ab-4e35-8dbe-d6604b5b1893 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:16.012418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551d912-40ab-4e35-8dbe-d6604b5b1893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:16.012897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551d912-40ab-4e35-8dbe-d6604b5b1893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:16.013808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551d912-40ab-4e35-8dbe-d6604b5b1893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:16.015745 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551d912-40ab-4e35-8dbe-d6604b5b1893 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:16.030307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1121/2238] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:18:16.035179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21f086-06a2-4785-8406-2552ae974796 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:16.050969 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21f086-06a2-4785-8406-2552ae974796 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:16.056664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d361a4-ee83-4b9a-be00-acf002e5de5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:16.057383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d361a4-ee83-4b9a-be00-acf002e5de5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:16.057657 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d361a4-ee83-4b9a-be00-acf002e5de5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:16.057932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d361a4-ee83-4b9a-be00-acf002e5de5c admin admin] PATH_INFO: `/v3/projects/6d2c83737b904941a17ccf6dc3102739/users/ca57b7e3999842769ab26957df1d716e/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:16.076736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d361a4-ee83-4b9a-be00-acf002e5de5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d2c83737b904941a17ccf6dc3102739, user_id=ca57b7e3999842769ab26957df1d716e, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:16.080905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d361a4-ee83-4b9a-be00-acf002e5de5c admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:16.121523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1118/2239] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:16 2022] PUT /identity/v3/projects/6d2c83737b904941a17ccf6dc3102739/users/ca57b7e3999842769ab26957df1d716e/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:16.123193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551d912-40ab-4e35-8dbe-d6604b5b1893 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:16.135558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551d912-40ab-4e35-8dbe-d6604b5b1893 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:16.271335 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df87b88-12db-4332-bed8-ba3a8beeec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:16.272095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87b88-12db-4332-bed8-ba3a8beeec21 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:16.272475 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87b88-12db-4332-bed8-ba3a8beeec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:16.272846 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87b88-12db-4332-bed8-ba3a8beeec21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:16.273696 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df87b88-12db-4332-bed8-ba3a8beeec21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:16.276781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df87b88-12db-4332-bed8-ba3a8beeec21 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:16.297395 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1122/2240] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:16.301465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d361a4-ee83-4b9a-be00-acf002e5de5c admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:16.325449 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d361a4-ee83-4b9a-be00-acf002e5de5c admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:16.339020 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622986c-2b46-4dfb-8ce7-8680ec012c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:16.339716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622986c-2b46-4dfb-8ce7-8680ec012c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:16.339990 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622986c-2b46-4dfb-8ce7-8680ec012c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:16.340258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622986c-2b46-4dfb-8ce7-8680ec012c45 admin admin] PATH_INFO: `/v3/projects/6d2c83737b904941a17ccf6dc3102739/users/ca57b7e3999842769ab26957df1d716e/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:16.342338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622986c-2b46-4dfb-8ce7-8680ec012c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d2c83737b904941a17ccf6dc3102739, user_id=ca57b7e3999842769ab26957df1d716e, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:16.344950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622986c-2b46-4dfb-8ce7-8680ec012c45 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:16.369780 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1119/2241] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:16 2022] PUT /identity/v3/projects/6d2c83737b904941a17ccf6dc3102739/users/ca57b7e3999842769ab26957df1d716e/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:21.992034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fbcbc-2ab9-4d3a-aea1-1070ae629d1f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:21.992748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fbcbc-2ab9-4d3a-aea1-1070ae629d1f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:21.992748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fbcbc-2ab9-4d3a-aea1-1070ae629d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:22.029110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-866fbcbc-2ab9-4d3a-aea1-1070ae629d1f None None] MFA Rules not processed for user `ca57b7e3999842769ab26957df1d716e`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:22.031469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-866fbcbc-2ab9-4d3a-aea1-1070ae629d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:22.056258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:22.121765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1123/2242] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:18:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:18:22.134426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622986c-2b46-4dfb-8ce7-8680ec012c45 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:22.136466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-5622986c-2b46-4dfb-8ce7-8680ec012c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:22.143320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:22.208696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622986c-2b46-4dfb-8ce7-8680ec012c45 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:22.212985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b466a1f-40c3-4f4f-a101-d75e7c2d8aac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd967a3fa32ef48b68c9e3a174f0c9a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:22.213722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b466a1f-40c3-4f4f-a101-d75e7c2d8aac service glance] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:22.214000 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b466a1f-40c3-4f4f-a101-d75e7c2d8aac service glance] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:22.214266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b466a1f-40c3-4f4f-a101-d75e7c2d8aac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:22.275338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b466a1f-40c3-4f4f-a101-d75e7c2d8aac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:22.277013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b466a1f-40c3-4f4f-a101-d75e7c2d8aac service glance] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:22.286149 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1120/2243] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:22.417102 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e456583-cc97-425b-9043-bd964191094c None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:22.417472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e456583-cc97-425b-9043-bd964191094c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:22.417759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e456583-cc97-425b-9043-bd964191094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:22.438049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-3e456583-cc97-425b-9043-bd964191094c None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:22.439262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-3e456583-cc97-425b-9043-bd964191094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:22.496580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1124/2244] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:18:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:22.543287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b466a1f-40c3-4f4f-a101-d75e7c2d8aac service glance] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:22.544751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7b466a1f-40c3-4f4f-a101-d75e7c2d8aac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:22.620022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b466a1f-40c3-4f4f-a101-d75e7c2d8aac service glance] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:22.632429 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ead6eb-95ef-4399-ad3f-20c7dab42663 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:22.633103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ead6eb-95ef-4399-ad3f-20c7dab42663 service swift] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:22.633413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ead6eb-95ef-4399-ad3f-20c7dab42663 service swift] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:22.633685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ead6eb-95ef-4399-ad3f-20c7dab42663 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:22.644948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ead6eb-95ef-4399-ad3f-20c7dab42663 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:22.646964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ead6eb-95ef-4399-ad3f-20c7dab42663 service swift] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:22.657510 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1121/2245] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:18:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:18:32.489193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=45 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:32.582047 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e731cfa-8bab-4fae-ba45-83683580bd9b None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:32.582418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e731cfa-8bab-4fae-ba45-83683580bd9b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:32.582760 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e731cfa-8bab-4fae-ba45-83683580bd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:32.606584 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-6e731cfa-8bab-4fae-ba45-83683580bd9b None None] MFA Rules not processed for user `7594d9276d1d4dac9120501de26c836f`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:32.608329 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-6e731cfa-8bab-4fae-ba45-83683580bd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:32.616779 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1125/2246] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:18:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:32.652350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=78 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:36.239441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdf348-a240-474d-a78a-a7a7c18c2e26 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:36.239441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdf348-a240-474d-a78a-a7a7c18c2e26 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:36.239441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdf348-a240-474d-a78a-a7a7c18c2e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:36.258639 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-06fdf348-a240-474d-a78a-a7a7c18c2e26 None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:36.259883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-06fdf348-a240-474d-a78a-a7a7c18c2e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:36.273383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1122/2247] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:18:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:36.285976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e731cfa-8bab-4fae-ba45-83683580bd9b None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:36.298252 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e731cfa-8bab-4fae-ba45-83683580bd9b None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:36.303947 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cf79f-ff8e-4ee4-b195-3a78b853738d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:36.304782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cf79f-ff8e-4ee4-b195-3a78b853738d service swift] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:36.305055 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cf79f-ff8e-4ee4-b195-3a78b853738d service swift] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:36.305374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cf79f-ff8e-4ee4-b195-3a78b853738d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:36.314716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cf79f-ff8e-4ee4-b195-3a78b853738d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:36.316415 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cf79f-ff8e-4ee4-b195-3a78b853738d service swift] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:36.326905 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1126/2248] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:18:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:18:46.252721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:46.322241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=9 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:54.491603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c56b2-3e54-450a-8e22-e746f0a5de76 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:54.492198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c56b2-3e54-450a-8e22-e746f0a5de76 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:54.492198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c56b2-3e54-450a-8e22-e746f0a5de76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:54.519508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-043c56b2-3e54-450a-8e22-e746f0a5de76 None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:54.521015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-043c56b2-3e54-450a-8e22-e746f0a5de76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:54.529907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1123/2249] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:18:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:54.542779 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cf79f-ff8e-4ee4-b195-3a78b853738d service swift] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:54.556539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cf79f-ff8e-4ee4-b195-3a78b853738d service swift] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:54.562179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c80f8-746a-483f-888e-70b4a1ca1c09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:54.562858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c80f8-746a-483f-888e-70b4a1ca1c09 service swift] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:54.563115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c80f8-746a-483f-888e-70b4a1ca1c09 service swift] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:54.563381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c80f8-746a-483f-888e-70b4a1ca1c09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:54.572590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c80f8-746a-483f-888e-70b4a1ca1c09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:54.574494 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c80f8-746a-483f-888e-70b4a1ca1c09 service swift] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:54.583126 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1127/2250] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:18:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:19:00.632002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58513832-0cd4-4cda-ba3c-9ebdefdce39f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:00.632632 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58513832-0cd4-4cda-ba3c-9ebdefdce39f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:00.632632 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58513832-0cd4-4cda-ba3c-9ebdefdce39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:00.652918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-58513832-0cd4-4cda-ba3c-9ebdefdce39f None None] MFA Rules not processed for user `a899638fd4f44d738d98fed19c35babc`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:00.656407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-58513832-0cd4-4cda-ba3c-9ebdefdce39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:00.771315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1124/2251] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:19:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:03.132803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c80f8-746a-483f-888e-70b4a1ca1c09 service swift] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:03.134228 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0b6c80f8-746a-483f-888e-70b4a1ca1c09 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:03.289953 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c80f8-746a-483f-888e-70b4a1ca1c09 service swift] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:03.304483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec79d4-fb07-48c6-8db8-69cc17b5be0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227f958b82a446e19a4d5b29d74193bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:03.305616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec79d4-fb07-48c6-8db8-69cc17b5be0c service placement] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:03.306436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec79d4-fb07-48c6-8db8-69cc17b5be0c service placement] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:03.307239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec79d4-fb07-48c6-8db8-69cc17b5be0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:03.309662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2aec79d4-fb07-48c6-8db8-69cc17b5be0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:03.315641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58513832-0cd4-4cda-ba3c-9ebdefdce39f None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:03.317612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-58513832-0cd4-4cda-ba3c-9ebdefdce39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:03.342643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58513832-0cd4-4cda-ba3c-9ebdefdce39f None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:03.344738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec79d4-fb07-48c6-8db8-69cc17b5be0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:03.347424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec79d4-fb07-48c6-8db8-69cc17b5be0c service placement] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:03.347774 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2f1f4-5154-47b0-9ad5-dd816ea5dd0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227f958b82a446e19a4d5b29d74193bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:03.348293 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2f1f4-5154-47b0-9ad5-dd816ea5dd0c service placement] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:03.348570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2f1f4-5154-47b0-9ad5-dd816ea5dd0c service placement] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:03.348843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2f1f4-5154-47b0-9ad5-dd816ea5dd0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:03.361287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2f1f4-5154-47b0-9ad5-dd816ea5dd0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:03.363485 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2f1f4-5154-47b0-9ad5-dd816ea5dd0c service placement] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:03.369800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1128/2252] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:03.376242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1125/2253] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:19:10.068749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d35619-543b-4201-a7b5-c1edb694f85f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:10.069420 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d35619-543b-4201-a7b5-c1edb694f85f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:10.069420 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d35619-543b-4201-a7b5-c1edb694f85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:10.108652 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-a7d35619-543b-4201-a7b5-c1edb694f85f None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:10.110269 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a7d35619-543b-4201-a7b5-c1edb694f85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:10.125359 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1129/2254] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:19:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:10.135487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2f1f4-5154-47b0-9ad5-dd816ea5dd0c service placement] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:10.155271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2f1f4-5154-47b0-9ad5-dd816ea5dd0c service placement] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:10.168911 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892dc04-6553-4fc8-bdbf-a4b432a5c888 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:10.169557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892dc04-6553-4fc8-bdbf-a4b432a5c888 service swift] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:10.170660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892dc04-6553-4fc8-bdbf-a4b432a5c888 service swift] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:10.173170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892dc04-6553-4fc8-bdbf-a4b432a5c888 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:10.188498 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892dc04-6553-4fc8-bdbf-a4b432a5c888 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:10.190203 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892dc04-6553-4fc8-bdbf-a4b432a5c888 service swift] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:10.201976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1126/2255] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:19:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:19:15.121393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ef128-a057-4035-93b9-7e4c73e534df None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:15.122331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ef128-a057-4035-93b9-7e4c73e534df None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:15.122759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ef128-a057-4035-93b9-7e4c73e534df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:15.161185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d50ef128-a057-4035-93b9-7e4c73e534df None None] MFA Rules not processed for user `c4ea453d044840f5aa1d5d89ba5a942d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:15.163304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d50ef128-a057-4035-93b9-7e4c73e534df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:15.313893 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1130/2256] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:19:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:15.793307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8854-ad2c-4c74-b251-cc483a7ae134 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:15.794216 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8854-ad2c-4c74-b251-cc483a7ae134 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:15.794641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8854-ad2c-4c74-b251-cc483a7ae134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:15.819749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-34ea8854-ad2c-4c74-b251-cc483a7ae134 None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:15.821669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-34ea8854-ad2c-4c74-b251-cc483a7ae134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:15.837705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1127/2257] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 31 00:19:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:15.845888 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ef128-a057-4035-93b9-7e4c73e534df None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:15.864450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ef128-a057-4035-93b9-7e4c73e534df None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:15.874838 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7034e-eede-4188-a94d-d7763f7d82da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:15.887366 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7034e-eede-4188-a94d-d7763f7d82da service swift] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:15.893363 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7034e-eede-4188-a94d-d7763f7d82da service swift] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:15.893991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7034e-eede-4188-a94d-d7763f7d82da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:15.911990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7034e-eede-4188-a94d-d7763f7d82da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:15.914061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7034e-eede-4188-a94d-d7763f7d82da service swift] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:15.927404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1131/2258] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:19:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:19:18.715089 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8854-ad2c-4c74-b251-cc483a7ae134 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:18.717926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-34ea8854-ad2c-4c74-b251-cc483a7ae134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:18.724016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=44 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:18.814924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8854-ad2c-4c74-b251-cc483a7ae134 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:18.820528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c39556-4a6c-4360-882c-1022fa6a8b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:18.821389 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c39556-4a6c-4360-882c-1022fa6a8b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:18.822189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c39556-4a6c-4360-882c-1022fa6a8b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:18.822838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c39556-4a6c-4360-882c-1022fa6a8b2e admin admin] PATH_INFO: `/v3/users/72a1893206b6442cbe0e3ca23101871a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:18.824585 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c39556-4a6c-4360-882c-1022fa6a8b2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a1893206b6442cbe0e3ca23101871a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:18.826992 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c39556-4a6c-4360-882c-1022fa6a8b2e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:18.905683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-96c39556-4a6c-4360-882c-1022fa6a8b2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a1893206b6442cbe0e3ca23101871a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:18.921733 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-96c39556-4a6c-4360-882c-1022fa6a8b2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a1893206b6442cbe0e3ca23101871a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:18.922459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-96c39556-4a6c-4360-882c-1022fa6a8b2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a1893206b6442cbe0e3ca23101871a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:18.923065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-96c39556-4a6c-4360-882c-1022fa6a8b2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a1893206b6442cbe0e3ca23101871a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:18.932250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-96c39556-4a6c-4360-882c-1022fa6a8b2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a1893206b6442cbe0e3ca23101871a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:18.947837 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1128/2259] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:18 2022] DELETE /identity/v3/users/72a1893206b6442cbe0e3ca23101871a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:19.237947 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7034e-eede-4188-a94d-d7763f7d82da service swift] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.243509 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=73 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:19.255670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7034e-eede-4188-a94d-d7763f7d82da service swift] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.327058 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527cf8d-37cf-4178-8fa4-9a56e83e3375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.327699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527cf8d-37cf-4178-8fa4-9a56e83e3375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.327981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527cf8d-37cf-4178-8fa4-9a56e83e3375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.328254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527cf8d-37cf-4178-8fa4-9a56e83e3375 admin admin] PATH_INFO: `/v3/projects/491f4440a14748d78054e3229ed55c2b` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.329457 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527cf8d-37cf-4178-8fa4-9a56e83e3375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=491f4440a14748d78054e3229ed55c2b)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.331373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527cf8d-37cf-4178-8fa4-9a56e83e3375 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.389037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8527cf8d-37cf-4178-8fa4-9a56e83e3375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491f4440a14748d78054e3229ed55c2b', 'request_id': 'req-8527cf8d-37cf-4178-8fa4-9a56e83e3375'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:19.398783 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8527cf8d-37cf-4178-8fa4-9a56e83e3375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491f4440a14748d78054e3229ed55c2b', 'request_id': 'req-8527cf8d-37cf-4178-8fa4-9a56e83e3375'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:19.405518 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8527cf8d-37cf-4178-8fa4-9a56e83e3375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491f4440a14748d78054e3229ed55c2b', 'request_id': 'req-8527cf8d-37cf-4178-8fa4-9a56e83e3375'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:19.416376 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8527cf8d-37cf-4178-8fa4-9a56e83e3375 admin admin] The token cache is being invalidate because project 491f4440a14748d78054e3229ed55c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:19.416659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8527cf8d-37cf-4178-8fa4-9a56e83e3375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:19.417389 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8527cf8d-37cf-4178-8fa4-9a56e83e3375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:19.418841 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1132/2260] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:19 2022] DELETE /identity/v3/projects/491f4440a14748d78054e3229ed55c2b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:19.425433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a404165-ac43-488b-a779-97b2e3f6c39e None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.425756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a404165-ac43-488b-a779-97b2e3f6c39e None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.426028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a404165-ac43-488b-a779-97b2e3f6c39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.448070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-1a404165-ac43-488b-a779-97b2e3f6c39e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:19.449540 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1a404165-ac43-488b-a779-97b2e3f6c39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:19.520654 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1129/2261] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:19.530867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eeb4e8-7465-47f9-9385-3f9f07869fe4 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.531148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eeb4e8-7465-47f9-9385-3f9f07869fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.531419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eeb4e8-7465-47f9-9385-3f9f07869fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.567902 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-73eeb4e8-7465-47f9-9385-3f9f07869fe4 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:19.569511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-73eeb4e8-7465-47f9-9385-3f9f07869fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:19.585747 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1133/2262] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:19.587204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a404165-ac43-488b-a779-97b2e3f6c39e None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.598955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a404165-ac43-488b-a779-97b2e3f6c39e None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.604376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f42c69-2e1a-4dfa-813b-f3a7f6e3c7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.605445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f42c69-2e1a-4dfa-813b-f3a7f6e3c7de admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.605905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f42c69-2e1a-4dfa-813b-f3a7f6e3c7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.606201 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f42c69-2e1a-4dfa-813b-f3a7f6e3c7de admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.607070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f42c69-2e1a-4dfa-813b-f3a7f6e3c7de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:19.607467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f42c69-2e1a-4dfa-813b-f3a7f6e3c7de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.609186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f42c69-2e1a-4dfa-813b-f3a7f6e3c7de admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.626978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1130/2263] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:19.628239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eeb4e8-7465-47f9-9385-3f9f07869fe4 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.639539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eeb4e8-7465-47f9-9385-3f9f07869fe4 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.645506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906ad67-599e-4633-8975-87febd0c2122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.646791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906ad67-599e-4633-8975-87febd0c2122 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.646791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906ad67-599e-4633-8975-87febd0c2122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.647148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906ad67-599e-4633-8975-87febd0c2122 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.647911 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906ad67-599e-4633-8975-87febd0c2122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.651159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906ad67-599e-4633-8975-87febd0c2122 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.702768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1134/2264] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:19 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:19.704619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f42c69-2e1a-4dfa-813b-f3a7f6e3c7de admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.720025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f42c69-2e1a-4dfa-813b-f3a7f6e3c7de admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.730368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:19.827356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25367848-38ee-4c7f-8b5b-3afcbd9ac597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.829462 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25367848-38ee-4c7f-8b5b-3afcbd9ac597 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.829462 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25367848-38ee-4c7f-8b5b-3afcbd9ac597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.829462 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25367848-38ee-4c7f-8b5b-3afcbd9ac597 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.830418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25367848-38ee-4c7f-8b5b-3afcbd9ac597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.832676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25367848-38ee-4c7f-8b5b-3afcbd9ac597 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.882019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1131/2265] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:19 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:19.887080 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906ad67-599e-4633-8975-87febd0c2122 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.902995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906ad67-599e-4633-8975-87febd0c2122 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.910594 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd00d9a-3a0a-4781-ab82-5627eaf5d1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.912172 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd00d9a-3a0a-4781-ab82-5627eaf5d1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.912654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd00d9a-3a0a-4781-ab82-5627eaf5d1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.913134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd00d9a-3a0a-4781-ab82-5627eaf5d1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.914006 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd00d9a-3a0a-4781-ab82-5627eaf5d1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.917982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd00d9a-3a0a-4781-ab82-5627eaf5d1c3 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.934406 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1135/2266] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:19.940436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25367848-38ee-4c7f-8b5b-3afcbd9ac597 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.954156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25367848-38ee-4c7f-8b5b-3afcbd9ac597 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.960957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92853ddd-05ec-4562-9662-28e71d354455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.962625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92853ddd-05ec-4562-9662-28e71d354455 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.963012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92853ddd-05ec-4562-9662-28e71d354455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.963545 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92853ddd-05ec-4562-9662-28e71d354455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.964366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92853ddd-05ec-4562-9662-28e71d354455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.967800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92853ddd-05ec-4562-9662-28e71d354455 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:20.004333 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1132/2267] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:20.006471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd00d9a-3a0a-4781-ab82-5627eaf5d1c3 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:20.039017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd00d9a-3a0a-4781-ab82-5627eaf5d1c3 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:20.052618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d665f-cb52-4a43-95b8-639ca763d976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:20.055999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d665f-cb52-4a43-95b8-639ca763d976 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:20.058816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d665f-cb52-4a43-95b8-639ca763d976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:20.059124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d665f-cb52-4a43-95b8-639ca763d976 admin admin] PATH_INFO: `/v3/projects/a203262d00da4903912caff85a4d5cbb/users/0fe5a34d4fd148af82673a3591b3d82c/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:20.110524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d665f-cb52-4a43-95b8-639ca763d976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a203262d00da4903912caff85a4d5cbb, user_id=0fe5a34d4fd148af82673a3591b3d82c, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:20.120901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d665f-cb52-4a43-95b8-639ca763d976 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:20.163291 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1136/2268] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:20 2022] PUT /identity/v3/projects/a203262d00da4903912caff85a4d5cbb/users/0fe5a34d4fd148af82673a3591b3d82c/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:20.165352 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9935d-804e-484e-b160-01b8c8f0cde9 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:20.165699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9935d-804e-484e-b160-01b8c8f0cde9 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:20.166042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9935d-804e-484e-b160-01b8c8f0cde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:20.221485 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-0be9935d-804e-484e-b160-01b8c8f0cde9 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:20.222992 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0be9935d-804e-484e-b160-01b8c8f0cde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:20.310213 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1133/2269] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:20.325964 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d665f-cb52-4a43-95b8-639ca763d976 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:20.328070 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-413d665f-cb52-4a43-95b8-639ca763d976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:20.392956 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:20.430966 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d665f-cb52-4a43-95b8-639ca763d976 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:20.435470 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb698556-6490-431e-a347-b0becf43430a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:20.436358 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb698556-6490-431e-a347-b0becf43430a service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:20.436758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb698556-6490-431e-a347-b0becf43430a service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:20.437040 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb698556-6490-431e-a347-b0becf43430a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:20.449693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb698556-6490-431e-a347-b0becf43430a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:20.451165 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb698556-6490-431e-a347-b0becf43430a service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:20.465770 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1137/2270] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:21.898192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9dfc9-8878-43c5-a074-e322c36df3f4 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:21.899859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9dfc9-8878-43c5-a074-e322c36df3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:21.900856 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9dfc9-8878-43c5-a074-e322c36df3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:21.946950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-e7e9dfc9-8878-43c5-a074-e322c36df3f4 None None] MFA Rules not processed for user `0fe5a34d4fd148af82673a3591b3d82c`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:21.948839 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e7e9dfc9-8878-43c5-a074-e322c36df3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:22.045109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1134/2271] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:19:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:22.051376 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb698556-6490-431e-a347-b0becf43430a service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.053591 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-eb698556-6490-431e-a347-b0becf43430a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:22.171271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb698556-6490-431e-a347-b0becf43430a service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.185327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3176bd-2014-472c-819a-eb79265f0cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.185899 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3176bd-2014-472c-819a-eb79265f0cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.186176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3176bd-2014-472c-819a-eb79265f0cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.186446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3176bd-2014-472c-819a-eb79265f0cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.214166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3176bd-2014-472c-819a-eb79265f0cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:22.216982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3176bd-2014-472c-819a-eb79265f0cd4 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:22.239124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1138/2272] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:23.229429 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9dfc9-8878-43c5-a074-e322c36df3f4 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:23.248540 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9dfc9-8878-43c5-a074-e322c36df3f4 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:23.252664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358d441-3ffb-4080-92a4-0c264ea577f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:23.253554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358d441-3ffb-4080-92a4-0c264ea577f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:23.254025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358d441-3ffb-4080-92a4-0c264ea577f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:23.254537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358d441-3ffb-4080-92a4-0c264ea577f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.256771 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b358d441-3ffb-4080-92a4-0c264ea577f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:23.274346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:23.356913 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358d441-3ffb-4080-92a4-0c264ea577f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:23.358871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358d441-3ffb-4080-92a4-0c264ea577f3 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:23.372405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1135/2273] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:23.935820 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8311e-46a2-4cf8-b9a9-7d1b45d203c4 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:23.937796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8311e-46a2-4cf8-b9a9-7d1b45d203c4 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:23.938469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8311e-46a2-4cf8-b9a9-7d1b45d203c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.992724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-aac8311e-46a2-4cf8-b9a9-7d1b45d203c4 None None] MFA Rules not processed for user `0fe5a34d4fd148af82673a3591b3d82c`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:23.995954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-aac8311e-46a2-4cf8-b9a9-7d1b45d203c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:24.023175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1139/2274] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:19:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:33.365979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=22 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:33.968239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=42 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:36.211162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e176263-6f98-45a0-9c44-d48de4237d67 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.212054 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e176263-6f98-45a0-9c44-d48de4237d67 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.212054 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e176263-6f98-45a0-9c44-d48de4237d67 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.215014 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1136/2275] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:19:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:36.222360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33f22e-0425-44be-bbe7-e8ef5f2a0566 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.222910 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33f22e-0425-44be-bbe7-e8ef5f2a0566 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.223934 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33f22e-0425-44be-bbe7-e8ef5f2a0566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.261161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-ba33f22e-0425-44be-bbe7-e8ef5f2a0566 None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:36.263667 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ba33f22e-0425-44be-bbe7-e8ef5f2a0566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:36.350213 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1140/2276] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:19:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:36.371268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e176263-6f98-45a0-9c44-d48de4237d67 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:36.373404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8e176263-6f98-45a0-9c44-d48de4237d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:36.436705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e176263-6f98-45a0-9c44-d48de4237d67 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:36.440611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4e739-67be-42da-8498-b96e12e0b166 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd967a3fa32ef48b68c9e3a174f0c9a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:36.441225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4e739-67be-42da-8498-b96e12e0b166 service glance] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.441509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4e739-67be-42da-8498-b96e12e0b166 service glance] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.441771 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4e739-67be-42da-8498-b96e12e0b166 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.452035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4e739-67be-42da-8498-b96e12e0b166 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:36.453421 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4e739-67be-42da-8498-b96e12e0b166 service glance] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:36.464087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1137/2277] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:36.543453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a541732-da73-426d-9ca1-23f7d7c3e827 None None] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.543726 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a541732-da73-426d-9ca1-23f7d7c3e827 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.543995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a541732-da73-426d-9ca1-23f7d7c3e827 None None] PATH_INFO: `/` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.545444 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1141/2278] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:36.551469 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbb6a-ad07-40f8-b827-97fcd9cf765a None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.552078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbb6a-ad07-40f8-b827-97fcd9cf765a None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.552477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbb6a-ad07-40f8-b827-97fcd9cf765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.574183 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-22dfbb6a-ad07-40f8-b827-97fcd9cf765a None None] MFA Rules not processed for user `d4f2b852544b450a86fdcb5fa18fd290`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:36.575503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-22dfbb6a-ad07-40f8-b827-97fcd9cf765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:36.582567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1138/2279] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:19:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:36.596447 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a541732-da73-426d-9ca1-23f7d7c3e827 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:36.608327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a541732-da73-426d-9ca1-23f7d7c3e827 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:36.612077 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5cd9f-d7f0-4be4-b599-c26265dbd708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:36.612789 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5cd9f-d7f0-4be4-b599-c26265dbd708 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.613035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5cd9f-d7f0-4be4-b599-c26265dbd708 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.613356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5cd9f-d7f0-4be4-b599-c26265dbd708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.623456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5cd9f-d7f0-4be4-b599-c26265dbd708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:36.627404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5cd9f-d7f0-4be4-b599-c26265dbd708 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:36.637483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1142/2280] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:19:36.738472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc534ce2-f230-4fc5-9514-149c2c574461 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.738750 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc534ce2-f230-4fc5-9514-149c2c574461 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.739016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc534ce2-f230-4fc5-9514-149c2c574461 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.740376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1139/2281] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:36.745977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb233e5-e26a-4bc6-82eb-1929eb852d50 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.746263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb233e5-e26a-4bc6-82eb-1929eb852d50 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.746537 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb233e5-e26a-4bc6-82eb-1929eb852d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.767396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-0bb233e5-e26a-4bc6-82eb-1929eb852d50 None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:36.768609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0bb233e5-e26a-4bc6-82eb-1929eb852d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:36.778887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1143/2282] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:19:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:36.792207 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc534ce2-f230-4fc5-9514-149c2c574461 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:36.805611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc534ce2-f230-4fc5-9514-149c2c574461 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:36.809877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6aaba1-39d3-449f-95f5-699aa8fab81b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:36.810465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aaba1-39d3-449f-95f5-699aa8fab81b service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.810743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aaba1-39d3-449f-95f5-699aa8fab81b service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.811009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aaba1-39d3-449f-95f5-699aa8fab81b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.821567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6aaba1-39d3-449f-95f5-699aa8fab81b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:36.823158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6aaba1-39d3-449f-95f5-699aa8fab81b service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:36.833998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1140/2283] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:43.976022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457da66-bbd3-47ee-b76c-85685fbc5993 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:43.976605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457da66-bbd3-47ee-b76c-85685fbc5993 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:43.976605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457da66-bbd3-47ee-b76c-85685fbc5993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:43.997501 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d457da66-bbd3-47ee-b76c-85685fbc5993 None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:43.998758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d457da66-bbd3-47ee-b76c-85685fbc5993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:44.058724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1144/2284] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:19:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:44.071380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6aaba1-39d3-449f-95f5-699aa8fab81b service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:44.072926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8b6aaba1-39d3-449f-95f5-699aa8fab81b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:44.149473 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6aaba1-39d3-449f-95f5-699aa8fab81b service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:44.155257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6785e74-8d5d-4824-adb4-c8c553c33c42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:44.155860 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6785e74-8d5d-4824-adb4-c8c553c33c42 service swift] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.156125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6785e74-8d5d-4824-adb4-c8c553c33c42 service swift] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.156392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6785e74-8d5d-4824-adb4-c8c553c33c42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.164704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6785e74-8d5d-4824-adb4-c8c553c33c42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:44.166317 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6785e74-8d5d-4824-adb4-c8c553c33c42 service swift] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:44.174580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1141/2285] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:19:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:19:54.051676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=65 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:54.171778 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=67 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:15.327862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e53d6-0a1b-4a20-96da-d859135645ad None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:15.328438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e53d6-0a1b-4a20-96da-d859135645ad None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:15.328438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e53d6-0a1b-4a20-96da-d859135645ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:15.350110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-bd2e53d6-0a1b-4a20-96da-d859135645ad None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:15.351218 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-bd2e53d6-0a1b-4a20-96da-d859135645ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:15.359560 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1145/2286] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 31 00:20:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:15.373191 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6785e74-8d5d-4824-adb4-c8c553c33c42 service swift] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:15.388013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6785e74-8d5d-4824-adb4-c8c553c33c42 service swift] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:15.393419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2cc59-41dd-44ff-8946-083a16d59833 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:15.394022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2cc59-41dd-44ff-8946-083a16d59833 service swift] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:15.395305 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2cc59-41dd-44ff-8946-083a16d59833 service swift] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:15.395796 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2cc59-41dd-44ff-8946-083a16d59833 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:15.405593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2cc59-41dd-44ff-8946-083a16d59833 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:15.407332 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2cc59-41dd-44ff-8946-083a16d59833 service swift] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:15.416138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1142/2287] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:20:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:25.344346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:25.412819 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=6 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:33.433825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274b061-e0fe-4bb3-a748-8f3ada1ddc14 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:33.434474 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274b061-e0fe-4bb3-a748-8f3ada1ddc14 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:33.434474 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274b061-e0fe-4bb3-a748-8f3ada1ddc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:33.456801 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c274b061-e0fe-4bb3-a748-8f3ada1ddc14 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:33.458254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c274b061-e0fe-4bb3-a748-8f3ada1ddc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:33.467702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1146/2288] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 00:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:33.496563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2cc59-41dd-44ff-8946-083a16d59833 service swift] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:33.498311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7fe2cc59-41dd-44ff-8946-083a16d59833 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:33.514086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2cc59-41dd-44ff-8946-083a16d59833 service swift] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:33.520968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de52d9-38d3-4bc8-a210-7f0d9efd3d6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:33.521591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de52d9-38d3-4bc8-a210-7f0d9efd3d6c service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:33.521859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de52d9-38d3-4bc8-a210-7f0d9efd3d6c service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:33.522120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de52d9-38d3-4bc8-a210-7f0d9efd3d6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:33.531038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de52d9-38d3-4bc8-a210-7f0d9efd3d6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:33.532589 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de52d9-38d3-4bc8-a210-7f0d9efd3d6c service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:33.542901 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1143/2289] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:38.587298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f93cf-0390-48ed-9d50-dba8191d1d22 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:38.587899 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f93cf-0390-48ed-9d50-dba8191d1d22 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:38.587899 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f93cf-0390-48ed-9d50-dba8191d1d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:38.608997 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-737f93cf-0390-48ed-9d50-dba8191d1d22 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:38.610317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-737f93cf-0390-48ed-9d50-dba8191d1d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:38.620049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1147/2290] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 00:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:38.643579 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de52d9-38d3-4bc8-a210-7f0d9efd3d6c service nova] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:38.644827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d3de52d9-38d3-4bc8-a210-7f0d9efd3d6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:38.660978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de52d9-38d3-4bc8-a210-7f0d9efd3d6c service nova] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:38.667369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45601311-574c-4a7c-9ef0-1587897337eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:38.668005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45601311-574c-4a7c-9ef0-1587897337eb service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:38.668274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45601311-574c-4a7c-9ef0-1587897337eb service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:38.668541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45601311-574c-4a7c-9ef0-1587897337eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:38.677302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45601311-574c-4a7c-9ef0-1587897337eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:38.678883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45601311-574c-4a7c-9ef0-1587897337eb service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:38.688425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1144/2291] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:42.919082 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddc525-4da0-44c5-b625-0b3bef13c9aa None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.919674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddc525-4da0-44c5-b625-0b3bef13c9aa None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.919674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddc525-4da0-44c5-b625-0b3bef13c9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.950936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c1ddc525-4da0-44c5-b625-0b3bef13c9aa None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:42.952198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c1ddc525-4da0-44c5-b625-0b3bef13c9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.964618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1148/2292] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 00:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:42.993935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45601311-574c-4a7c-9ef0-1587897337eb service nova] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.009933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45601311-574c-4a7c-9ef0-1587897337eb service nova] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.016477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8158140-5094-451d-b360-f2f949ddb9fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.017064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8158140-5094-451d-b360-f2f949ddb9fe service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.017360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8158140-5094-451d-b360-f2f949ddb9fe service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.017627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8158140-5094-451d-b360-f2f949ddb9fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.026749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8158140-5094-451d-b360-f2f949ddb9fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.028323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8158140-5094-451d-b360-f2f949ddb9fe service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.037729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1145/2293] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:47.018821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47013c00-e6fc-4b32-964f-923709be995e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.019999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47013c00-e6fc-4b32-964f-923709be995e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.020155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47013c00-e6fc-4b32-964f-923709be995e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.043996 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-47013c00-e6fc-4b32-964f-923709be995e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:47.045222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-47013c00-e6fc-4b32-964f-923709be995e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:47.054910 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1149/2294] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:47.085486 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8158140-5094-451d-b360-f2f949ddb9fe service nova] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.097162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8158140-5094-451d-b360-f2f949ddb9fe service nova] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.104645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f8aba-4ae3-4f60-94ee-efe592128c28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.105189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f8aba-4ae3-4f60-94ee-efe592128c28 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.105500 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f8aba-4ae3-4f60-94ee-efe592128c28 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.105803 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f8aba-4ae3-4f60-94ee-efe592128c28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.114990 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f8aba-4ae3-4f60-94ee-efe592128c28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.116573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f8aba-4ae3-4f60-94ee-efe592128c28 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.126532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1146/2295] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:52.286913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b56465-bc7c-4c22-bbb8-4906c4619131 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.287490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b56465-bc7c-4c22-bbb8-4906c4619131 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.287490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b56465-bc7c-4c22-bbb8-4906c4619131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.307993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-01b56465-bc7c-4c22-bbb8-4906c4619131 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:52.309188 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-01b56465-bc7c-4c22-bbb8-4906c4619131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:52.317830 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1150/2296] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 00:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:52.342217 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f8aba-4ae3-4f60-94ee-efe592128c28 service nova] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.353937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f8aba-4ae3-4f60-94ee-efe592128c28 service nova] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.363176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962e90-6de0-48ad-a8df-eea39fd48e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.363791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962e90-6de0-48ad-a8df-eea39fd48e36 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.364062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962e90-6de0-48ad-a8df-eea39fd48e36 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.364319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962e90-6de0-48ad-a8df-eea39fd48e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.373112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962e90-6de0-48ad-a8df-eea39fd48e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.374718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962e90-6de0-48ad-a8df-eea39fd48e36 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:52.384523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1147/2297] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:55.434016 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b56465-bc7c-4c22-bbb8-4906c4619131 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:55.440256 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=16 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:55.444960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b56465-bc7c-4c22-bbb8-4906c4619131 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:55.448719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d833a-fbd0-49dd-b538-7f1b3881b645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:55.449422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d833a-fbd0-49dd-b538-7f1b3881b645 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:55.449699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d833a-fbd0-49dd-b538-7f1b3881b645 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:55.449968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d833a-fbd0-49dd-b538-7f1b3881b645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:55.451863 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-564d833a-fbd0-49dd-b538-7f1b3881b645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:55.453010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962e90-6de0-48ad-a8df-eea39fd48e36 service nova] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:55.454489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-fc962e90-6de0-48ad-a8df-eea39fd48e36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:55.461864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=31 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:55.467439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d833a-fbd0-49dd-b538-7f1b3881b645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:55.467647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962e90-6de0-48ad-a8df-eea39fd48e36 service nova] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:55.469267 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d833a-fbd0-49dd-b538-7f1b3881b645 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:55.472120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d38de-5bef-4dc4-9f67-d50a6c412495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:55.472729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d38de-5bef-4dc4-9f67-d50a6c412495 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:55.473006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d38de-5bef-4dc4-9f67-d50a6c412495 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:55.474177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d38de-5bef-4dc4-9f67-d50a6c412495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:55.476372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-280d38de-5bef-4dc4-9f67-d50a6c412495 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:55.484150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1151/2298] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:55.491465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d38de-5bef-4dc4-9f67-d50a6c412495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:55.493078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d38de-5bef-4dc4-9f67-d50a6c412495 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:55.505246 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1148/2299] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:56.499034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf7f3-205a-413b-87f0-3d7b505b0a3e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:56.500058 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf7f3-205a-413b-87f0-3d7b505b0a3e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:56.500355 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf7f3-205a-413b-87f0-3d7b505b0a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:56.522858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7fabf7f3-205a-413b-87f0-3d7b505b0a3e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:56.524286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7fabf7f3-205a-413b-87f0-3d7b505b0a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:56.534595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1152/2300] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 00:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:56.559877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d38de-5bef-4dc4-9f67-d50a6c412495 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:56.572420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d38de-5bef-4dc4-9f67-d50a6c412495 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:56.578295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8934a1-760b-420a-aad5-02087ffd6770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:56.579326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8934a1-760b-420a-aad5-02087ffd6770 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:56.579701 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8934a1-760b-420a-aad5-02087ffd6770 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:56.579976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8934a1-760b-420a-aad5-02087ffd6770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:56.589548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8934a1-760b-420a-aad5-02087ffd6770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:56.591139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8934a1-760b-420a-aad5-02087ffd6770 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:56.602057 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1149/2301] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:02.777171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabf7f3-205a-413b-87f0-3d7b505b0a3e None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:02.794405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabf7f3-205a-413b-87f0-3d7b505b0a3e None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:02.801131 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6381132-6a5b-4a65-aede-36240b817db0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:02.801879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6381132-6a5b-4a65-aede-36240b817db0 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:02.802154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6381132-6a5b-4a65-aede-36240b817db0 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:02.802418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6381132-6a5b-4a65-aede-36240b817db0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:02.804412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d6381132-6a5b-4a65-aede-36240b817db0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:02.872375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6381132-6a5b-4a65-aede-36240b817db0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:02.873854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6381132-6a5b-4a65-aede-36240b817db0 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:02.885280 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1153/2302] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:06.599034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=11 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:12.886307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=36 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:15.544329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8934a1-760b-420a-aad5-02087ffd6770 service nova] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:15.558830 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8934a1-760b-420a-aad5-02087ffd6770 service nova] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:15.565578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7afdf2-3f65-47ed-a0fb-4fc10c05f1eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:15.566179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7afdf2-3f65-47ed-a0fb-4fc10c05f1eb service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:15.566451 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7afdf2-3f65-47ed-a0fb-4fc10c05f1eb service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:15.566718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7afdf2-3f65-47ed-a0fb-4fc10c05f1eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:15.568876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3e7afdf2-3f65-47ed-a0fb-4fc10c05f1eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:15.632772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7afdf2-3f65-47ed-a0fb-4fc10c05f1eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:15.634422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7afdf2-3f65-47ed-a0fb-4fc10c05f1eb service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:15.646267 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1150/2303] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:17.305530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6381132-6a5b-4a65-aede-36240b817db0 service nova] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:17.305530 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d6381132-6a5b-4a65-aede-36240b817db0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:17.311343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6381132-6a5b-4a65-aede-36240b817db0 service nova] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:17.315886 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2fb8f-ea7e-4a89-8e67-63c4bb20ab01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:17.316503 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2fb8f-ea7e-4a89-8e67-63c4bb20ab01 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:17.316746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2fb8f-ea7e-4a89-8e67-63c4bb20ab01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:17.317010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2fb8f-ea7e-4a89-8e67-63c4bb20ab01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:17.319759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1bc2fb8f-ea7e-4a89-8e67-63c4bb20ab01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:17.330418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2fb8f-ea7e-4a89-8e67-63c4bb20ab01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:17.331846 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2fb8f-ea7e-4a89-8e67-63c4bb20ab01 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:17.341242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1154/2304] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:17.620907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3c607-c1db-4f2c-be55-0a77bf27486e None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:17.621374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3c607-c1db-4f2c-be55-0a77bf27486e None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:17.621493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3c607-c1db-4f2c-be55-0a77bf27486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:17.642079 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-e1c3c607-c1db-4f2c-be55-0a77bf27486e None None] MFA Rules not processed for user `0fe5a34d4fd148af82673a3591b3d82c`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:17.643322 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e1c3c607-c1db-4f2c-be55-0a77bf27486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:17.652038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1151/2305] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:21:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:17.923523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2fb8f-ea7e-4a89-8e67-63c4bb20ab01 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:17.933111 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2fb8f-ea7e-4a89-8e67-63c4bb20ab01 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:17.937959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b318c42-4a9f-4cab-b365-ae8d0eed3ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:17.938657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b318c42-4a9f-4cab-b365-ae8d0eed3ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:17.939100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b318c42-4a9f-4cab-b365-ae8d0eed3ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:17.939527 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b318c42-4a9f-4cab-b365-ae8d0eed3ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:17.941594 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1b318c42-4a9f-4cab-b365-ae8d0eed3ab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:17.952991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b318c42-4a9f-4cab-b365-ae8d0eed3ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:17.954759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b318c42-4a9f-4cab-b365-ae8d0eed3ab9 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:17.964469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1155/2306] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:18.483998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3c607-c1db-4f2c-be55-0a77bf27486e None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:18.485424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e1c3c607-c1db-4f2c-be55-0a77bf27486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:18.571921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3c607-c1db-4f2c-be55-0a77bf27486e None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:18.577100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176998c-5411-4531-bbf6-2a3354689b13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227f958b82a446e19a4d5b29d74193bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:18.577834 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176998c-5411-4531-bbf6-2a3354689b13 service placement] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:18.578175 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176998c-5411-4531-bbf6-2a3354689b13 service placement] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:18.578511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176998c-5411-4531-bbf6-2a3354689b13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:18.580358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-5176998c-5411-4531-bbf6-2a3354689b13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:18.594991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176998c-5411-4531-bbf6-2a3354689b13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:18.596764 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176998c-5411-4531-bbf6-2a3354689b13 service placement] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:18.607887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1152/2307] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:21.260968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b318c42-4a9f-4cab-b365-ae8d0eed3ab9 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:21.273409 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b318c42-4a9f-4cab-b365-ae8d0eed3ab9 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:21.277819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab8b14-8e96-4e1f-8feb-0f0c8ac0bd04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:21.278540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8b14-8e96-4e1f-8feb-0f0c8ac0bd04 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:21.278819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8b14-8e96-4e1f-8feb-0f0c8ac0bd04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:21.279089 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8b14-8e96-4e1f-8feb-0f0c8ac0bd04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:21.280838 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-96ab8b14-8e96-4e1f-8feb-0f0c8ac0bd04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:21.292587 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab8b14-8e96-4e1f-8feb-0f0c8ac0bd04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:21.294331 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab8b14-8e96-4e1f-8feb-0f0c8ac0bd04 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:21.310956 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1156/2308] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:23.581569 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176998c-5411-4531-bbf6-2a3354689b13 service placement] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:23.594724 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176998c-5411-4531-bbf6-2a3354689b13 service placement] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:23.601306 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad55428-560e-48a6-ad71-26cc2065dfbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:23.602169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad55428-560e-48a6-ad71-26cc2065dfbc service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.602439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad55428-560e-48a6-ad71-26cc2065dfbc service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.602872 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad55428-560e-48a6-ad71-26cc2065dfbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.604894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-fad55428-560e-48a6-ad71-26cc2065dfbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:23.619856 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad55428-560e-48a6-ad71-26cc2065dfbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:23.621648 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad55428-560e-48a6-ad71-26cc2065dfbc service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:23.633522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1153/2309] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:31.301565 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=18 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:33.628775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=69 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:37.010124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab8b14-8e96-4e1f-8feb-0f0c8ac0bd04 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.024804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab8b14-8e96-4e1f-8feb-0f0c8ac0bd04 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.031531 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8033396-d3a6-4e17-a896-54ccf1aa41c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.032132 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8033396-d3a6-4e17-a896-54ccf1aa41c3 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.032405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8033396-d3a6-4e17-a896-54ccf1aa41c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.032666 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8033396-d3a6-4e17-a896-54ccf1aa41c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.034532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e8033396-d3a6-4e17-a896-54ccf1aa41c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.098071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8033396-d3a6-4e17-a896-54ccf1aa41c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.099761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8033396-d3a6-4e17-a896-54ccf1aa41c3 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.112382 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1157/2310] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:37.493356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad55428-560e-48a6-ad71-26cc2065dfbc service nova] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.505499 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad55428-560e-48a6-ad71-26cc2065dfbc service nova] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.518108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9e065-df6c-4300-ae6f-23936c897c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.518730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9e065-df6c-4300-ae6f-23936c897c43 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.519005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9e065-df6c-4300-ae6f-23936c897c43 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.519601 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9e065-df6c-4300-ae6f-23936c897c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.522158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f5e9e065-df6c-4300-ae6f-23936c897c43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.541699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9e065-df6c-4300-ae6f-23936c897c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.544407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9e065-df6c-4300-ae6f-23936c897c43 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.559206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1154/2311] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:39.989472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d2c2c-6b2a-4e3a-97c7-2072589a53af None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:39.990038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d2c2c-6b2a-4e3a-97c7-2072589a53af None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:39.990038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d2c2c-6b2a-4e3a-97c7-2072589a53af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:40.014631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-825d2c2c-6b2a-4e3a-97c7-2072589a53af None None] MFA Rules not processed for user `a899638fd4f44d738d98fed19c35babc`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:40.017172 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-825d2c2c-6b2a-4e3a-97c7-2072589a53af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:40.038665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1158/2312] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:21:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:41.053115 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d58067-1836-4360-b0d5-a4fe727e1f5c None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.053700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d58067-1836-4360-b0d5-a4fe727e1f5c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.053700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d58067-1836-4360-b0d5-a4fe727e1f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.096448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d0d58067-1836-4360-b0d5-a4fe727e1f5c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:41.104419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d0d58067-1836-4360-b0d5-a4fe727e1f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:41.114753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1155/2313] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 00:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:41.177522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d2c2c-6b2a-4e3a-97c7-2072589a53af None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:41.194201 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d2c2c-6b2a-4e3a-97c7-2072589a53af None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:41.201719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a5a4b-16ca-4ca2-a0dd-fbcd78646d1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:41.202272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a5a4b-16ca-4ca2-a0dd-fbcd78646d1f service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.202547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a5a4b-16ca-4ca2-a0dd-fbcd78646d1f service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.202807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a5a4b-16ca-4ca2-a0dd-fbcd78646d1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.212298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a5a4b-16ca-4ca2-a0dd-fbcd78646d1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:41.214341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a5a4b-16ca-4ca2-a0dd-fbcd78646d1f service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:41.225504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1159/2314] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:47.510167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a49fb-c77c-4460-9398-59e971c843d7 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.510754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a49fb-c77c-4460-9398-59e971c843d7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.510754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a49fb-c77c-4460-9398-59e971c843d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.533593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a75a49fb-c77c-4460-9398-59e971c843d7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:47.535120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a75a49fb-c77c-4460-9398-59e971c843d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:47.544919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1156/2315] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 00:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:47.577501 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a5a4b-16ca-4ca2-a0dd-fbcd78646d1f service nova] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.594404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a5a4b-16ca-4ca2-a0dd-fbcd78646d1f service nova] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.601970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821fcf4-0c77-4087-b986-4b26a8e50325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.602814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821fcf4-0c77-4087-b986-4b26a8e50325 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.603085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821fcf4-0c77-4087-b986-4b26a8e50325 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.603373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821fcf4-0c77-4087-b986-4b26a8e50325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.612367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821fcf4-0c77-4087-b986-4b26a8e50325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.614480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821fcf4-0c77-4087-b986-4b26a8e50325 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.626836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1160/2316] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:50.768819 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ed782-993c-4306-a76c-c984981c024b None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:50.769799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ed782-993c-4306-a76c-c984981c024b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:50.769799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ed782-993c-4306-a76c-c984981c024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:50.789239 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a32ed782-993c-4306-a76c-c984981c024b None None] MFA Rules not processed for user `30a43f66db08456fb272d7e13a1c9256`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:50.790474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a32ed782-993c-4306-a76c-c984981c024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:50.802932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1157/2317] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:21:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:51.615925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c2928-5216-4088-bc0a-372e3ba48c20 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.616593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c2928-5216-4088-bc0a-372e3ba48c20 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.616593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c2928-5216-4088-bc0a-372e3ba48c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.638363 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-2b4c2928-5216-4088-bc0a-372e3ba48c20 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:51.639605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2b4c2928-5216-4088-bc0a-372e3ba48c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:51.649899 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1161/2318] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 00:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:51.671564 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ed782-993c-4306-a76c-c984981c024b None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:51.685892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ed782-993c-4306-a76c-c984981c024b None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:51.694432 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a244ba-48e1-413a-a025-64b1a0b51fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:51.695004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a244ba-48e1-413a-a025-64b1a0b51fa2 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.695273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a244ba-48e1-413a-a025-64b1a0b51fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.695541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a244ba-48e1-413a-a025-64b1a0b51fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.704976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a244ba-48e1-413a-a025-64b1a0b51fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:51.706594 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a244ba-48e1-413a-a025-64b1a0b51fa2 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:51.718272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1158/2319] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:58.926234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e33ec-edf3-499d-8b34-6984379c1f45 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:58.926925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e33ec-edf3-499d-8b34-6984379c1f45 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:58.926925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e33ec-edf3-499d-8b34-6984379c1f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:58.956836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-9d0e33ec-edf3-499d-8b34-6984379c1f45 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:58.958078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9d0e33ec-edf3-499d-8b34-6984379c1f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:58.968083 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1162/2320] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 00:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:58.996835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a244ba-48e1-413a-a025-64b1a0b51fa2 service nova] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:59.008559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a244ba-48e1-413a-a025-64b1a0b51fa2 service nova] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:59.015574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31984803-6473-434b-ab08-f9201e882b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:59.016192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31984803-6473-434b-ab08-f9201e882b92 service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:59.016440 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31984803-6473-434b-ab08-f9201e882b92 service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:59.016710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31984803-6473-434b-ab08-f9201e882b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:59.025548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31984803-6473-434b-ab08-f9201e882b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:59.027110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31984803-6473-434b-ab08-f9201e882b92 service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:59.036967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1159/2321] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:05.610988 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76f26e-8150-4954-a764-be2b17706164 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:05.611575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76f26e-8150-4954-a764-be2b17706164 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:05.611575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76f26e-8150-4954-a764-be2b17706164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:05.618997 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=50 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:05.633514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-2d76f26e-8150-4954-a764-be2b17706164 None None] MFA Rules not processed for user `c4ea453d044840f5aa1d5d89ba5a942d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:05.635378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2d76f26e-8150-4954-a764-be2b17706164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:05.691668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1163/2322] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:22:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:07.296416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b2a38-8947-4b05-ab52-5558ff07f952 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:07.296987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b2a38-8947-4b05-ab52-5558ff07f952 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:07.296987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b2a38-8947-4b05-ab52-5558ff07f952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:07.305468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=28 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:07.318598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-2d9b2a38-8947-4b05-ab52-5558ff07f952 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:07.319772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2d9b2a38-8947-4b05-ab52-5558ff07f952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:07.328131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1160/2323] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 00:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:07.353832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76f26e-8150-4954-a764-be2b17706164 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:07.367806 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76f26e-8150-4954-a764-be2b17706164 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:07.375025 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe2e05-bafc-4352-94f0-2587d945dd09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:07.375640 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe2e05-bafc-4352-94f0-2587d945dd09 service nova] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:07.375896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe2e05-bafc-4352-94f0-2587d945dd09 service nova] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:07.376171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe2e05-bafc-4352-94f0-2587d945dd09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:07.385536 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe2e05-bafc-4352-94f0-2587d945dd09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:07.387172 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe2e05-bafc-4352-94f0-2587d945dd09 service nova] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:07.397594 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1164/2324] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:17.313867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:17.393038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=30 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:23.578513 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b2a38-8947-4b05-ab52-5558ff07f952 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:23.591716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b2a38-8947-4b05-ab52-5558ff07f952 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:23.597588 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239a0a2-883b-4f9f-9205-08c5bf400a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2016ed84211d412481d512eae23d2ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:23.598304 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239a0a2-883b-4f9f-9205-08c5bf400a8a service nova] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:23.598745 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239a0a2-883b-4f9f-9205-08c5bf400a8a service nova] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:23.599080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239a0a2-883b-4f9f-9205-08c5bf400a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:23.600925 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4239a0a2-883b-4f9f-9205-08c5bf400a8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:23.614306 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239a0a2-883b-4f9f-9205-08c5bf400a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:23.616047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239a0a2-883b-4f9f-9205-08c5bf400a8a service nova] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:23.628321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1161/2325] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:33.623379 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=6 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:36.979921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8239d-d3fe-44aa-822f-4fc6876d8f90 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:36.980388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8239d-d3fe-44aa-822f-4fc6876d8f90 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:36.980491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8239d-d3fe-44aa-822f-4fc6876d8f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:37.004119 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-aae8239d-d3fe-44aa-822f-4fc6876d8f90 None None] MFA Rules not processed for user `cb42eefa189049d4bdaddd776eb735e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:37.005414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-aae8239d-d3fe-44aa-822f-4fc6876d8f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:37.013079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1165/2326] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:22:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:43.495732 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b92dd-ed82-421c-b68f-96f4dfc8b2a9 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.496343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b92dd-ed82-421c-b68f-96f4dfc8b2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.496343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b92dd-ed82-421c-b68f-96f4dfc8b2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.516881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-dd1b92dd-ed82-421c-b68f-96f4dfc8b2a9 None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:43.518120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-dd1b92dd-ed82-421c-b68f-96f4dfc8b2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:43.526252 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1162/2327] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 31 00:22:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:43.578027 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8239d-d3fe-44aa-822f-4fc6876d8f90 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:43.591443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8239d-d3fe-44aa-822f-4fc6876d8f90 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:43.597957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8782558-b02e-4787-acb2-8824508ab7d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:43.600187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782558-b02e-4787-acb2-8824508ab7d8 service swift] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.600970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782558-b02e-4787-acb2-8824508ab7d8 service swift] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.602343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782558-b02e-4787-acb2-8824508ab7d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.613069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8782558-b02e-4787-acb2-8824508ab7d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:43.614823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8782558-b02e-4787-acb2-8824508ab7d8 service swift] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:43.625516 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1166/2328] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:22:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:22:48.062818 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b92dd-ed82-421c-b68f-96f4dfc8b2a9 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:48.064346 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-dd1b92dd-ed82-421c-b68f-96f4dfc8b2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:48.080641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b92dd-ed82-421c-b68f-96f4dfc8b2a9 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:48.091689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a29729-240d-4f17-a4a7-07ae0c7ccc59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227f958b82a446e19a4d5b29d74193bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:48.092205 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a29729-240d-4f17-a4a7-07ae0c7ccc59 service placement] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:48.100256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a29729-240d-4f17-a4a7-07ae0c7ccc59 service placement] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:48.100770 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a29729-240d-4f17-a4a7-07ae0c7ccc59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:48.103009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-76a29729-240d-4f17-a4a7-07ae0c7ccc59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:48.118848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a29729-240d-4f17-a4a7-07ae0c7ccc59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:48.120643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a29729-240d-4f17-a4a7-07ae0c7ccc59 service placement] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:48.144401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1163/2329] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:51.680948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8782558-b02e-4787-acb2-8824508ab7d8 service swift] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:51.693663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8782558-b02e-4787-acb2-8824508ab7d8 service swift] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:51.700075 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd2c6e-01d3-4c05-8fe4-8cd212783cdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227f958b82a446e19a4d5b29d74193bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:51.700687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2c6e-01d3-4c05-8fe4-8cd212783cdc service placement] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:51.700959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2c6e-01d3-4c05-8fe4-8cd212783cdc service placement] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:51.701246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2c6e-01d3-4c05-8fe4-8cd212783cdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:51.703056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-27fd2c6e-01d3-4c05-8fe4-8cd212783cdc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:51.715087 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd2c6e-01d3-4c05-8fe4-8cd212783cdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:51.716674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd2c6e-01d3-4c05-8fe4-8cd212783cdc service placement] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:51.726909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1167/2330] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:51.787583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a29729-240d-4f17-a4a7-07ae0c7ccc59 service placement] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:51.789425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-76a29729-240d-4f17-a4a7-07ae0c7ccc59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:51.803013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a29729-240d-4f17-a4a7-07ae0c7ccc59 service placement] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:51.807754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:51.808376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:51.808645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:51.808912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] PATH_INFO: `/v3/users/7594d9276d1d4dac9120501de26c836f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:51.810079 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7594d9276d1d4dac9120501de26c836f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:51.812151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:51.867956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7594d9276d1d4dac9120501de26c836f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:51.879710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7594d9276d1d4dac9120501de26c836f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:51.880402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7594d9276d1d4dac9120501de26c836f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:51.881137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7594d9276d1d4dac9120501de26c836f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:51.895095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7594d9276d1d4dac9120501de26c836f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:51.908478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1164/2331] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:51 2022] DELETE /identity/v3/users/7594d9276d1d4dac9120501de26c836f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:52.090937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd2c6e-01d3-4c05-8fe4-8cd212783cdc service placement] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:52.103590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd2c6e-01d3-4c05-8fe4-8cd212783cdc service placement] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:52.169584 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:52.170223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:52.170498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:52.170767 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] PATH_INFO: `/v3/projects/eec3a36c22d6467eba29edfcfca481c5` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:52.171875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec3a36c22d6467eba29edfcfca481c5)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:52.173825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:52.218348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:52.219943 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:52.250033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec3a36c22d6467eba29edfcfca481c5', 'request_id': 'req-2e392999-eed7-4188-bbac-416174c49024'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.265468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec3a36c22d6467eba29edfcfca481c5', 'request_id': 'req-2e392999-eed7-4188-bbac-416174c49024'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.269751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f93a32-a410-4def-8160-26c20a55a034 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:52.273405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec3a36c22d6467eba29edfcfca481c5', 'request_id': 'req-2e392999-eed7-4188-bbac-416174c49024'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.287257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] The token cache is being invalidate because project eec3a36c22d6467eba29edfcfca481c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:52.287544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.288270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.290142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1168/2332] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:52 2022] DELETE /identity/v3/projects/eec3a36c22d6467eba29edfcfca481c5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:52.293872 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:52.295172 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:52.349611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:52.350248 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:52.350515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:52.350960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] PATH_INFO: `/v3/users/0fe5a34d4fd148af82673a3591b3d82c` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:52.352203 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe5a34d4fd148af82673a3591b3d82c)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:52.354138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:52.366540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:52.371405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e392999-eed7-4188-bbac-416174c49024 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:52.380425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:52.381198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:52.382089 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:52.382433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] PATH_INFO: `/v3/users/ca57b7e3999842769ab26957df1d716e` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:52.386061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca57b7e3999842769ab26957df1d716e)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:52.390100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:52.431342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe5a34d4fd148af82673a3591b3d82c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.442946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:52.452468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe5a34d4fd148af82673a3591b3d82c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.453756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe5a34d4fd148af82673a3591b3d82c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.454687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe5a34d4fd148af82673a3591b3d82c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.467049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca57b7e3999842769ab26957df1d716e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.470937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe5a34d4fd148af82673a3591b3d82c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.476844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca57b7e3999842769ab26957df1d716e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.477626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca57b7e3999842769ab26957df1d716e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.484840 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca57b7e3999842769ab26957df1d716e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.487977 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1165/2333] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:52 2022] DELETE /identity/v3/users/0fe5a34d4fd148af82673a3591b3d82c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:52.497115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca57b7e3999842769ab26957df1d716e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.503100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1169/2334] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:52 2022] DELETE /identity/v3/users/ca57b7e3999842769ab26957df1d716e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:52.693620 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:52.696177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:52.712809 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:52.715443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:52.778707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb42dd-6bd9-4ddc-8afa-f460ed508f6c admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:52.797102 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a47bf-9f0b-48bd-b5dd-698a4d8474c7 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:52.802153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:52.802787 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:52.803065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:52.803332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] PATH_INFO: `/v3/projects/6d2c83737b904941a17ccf6dc3102739` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:52.804670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d2c83737b904941a17ccf6dc3102739)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:52.806633 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:52.847527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:52.848126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:52.848405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:52.848673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] PATH_INFO: `/v3/projects/a203262d00da4903912caff85a4d5cbb` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:52.853329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a203262d00da4903912caff85a4d5cbb)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:52.855361 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:52.888258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d2c83737b904941a17ccf6dc3102739', 'request_id': 'req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.900225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d2c83737b904941a17ccf6dc3102739', 'request_id': 'req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.908662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d2c83737b904941a17ccf6dc3102739', 'request_id': 'req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.917591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a203262d00da4903912caff85a4d5cbb', 'request_id': 'req-2a4aeadc-b3d2-4077-91e2-120e04a563ba'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.921430 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] The token cache is being invalidate because project 6d2c83737b904941a17ccf6dc3102739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:52.921894 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.922796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.925094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1170/2335] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:52 2022] DELETE /identity/v3/projects/6d2c83737b904941a17ccf6dc3102739 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:52.933129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a203262d00da4903912caff85a4d5cbb', 'request_id': 'req-2a4aeadc-b3d2-4077-91e2-120e04a563ba'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.942711 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a203262d00da4903912caff85a4d5cbb', 'request_id': 'req-2a4aeadc-b3d2-4077-91e2-120e04a563ba'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.957623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] The token cache is being invalidate because project a203262d00da4903912caff85a4d5cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:52.957895 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.958775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:52.973242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1166/2336] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:52 2022] DELETE /identity/v3/projects/a203262d00da4903912caff85a4d5cbb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:02.918108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:02.953597 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=85,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:25.993805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:25.995466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:26.057976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c32fd-b4bb-4f06-8e2d-24adbabc872a admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:26.110751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4fcb-2b4e-4adb-8cfa-232707bd2b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:26.111368 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4fcb-2b4e-4adb-8cfa-232707bd2b07 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:26.111642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4fcb-2b4e-4adb-8cfa-232707bd2b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:26.111907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4fcb-2b4e-4adb-8cfa-232707bd2b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:26.113741 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-fb5c4fcb-2b4e-4adb-8cfa-232707bd2b07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:26.179598 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c4fcb-2b4e-4adb-8cfa-232707bd2b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:26.181116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c4fcb-2b4e-4adb-8cfa-232707bd2b07 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:26.190478 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1171/2337] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:36.186367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=68 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:40.183818 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:40.185528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:40.247875 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4aeadc-b3d2-4077-91e2-120e04a563ba admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:40.251575 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46616726-c439-4778-9acb-52ee47defa8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:40.252218 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46616726-c439-4778-9acb-52ee47defa8e service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:40.252453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46616726-c439-4778-9acb-52ee47defa8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:40.252715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46616726-c439-4778-9acb-52ee47defa8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:40.254453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-46616726-c439-4778-9acb-52ee47defa8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:40.326237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46616726-c439-4778-9acb-52ee47defa8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:40.327797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46616726-c439-4778-9acb-52ee47defa8e service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:40.345130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1167/2338] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:49.473453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4fcb-2b4e-4adb-8cfa-232707bd2b07 service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:49.475082 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-fb5c4fcb-2b4e-4adb-8cfa-232707bd2b07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:49.517570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4fcb-2b4e-4adb-8cfa-232707bd2b07 service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:49.522342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576eac1-a37c-4c3e-bd59-ffed74eb0228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:49.523095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576eac1-a37c-4c3e-bd59-ffed74eb0228 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:49.523408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576eac1-a37c-4c3e-bd59-ffed74eb0228 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:49.523676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576eac1-a37c-4c3e-bd59-ffed74eb0228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:49.525806 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1576eac1-a37c-4c3e-bd59-ffed74eb0228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:49.642488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576eac1-a37c-4c3e-bd59-ffed74eb0228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:49.644216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576eac1-a37c-4c3e-bd59-ffed74eb0228 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:49.665860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1172/2339] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:50.339064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=48 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:50.348215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46616726-c439-4778-9acb-52ee47defa8e service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:50.370907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46616726-c439-4778-9acb-52ee47defa8e service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:50.375245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf2ba2-1abe-4ec4-a1a6-476fbafd38f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:50.376313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2ba2-1abe-4ec4-a1a6-476fbafd38f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:50.376666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2ba2-1abe-4ec4-a1a6-476fbafd38f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:50.376912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2ba2-1abe-4ec4-a1a6-476fbafd38f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:50.379343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e4cf2ba2-1abe-4ec4-a1a6-476fbafd38f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:50.392431 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf2ba2-1abe-4ec4-a1a6-476fbafd38f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:50.394265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf2ba2-1abe-4ec4-a1a6-476fbafd38f8 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:50.405293 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1168/2340] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:23:50.674739 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90b12-baf2-494d-9998-3afdbdc373c1 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:50.675283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90b12-baf2-494d-9998-3afdbdc373c1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:50.675283 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90b12-baf2-494d-9998-3afdbdc373c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:50.694529 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7af90b12-baf2-494d-9998-3afdbdc373c1 None None] MFA Rules not processed for user `a899638fd4f44d738d98fed19c35babc`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:50.695746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7af90b12-baf2-494d-9998-3afdbdc373c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:50.755600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1173/2341] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:23:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:55.729005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf2ba2-1abe-4ec4-a1a6-476fbafd38f8 service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:55.730673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e4cf2ba2-1abe-4ec4-a1a6-476fbafd38f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:55.747682 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf2ba2-1abe-4ec4-a1a6-476fbafd38f8 service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:55.765929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a44b9d-bdc6-4bc2-b457-9363b5ebce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:55.766580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a44b9d-bdc6-4bc2-b457-9363b5ebce2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:55.767061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a44b9d-bdc6-4bc2-b457-9363b5ebce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:55.767616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a44b9d-bdc6-4bc2-b457-9363b5ebce2d admin admin] PATH_INFO: `/v3/users/c4ea453d044840f5aa1d5d89ba5a942d` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:55.769996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a44b9d-bdc6-4bc2-b457-9363b5ebce2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ea453d044840f5aa1d5d89ba5a942d)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:55.772798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a44b9d-bdc6-4bc2-b457-9363b5ebce2d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:55.834028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-99a44b9d-bdc6-4bc2-b457-9363b5ebce2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ea453d044840f5aa1d5d89ba5a942d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:55.851877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-99a44b9d-bdc6-4bc2-b457-9363b5ebce2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ea453d044840f5aa1d5d89ba5a942d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:55.852846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-99a44b9d-bdc6-4bc2-b457-9363b5ebce2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ea453d044840f5aa1d5d89ba5a942d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:55.853728 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-99a44b9d-bdc6-4bc2-b457-9363b5ebce2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ea453d044840f5aa1d5d89ba5a942d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:55.864690 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-99a44b9d-bdc6-4bc2-b457-9363b5ebce2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ea453d044840f5aa1d5d89ba5a942d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:55.879279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1169/2342] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:23:55 2022] DELETE /identity/v3/users/c4ea453d044840f5aa1d5d89ba5a942d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:56.083729 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90b12-baf2-494d-9998-3afdbdc373c1 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:56.097704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90b12-baf2-494d-9998-3afdbdc373c1 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:56.129504 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:56.180754 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ea2cc-70d3-4b18-a50e-148cb622dc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:56.181766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ea2cc-70d3-4b18-a50e-148cb622dc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:56.182158 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ea2cc-70d3-4b18-a50e-148cb622dc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:56.182885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ea2cc-70d3-4b18-a50e-148cb622dc40 admin admin] PATH_INFO: `/v3/projects/5dd1d873f5e24ecfaa18d02bdf682b52` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:56.184160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ea2cc-70d3-4b18-a50e-148cb622dc40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd1d873f5e24ecfaa18d02bdf682b52)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:56.186249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ea2cc-70d3-4b18-a50e-148cb622dc40 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:56.256858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-197ea2cc-70d3-4b18-a50e-148cb622dc40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd1d873f5e24ecfaa18d02bdf682b52', 'request_id': 'req-197ea2cc-70d3-4b18-a50e-148cb622dc40'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:56.270343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-197ea2cc-70d3-4b18-a50e-148cb622dc40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd1d873f5e24ecfaa18d02bdf682b52', 'request_id': 'req-197ea2cc-70d3-4b18-a50e-148cb622dc40'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:56.278183 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-197ea2cc-70d3-4b18-a50e-148cb622dc40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd1d873f5e24ecfaa18d02bdf682b52', 'request_id': 'req-197ea2cc-70d3-4b18-a50e-148cb622dc40'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:56.291429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-197ea2cc-70d3-4b18-a50e-148cb622dc40 admin admin] The token cache is being invalidate because project 5dd1d873f5e24ecfaa18d02bdf682b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:23:56.291755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-197ea2cc-70d3-4b18-a50e-148cb622dc40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:56.292406 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-197ea2cc-70d3-4b18-a50e-148cb622dc40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:56.297288 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1174/2343] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:23:56 2022] DELETE /identity/v3/projects/5dd1d873f5e24ecfaa18d02bdf682b52 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:56.299788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2fd0-8023-4b29-b049-3cf444fa4d2f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:56.300076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2fd0-8023-4b29-b049-3cf444fa4d2f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:56.300351 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2fd0-8023-4b29-b049-3cf444fa4d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:56.363474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-682f2fd0-8023-4b29-b049-3cf444fa4d2f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:56.364731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-682f2fd0-8023-4b29-b049-3cf444fa4d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:56.432225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1170/2344] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:56.440010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54a08e-760b-48e8-b957-02a4c689866a None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:56.440341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54a08e-760b-48e8-b957-02a4c689866a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:56.440563 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54a08e-760b-48e8-b957-02a4c689866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:56.470831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-1b54a08e-760b-48e8-b957-02a4c689866a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:56.472984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1b54a08e-760b-48e8-b957-02a4c689866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:56.489993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1175/2345] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:56.490470 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f2fd0-8023-4b29-b049-3cf444fa4d2f None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:56.503772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f2fd0-8023-4b29-b049-3cf444fa4d2f None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:56.511470 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11cd0b-3fd6-4424-9959-54c134d7ebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:56.513294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11cd0b-3fd6-4424-9959-54c134d7ebbb admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:56.513577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11cd0b-3fd6-4424-9959-54c134d7ebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:56.513848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11cd0b-3fd6-4424-9959-54c134d7ebbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:56.514517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11cd0b-3fd6-4424-9959-54c134d7ebbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:23:56.514952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11cd0b-3fd6-4424-9959-54c134d7ebbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:56.516577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11cd0b-3fd6-4424-9959-54c134d7ebbb admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:56.531376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1171/2346] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:23:56.535779 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54a08e-760b-48e8-b957-02a4c689866a None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:56.548838 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54a08e-760b-48e8-b957-02a4c689866a None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:56.556856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e07c1-84cc-487f-981d-c7dd8b1f2c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:56.557543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e07c1-84cc-487f-981d-c7dd8b1f2c11 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:56.557815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e07c1-84cc-487f-981d-c7dd8b1f2c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:56.558085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e07c1-84cc-487f-981d-c7dd8b1f2c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:56.558746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e07c1-84cc-487f-981d-c7dd8b1f2c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:56.561242 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e07c1-84cc-487f-981d-c7dd8b1f2c11 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:56.599337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1176/2347] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:23:56 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:23:56.603787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11cd0b-3fd6-4424-9959-54c134d7ebbb admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:56.613658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:56.619779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11cd0b-3fd6-4424-9959-54c134d7ebbb admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:56.688374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df738e-c7e7-4e97-8bdf-62b238fd3873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:56.689103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df738e-c7e7-4e97-8bdf-62b238fd3873 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:56.689492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df738e-c7e7-4e97-8bdf-62b238fd3873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:56.689834 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df738e-c7e7-4e97-8bdf-62b238fd3873 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:56.690539 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df738e-c7e7-4e97-8bdf-62b238fd3873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:56.692544 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df738e-c7e7-4e97-8bdf-62b238fd3873 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:56.736112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1172/2348] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:23:56 2022] POST /identity/v3/users => generated 303 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:23:56.740516 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e07c1-84cc-487f-981d-c7dd8b1f2c11 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:56.756869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e07c1-84cc-487f-981d-c7dd8b1f2c11 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:56.764868 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa074df-4169-4ac0-83a6-5e4ea8d64391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:56.765076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa074df-4169-4ac0-83a6-5e4ea8d64391 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:56.765378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa074df-4169-4ac0-83a6-5e4ea8d64391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:56.765645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa074df-4169-4ac0-83a6-5e4ea8d64391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:56.766293 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa074df-4169-4ac0-83a6-5e4ea8d64391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:56.768365 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa074df-4169-4ac0-83a6-5e4ea8d64391 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:56.782437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1177/2349] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:23:56.786436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df738e-c7e7-4e97-8bdf-62b238fd3873 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:56.804706 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df738e-c7e7-4e97-8bdf-62b238fd3873 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:56.810690 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163b409-1d31-4248-94b1-3c5599183e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:56.811299 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163b409-1d31-4248-94b1-3c5599183e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:56.811663 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163b409-1d31-4248-94b1-3c5599183e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:56.811912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163b409-1d31-4248-94b1-3c5599183e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:56.812554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163b409-1d31-4248-94b1-3c5599183e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:56.814189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163b409-1d31-4248-94b1-3c5599183e59 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:56.835673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1173/2350] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:23:56.840288 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa074df-4169-4ac0-83a6-5e4ea8d64391 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:56.852529 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa074df-4169-4ac0-83a6-5e4ea8d64391 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:56.857860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99322857-a5ad-4a61-842e-2c8a38b827bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:56.858613 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322857-a5ad-4a61-842e-2c8a38b827bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:56.858964 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322857-a5ad-4a61-842e-2c8a38b827bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:56.859319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322857-a5ad-4a61-842e-2c8a38b827bb admin admin] PATH_INFO: `/v3/projects/5ac36132c04940daaa635f1b64f11b6a/users/57edc3e28fd44212a0d8e4737623d309/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:56.876367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99322857-a5ad-4a61-842e-2c8a38b827bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac36132c04940daaa635f1b64f11b6a, user_id=57edc3e28fd44212a0d8e4737623d309, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:56.879059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99322857-a5ad-4a61-842e-2c8a38b827bb admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:56.895028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1178/2351] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:23:56 2022] PUT /identity/v3/projects/5ac36132c04940daaa635f1b64f11b6a/users/57edc3e28fd44212a0d8e4737623d309/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:56.906746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6647a14-c713-458a-b7b4-305b28a8c5cb None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:56.907030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6647a14-c713-458a-b7b4-305b28a8c5cb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:56.907303 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6647a14-c713-458a-b7b4-305b28a8c5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:56.935842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d6647a14-c713-458a-b7b4-305b28a8c5cb None None] MFA Rules not processed for user `57edc3e28fd44212a0d8e4737623d309`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:56.937066 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d6647a14-c713-458a-b7b4-305b28a8c5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:57.011566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1174/2352] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:23:56 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:57.016243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99322857-a5ad-4a61-842e-2c8a38b827bb admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:57.066716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:57.084945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99322857-a5ad-4a61-842e-2c8a38b827bb admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:57.100486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480cd54-fcb3-4c08-bf72-05f6fd748c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:57.101539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480cd54-fcb3-4c08-bf72-05f6fd748c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:57.101878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480cd54-fcb3-4c08-bf72-05f6fd748c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:57.102213 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480cd54-fcb3-4c08-bf72-05f6fd748c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:57.102924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480cd54-fcb3-4c08-bf72-05f6fd748c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:57.105260 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480cd54-fcb3-4c08-bf72-05f6fd748c3b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:57.138272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1179/2353] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:23:57 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:23:57.142740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6647a14-c713-458a-b7b4-305b28a8c5cb None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:57.158889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6647a14-c713-458a-b7b4-305b28a8c5cb None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:57.222452 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e490c-3ddd-4076-987f-47136f0b2e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:57.223206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e490c-3ddd-4076-987f-47136f0b2e9f admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:57.223484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e490c-3ddd-4076-987f-47136f0b2e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:57.223753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e490c-3ddd-4076-987f-47136f0b2e9f admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:57.224408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e490c-3ddd-4076-987f-47136f0b2e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:57.226378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e490c-3ddd-4076-987f-47136f0b2e9f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:57.258259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1175/2354] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:23:57 2022] POST /identity/v3/users => generated 308 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:23:57.262260 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480cd54-fcb3-4c08-bf72-05f6fd748c3b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:57.273686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480cd54-fcb3-4c08-bf72-05f6fd748c3b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:57.281473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd39c6-61dd-42fb-9736-a2fe526bc328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:57.282133 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd39c6-61dd-42fb-9736-a2fe526bc328 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:57.282410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd39c6-61dd-42fb-9736-a2fe526bc328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:57.282675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd39c6-61dd-42fb-9736-a2fe526bc328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:57.283322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd39c6-61dd-42fb-9736-a2fe526bc328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:57.285181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd39c6-61dd-42fb-9736-a2fe526bc328 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:57.297587 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1180/2355] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:23:57.302310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e490c-3ddd-4076-987f-47136f0b2e9f admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:57.308273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:57.317617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e490c-3ddd-4076-987f-47136f0b2e9f admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:57.326798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297b833-b6a8-466f-a424-4dea638a1c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:57.327704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b833-b6a8-466f-a424-4dea638a1c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:57.328133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b833-b6a8-466f-a424-4dea638a1c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:57.328567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b833-b6a8-466f-a424-4dea638a1c23 admin admin] PATH_INFO: `/v3/projects/c6c140abef3c407db93193bdaa3274b6/users/f9d4a9b8abcc479aa47a8df129817661/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:57.345964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297b833-b6a8-466f-a424-4dea638a1c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c140abef3c407db93193bdaa3274b6, user_id=f9d4a9b8abcc479aa47a8df129817661, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:57.349465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297b833-b6a8-466f-a424-4dea638a1c23 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:57.369189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1176/2356] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:23:57 2022] PUT /identity/v3/projects/c6c140abef3c407db93193bdaa3274b6/users/f9d4a9b8abcc479aa47a8df129817661/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:23:57.373278 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd39c6-61dd-42fb-9736-a2fe526bc328 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:57.384661 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd39c6-61dd-42fb-9736-a2fe526bc328 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:57.455746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c783cf-d5c0-485c-aecf-d06fc088ed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:57.456373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c783cf-d5c0-485c-aecf-d06fc088ed5d admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:57.456650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c783cf-d5c0-485c-aecf-d06fc088ed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:57.456920 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c783cf-d5c0-485c-aecf-d06fc088ed5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:57.457597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c783cf-d5c0-485c-aecf-d06fc088ed5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:57.459185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c783cf-d5c0-485c-aecf-d06fc088ed5d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:57.469875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1181/2357] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:23:57.474107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297b833-b6a8-466f-a424-4dea638a1c23 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:57.484707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297b833-b6a8-466f-a424-4dea638a1c23 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:57.489329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6adc7-8753-47fb-abcb-163070d337ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:57.490012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6adc7-8753-47fb-abcb-163070d337ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:57.490286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6adc7-8753-47fb-abcb-163070d337ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:57.490562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6adc7-8753-47fb-abcb-163070d337ca admin admin] PATH_INFO: `/v3/projects/c6c140abef3c407db93193bdaa3274b6/users/f9d4a9b8abcc479aa47a8df129817661/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:57.492513 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6adc7-8753-47fb-abcb-163070d337ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c140abef3c407db93193bdaa3274b6, user_id=f9d4a9b8abcc479aa47a8df129817661, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:57.495218 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6adc7-8753-47fb-abcb-163070d337ca admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:57.506226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1177/2358] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:23:57 2022] PUT /identity/v3/projects/c6c140abef3c407db93193bdaa3274b6/users/f9d4a9b8abcc479aa47a8df129817661/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:57.517116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8010-c457-4dcf-9831-6834892ca14c None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:57.517606 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8010-c457-4dcf-9831-6834892ca14c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:57.517889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8010-c457-4dcf-9831-6834892ca14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:57.548572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-8a0a8010-c457-4dcf-9831-6834892ca14c None None] MFA Rules not processed for user `f9d4a9b8abcc479aa47a8df129817661`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:57.549726 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8a0a8010-c457-4dcf-9831-6834892ca14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:57.628691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1182/2359] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:23:57 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:57.636436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6adc7-8753-47fb-abcb-163070d337ca admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:57.638371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-77b6adc7-8753-47fb-abcb-163070d337ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:57.698520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6adc7-8753-47fb-abcb-163070d337ca admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:57.702212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0a956-1aa0-40cf-92b9-2e28e747b328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:57.702823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a956-1aa0-40cf-92b9-2e28e747b328 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:57.703094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a956-1aa0-40cf-92b9-2e28e747b328 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:57.703364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a956-1aa0-40cf-92b9-2e28e747b328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:57.712738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0a956-1aa0-40cf-92b9-2e28e747b328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:57.714192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0a956-1aa0-40cf-92b9-2e28e747b328 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:57.723923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1178/2360] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:57 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:57.900931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8010-c457-4dcf-9831-6834892ca14c None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:57.965455 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:57.983743 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8010-c457-4dcf-9831-6834892ca14c None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:57.989422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:57.990055 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:57.990388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:57.991180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] PATH_INFO: `/v3/users/57edc3e28fd44212a0d8e4737623d309` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:57.992103 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57edc3e28fd44212a0d8e4737623d309)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:57.994492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:58.091659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57edc3e28fd44212a0d8e4737623d309'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.104231 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57edc3e28fd44212a0d8e4737623d309'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.104959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57edc3e28fd44212a0d8e4737623d309'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.113098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57edc3e28fd44212a0d8e4737623d309'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.127949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57edc3e28fd44212a0d8e4737623d309'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.134922 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1183/2361] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:23:57 2022] DELETE /identity/v3/users/57edc3e28fd44212a0d8e4737623d309 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:58.139611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e444f25-1870-4821-bca7-76e8275bcdd9 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:58.140261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e444f25-1870-4821-bca7-76e8275bcdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:58.140261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e444f25-1870-4821-bca7-76e8275bcdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:58.161118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-1e444f25-1870-4821-bca7-76e8275bcdd9 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:58.162730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1e444f25-1870-4821-bca7-76e8275bcdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:58.229409 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1179/2362] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:58.239400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:58.241056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:58.311996 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fe611-abc7-4a02-aac8-6f30b596a405 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:58.315976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf445d-50d6-43a2-be43-ffeada0704dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:58.316703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf445d-50d6-43a2-be43-ffeada0704dd service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:58.317048 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf445d-50d6-43a2-be43-ffeada0704dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:58.317410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf445d-50d6-43a2-be43-ffeada0704dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:58.328263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf445d-50d6-43a2-be43-ffeada0704dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:58.329877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf445d-50d6-43a2-be43-ffeada0704dd service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:58.343240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1184/2363] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:58.640627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e444f25-1870-4821-bca7-76e8275bcdd9 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:58.642202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1e444f25-1870-4821-bca7-76e8275bcdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:58.659784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e444f25-1870-4821-bca7-76e8275bcdd9 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:58.665781 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:58.666625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:58.666853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:58.667120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] PATH_INFO: `/v3/projects/5ac36132c04940daaa635f1b64f11b6a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:58.668262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac36132c04940daaa635f1b64f11b6a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:58.670206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:58.723162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac36132c04940daaa635f1b64f11b6a', 'request_id': 'req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.732424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac36132c04940daaa635f1b64f11b6a', 'request_id': 'req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.739187 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac36132c04940daaa635f1b64f11b6a', 'request_id': 'req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.741470 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:58.753826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] The token cache is being invalidate because project 5ac36132c04940daaa635f1b64f11b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:23:58.754118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.754955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.756731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1180/2364] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:23:58 2022] DELETE /identity/v3/projects/5ac36132c04940daaa635f1b64f11b6a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:58.760688 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf445d-50d6-43a2-be43-ffeada0704dd service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:58.771098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf445d-50d6-43a2-be43-ffeada0704dd service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:58.839409 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74ceef-5576-44df-a772-42a81ed30dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:58.840076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74ceef-5576-44df-a772-42a81ed30dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:58.840346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74ceef-5576-44df-a772-42a81ed30dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:58.840606 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74ceef-5576-44df-a772-42a81ed30dfc admin admin] PATH_INFO: `/v3/users/f9d4a9b8abcc479aa47a8df129817661` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:58.841805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74ceef-5576-44df-a772-42a81ed30dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d4a9b8abcc479aa47a8df129817661)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:58.843740 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74ceef-5576-44df-a772-42a81ed30dfc admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:58.851169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:58.901942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-1d74ceef-5576-44df-a772-42a81ed30dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d4a9b8abcc479aa47a8df129817661'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.911637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-1d74ceef-5576-44df-a772-42a81ed30dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d4a9b8abcc479aa47a8df129817661'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.913062 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-1d74ceef-5576-44df-a772-42a81ed30dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d4a9b8abcc479aa47a8df129817661'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.924229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-1d74ceef-5576-44df-a772-42a81ed30dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d4a9b8abcc479aa47a8df129817661'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.938401 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-1d74ceef-5576-44df-a772-42a81ed30dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d4a9b8abcc479aa47a8df129817661'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:58.947263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1185/2365] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:23:58 2022] DELETE /identity/v3/users/f9d4a9b8abcc479aa47a8df129817661 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:59.486978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:59.489600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:59.510852 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d015ff-a8e1-412d-aee8-c1b49c8191a4 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:59.593604 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d173762-6798-45f5-a522-59bd16a020fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:59.594380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173762-6798-45f5-a522-59bd16a020fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:59.594707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173762-6798-45f5-a522-59bd16a020fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:59.595054 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173762-6798-45f5-a522-59bd16a020fb admin admin] PATH_INFO: `/v3/projects/c6c140abef3c407db93193bdaa3274b6` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:59.596294 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d173762-6798-45f5-a522-59bd16a020fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c140abef3c407db93193bdaa3274b6)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:59.606699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d173762-6798-45f5-a522-59bd16a020fb admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:59.677780 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1d173762-6798-45f5-a522-59bd16a020fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c140abef3c407db93193bdaa3274b6', 'request_id': 'req-1d173762-6798-45f5-a522-59bd16a020fb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:59.697084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1d173762-6798-45f5-a522-59bd16a020fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c140abef3c407db93193bdaa3274b6', 'request_id': 'req-1d173762-6798-45f5-a522-59bd16a020fb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:59.709125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1d173762-6798-45f5-a522-59bd16a020fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c140abef3c407db93193bdaa3274b6', 'request_id': 'req-1d173762-6798-45f5-a522-59bd16a020fb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:59.732414 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1d173762-6798-45f5-a522-59bd16a020fb admin admin] The token cache is being invalidate because project c6c140abef3c407db93193bdaa3274b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:23:59.732705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1d173762-6798-45f5-a522-59bd16a020fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:59.733401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1d173762-6798-45f5-a522-59bd16a020fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:59.735479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1181/2366] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:23:59 2022] DELETE /identity/v3/projects/c6c140abef3c407db93193bdaa3274b6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:59.740348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4951c-4645-4add-a0a4-e6ee42033f5f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:59.741163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4951c-4645-4add-a0a4-e6ee42033f5f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:59.741757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4951c-4645-4add-a0a4-e6ee42033f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:59.770001 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-03f4951c-4645-4add-a0a4-e6ee42033f5f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:59.771262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-03f4951c-4645-4add-a0a4-e6ee42033f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:59.865500 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1186/2367] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:59.872967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f555e-1b61-4009-b298-6fc9744b8df3 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:59.873168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f555e-1b61-4009-b298-6fc9744b8df3 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:59.873491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f555e-1b61-4009-b298-6fc9744b8df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:59.898708 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ce8f555e-1b61-4009-b298-6fc9744b8df3 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:59.900418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ce8f555e-1b61-4009-b298-6fc9744b8df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:59.916422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1182/2368] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:59.917329 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4951c-4645-4add-a0a4-e6ee42033f5f None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:59.928453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4951c-4645-4add-a0a4-e6ee42033f5f None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:59.934930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7452264-fefc-4f20-b6ab-614983fcfe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:59.935556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7452264-fefc-4f20-b6ab-614983fcfe41 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:59.935831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7452264-fefc-4f20-b6ab-614983fcfe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:59.936096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7452264-fefc-4f20-b6ab-614983fcfe41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:59.936754 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7452264-fefc-4f20-b6ab-614983fcfe41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:23:59.937054 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7452264-fefc-4f20-b6ab-614983fcfe41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:59.938731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7452264-fefc-4f20-b6ab-614983fcfe41 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:59.954209 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1187/2369] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:23:59.958551 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f555e-1b61-4009-b298-6fc9744b8df3 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:59.976338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f555e-1b61-4009-b298-6fc9744b8df3 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:59.981345 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a60650-765d-4d62-a154-614133da4a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:59.981910 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a60650-765d-4d62-a154-614133da4a53 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:59.982183 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a60650-765d-4d62-a154-614133da4a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:59.982512 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a60650-765d-4d62-a154-614133da4a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:59.984061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a60650-765d-4d62-a154-614133da4a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:59.986455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a60650-765d-4d62-a154-614133da4a53 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:00.023978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1183/2370] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:23:59 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:00.028972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7452264-fefc-4f20-b6ab-614983fcfe41 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:00.039406 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7452264-fefc-4f20-b6ab-614983fcfe41 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:00.115712 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660cc6f-79c7-476e-8fdc-8884d3a575e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:00.116329 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660cc6f-79c7-476e-8fdc-8884d3a575e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.116599 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660cc6f-79c7-476e-8fdc-8884d3a575e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.116861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660cc6f-79c7-476e-8fdc-8884d3a575e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.117545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660cc6f-79c7-476e-8fdc-8884d3a575e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:00.119544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660cc6f-79c7-476e-8fdc-8884d3a575e2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:00.144772 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1188/2371] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:00 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:00.149265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a60650-765d-4d62-a154-614133da4a53 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:00.159674 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a60650-765d-4d62-a154-614133da4a53 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:00.164560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee64a1-cbd3-4dd0-a101-0f88a452fad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:00.165442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee64a1-cbd3-4dd0-a101-0f88a452fad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.165686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee64a1-cbd3-4dd0-a101-0f88a452fad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.165993 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee64a1-cbd3-4dd0-a101-0f88a452fad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.166775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee64a1-cbd3-4dd0-a101-0f88a452fad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:00.169120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee64a1-cbd3-4dd0-a101-0f88a452fad0 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:00.180629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1184/2372] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:00.184557 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660cc6f-79c7-476e-8fdc-8884d3a575e2 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:00.190241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:00.197005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660cc6f-79c7-476e-8fdc-8884d3a575e2 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:00.203608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34135819-955f-414d-8795-50682641037c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:00.204539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34135819-955f-414d-8795-50682641037c admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.204895 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34135819-955f-414d-8795-50682641037c admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.205419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34135819-955f-414d-8795-50682641037c admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.206156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34135819-955f-414d-8795-50682641037c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:00.208308 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34135819-955f-414d-8795-50682641037c admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:00.220199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1189/2373] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:00.224563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee64a1-cbd3-4dd0-a101-0f88a452fad0 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:00.235433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee64a1-cbd3-4dd0-a101-0f88a452fad0 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:00.242068 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c9c23-7d28-4422-8ceb-3d865c53b792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:00.243925 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9c23-7d28-4422-8ceb-3d865c53b792 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.244325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9c23-7d28-4422-8ceb-3d865c53b792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.245813 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9c23-7d28-4422-8ceb-3d865c53b792 admin admin] PATH_INFO: `/v3/projects/ace8226204f241f9aa2d3de72dbc9a92/users/4d04c8647fef490fbc992149f4816ada/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.264921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c9c23-7d28-4422-8ceb-3d865c53b792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace8226204f241f9aa2d3de72dbc9a92, user_id=4d04c8647fef490fbc992149f4816ada, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:00.266709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34135819-955f-414d-8795-50682641037c admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:00.268134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c9c23-7d28-4422-8ceb-3d865c53b792 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:00.268952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-34135819-955f-414d-8795-50682641037c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:00.284110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1185/2374] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:00 2022] PUT /identity/v3/projects/ace8226204f241f9aa2d3de72dbc9a92/users/4d04c8647fef490fbc992149f4816ada/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:00.285850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34135819-955f-414d-8795-50682641037c admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:00.296204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09646e28-d598-44cd-9efb-1b7542e1dac4 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.296480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09646e28-d598-44cd-9efb-1b7542e1dac4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.296749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09646e28-d598-44cd-9efb-1b7542e1dac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.326132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-09646e28-d598-44cd-9efb-1b7542e1dac4 None None] MFA Rules not processed for user `4d04c8647fef490fbc992149f4816ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:00.327351 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-09646e28-d598-44cd-9efb-1b7542e1dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:00.338658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:00.361998 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:00.362831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.363207 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.363572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] PATH_INFO: `/v3/users/cbc13eb415d444debe85eb97b7879749` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.364879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc13eb415d444debe85eb97b7879749)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:00.367076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:00.428532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc13eb415d444debe85eb97b7879749'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:00.434664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1186/2375] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:00.438718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09646e28-d598-44cd-9efb-1b7542e1dac4 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:00.440987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc13eb415d444debe85eb97b7879749'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:00.441814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc13eb415d444debe85eb97b7879749'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:00.451885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc13eb415d444debe85eb97b7879749'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:00.456998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09646e28-d598-44cd-9efb-1b7542e1dac4 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:00.464912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944319e-e075-4cf7-b0e9-fc30c34502b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:00.466492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944319e-e075-4cf7-b0e9-fc30c34502b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.466891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944319e-e075-4cf7-b0e9-fc30c34502b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.467163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944319e-e075-4cf7-b0e9-fc30c34502b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.467342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc13eb415d444debe85eb97b7879749'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:00.468646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944319e-e075-4cf7-b0e9-fc30c34502b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:00.471342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944319e-e075-4cf7-b0e9-fc30c34502b0 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:00.476119 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1190/2376] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:00 2022] DELETE /identity/v3/users/cbc13eb415d444debe85eb97b7879749 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:24:00.512923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1187/2377] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:00 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:00.516949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:00.521737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:00.611923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b73cc0-3243-4644-9728-314f0e41c494 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:00.627896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:00.698124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0528c-c67c-43d2-a12c-a2fb4302e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:00.698777 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0528c-c67c-43d2-a12c-a2fb4302e465 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.699056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0528c-c67c-43d2-a12c-a2fb4302e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.699446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0528c-c67c-43d2-a12c-a2fb4302e465 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.701481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0528c-c67c-43d2-a12c-a2fb4302e465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:00.703644 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0528c-c67c-43d2-a12c-a2fb4302e465 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:00.724949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944319e-e075-4cf7-b0e9-fc30c34502b0 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:00.728739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4944319e-e075-4cf7-b0e9-fc30c34502b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:00.747870 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1191/2378] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:00 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:00.750882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0528c-c67c-43d2-a12c-a2fb4302e465 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:00.758073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944319e-e075-4cf7-b0e9-fc30c34502b0 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:00.771131 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0528c-c67c-43d2-a12c-a2fb4302e465 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:00.777836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bb62b-88d4-49e2-9eb5-60e4f2dd90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:00.778000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bb62b-88d4-49e2-9eb5-60e4f2dd90bb admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.778155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bb62b-88d4-49e2-9eb5-60e4f2dd90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.778854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bb62b-88d4-49e2-9eb5-60e4f2dd90bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.779140 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bb62b-88d4-49e2-9eb5-60e4f2dd90bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:00.780999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bb62b-88d4-49e2-9eb5-60e4f2dd90bb admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:00.793003 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:00.796205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1192/2379] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:24:00.797179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bb62b-88d4-49e2-9eb5-60e4f2dd90bb admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:00.799225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.799523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.799797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] PATH_INFO: `/v3/projects/da592dd9fc5b435cad100ceb6cd9c912` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.801027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] RBAC: Authorizing `identity:delete_project(project_id=da592dd9fc5b435cad100ceb6cd9c912)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:00.802960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:00.810399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bb62b-88d4-49e2-9eb5-60e4f2dd90bb admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:00.815575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41fe61-eb6c-40da-a7b7-f88419df3e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:00.816533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41fe61-eb6c-40da-a7b7-f88419df3e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.816816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41fe61-eb6c-40da-a7b7-f88419df3e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.817090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41fe61-eb6c-40da-a7b7-f88419df3e37 admin admin] PATH_INFO: `/v3/projects/8bd89496e9034ae8808c346ca8b99bf6/users/78d87016ae34456594dcac3ee2cdf8fd/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.834287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41fe61-eb6c-40da-a7b7-f88419df3e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd89496e9034ae8808c346ca8b99bf6, user_id=78d87016ae34456594dcac3ee2cdf8fd, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:00.837167 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41fe61-eb6c-40da-a7b7-f88419df3e37 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:00.852247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1193/2380] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:00 2022] PUT /identity/v3/projects/8bd89496e9034ae8808c346ca8b99bf6/users/78d87016ae34456594dcac3ee2cdf8fd/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:00.856502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41fe61-eb6c-40da-a7b7-f88419df3e37 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:00.861905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da592dd9fc5b435cad100ceb6cd9c912', 'request_id': 'req-5efbf446-d021-49a7-a33e-a9384d3e293a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:00.872592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da592dd9fc5b435cad100ceb6cd9c912', 'request_id': 'req-5efbf446-d021-49a7-a33e-a9384d3e293a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:00.882263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da592dd9fc5b435cad100ceb6cd9c912', 'request_id': 'req-5efbf446-d021-49a7-a33e-a9384d3e293a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:00.895452 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] The token cache is being invalidate because project da592dd9fc5b435cad100ceb6cd9c912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:00.895738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:00.896396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:00.899971 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1188/2381] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:00 2022] DELETE /identity/v3/projects/da592dd9fc5b435cad100ceb6cd9c912 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:24:00.903336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:00.904896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:00.927035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41fe61-eb6c-40da-a7b7-f88419df3e37 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:00.975469 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbf446-d021-49a7-a33e-a9384d3e293a admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:00.980763 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:00.981555 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.982016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.982358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] PATH_INFO: `/v3/users/8b326571262b4faaa4ff17f72e7a8513` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.983515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b326571262b4faaa4ff17f72e7a8513)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:00.985545 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:00.992546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56d8cc-cff7-4601-ade4-94e15773d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:00.993493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56d8cc-cff7-4601-ade4-94e15773d146 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.993843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56d8cc-cff7-4601-ade4-94e15773d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.994121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56d8cc-cff7-4601-ade4-94e15773d146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.994766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56d8cc-cff7-4601-ade4-94e15773d146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:00.996461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56d8cc-cff7-4601-ade4-94e15773d146 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:01.000466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:01.010383 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1194/2382] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:01.012056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56d8cc-cff7-4601-ade4-94e15773d146 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:01.015396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-5f56d8cc-cff7-4601-ade4-94e15773d146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:01.030310 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56d8cc-cff7-4601-ade4-94e15773d146 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:01.036781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a2d94-a341-463f-92b6-eff0c54d72e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:01.037312 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2d94-a341-463f-92b6-eff0c54d72e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:01.037613 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2d94-a341-463f-92b6-eff0c54d72e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:01.037887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2d94-a341-463f-92b6-eff0c54d72e4 admin admin] PATH_INFO: `/v3/projects/8bd89496e9034ae8808c346ca8b99bf6/users/78d87016ae34456594dcac3ee2cdf8fd/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:01.040473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a2d94-a341-463f-92b6-eff0c54d72e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd89496e9034ae8808c346ca8b99bf6, user_id=78d87016ae34456594dcac3ee2cdf8fd, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:01.043687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a2d94-a341-463f-92b6-eff0c54d72e4 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:01.047451 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b326571262b4faaa4ff17f72e7a8513'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:01.065346 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1195/2383] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:01 2022] PUT /identity/v3/projects/8bd89496e9034ae8808c346ca8b99bf6/users/78d87016ae34456594dcac3ee2cdf8fd/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:01.065720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b326571262b4faaa4ff17f72e7a8513'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:01.065892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b326571262b4faaa4ff17f72e7a8513'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:01.066507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b326571262b4faaa4ff17f72e7a8513'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:01.069742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97b8b5-0b3a-41b5-9592-49284d7f90a1 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:01.070161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97b8b5-0b3a-41b5-9592-49284d7f90a1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:01.070334 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97b8b5-0b3a-41b5-9592-49284d7f90a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:01.077446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b326571262b4faaa4ff17f72e7a8513'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:01.081054 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:01.094256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1189/2384] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:00 2022] DELETE /identity/v3/users/8b326571262b4faaa4ff17f72e7a8513 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:01.109091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-eb97b8b5-0b3a-41b5-9592-49284d7f90a1 None None] MFA Rules not processed for user `78d87016ae34456594dcac3ee2cdf8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:01.110332 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-eb97b8b5-0b3a-41b5-9592-49284d7f90a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:01.225299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1196/2385] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:01.231994 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:01.233729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:01.303086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97b8b5-0b3a-41b5-9592-49284d7f90a1 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:01.304654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-eb97b8b5-0b3a-41b5-9592-49284d7f90a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:01.307366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880acc1a-c9d8-421f-8b53-3251187fa9a4 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:01.311091 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9820db-adec-4661-b72f-2072f87305d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:01.312204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9820db-adec-4661-b72f-2072f87305d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:01.312474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9820db-adec-4661-b72f-2072f87305d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:01.312743 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9820db-adec-4661-b72f-2072f87305d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:01.322456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9820db-adec-4661-b72f-2072f87305d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:01.324262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9820db-adec-4661-b72f-2072f87305d6 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:01.334604 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1190/2386] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:01.392996 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97b8b5-0b3a-41b5-9592-49284d7f90a1 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:01.400495 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927e0be-d62d-4743-bcce-7fbfce6ecd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:01.401122 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927e0be-d62d-4743-bcce-7fbfce6ecd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:01.401431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927e0be-d62d-4743-bcce-7fbfce6ecd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:01.401704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927e0be-d62d-4743-bcce-7fbfce6ecd97 admin admin] PATH_INFO: `/v3/projects/c476695077de41fc9b1a0e304e3e6acb` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:01.402839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927e0be-d62d-4743-bcce-7fbfce6ecd97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c476695077de41fc9b1a0e304e3e6acb)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:01.404780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927e0be-d62d-4743-bcce-7fbfce6ecd97 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:01.459742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-5927e0be-d62d-4743-bcce-7fbfce6ecd97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c476695077de41fc9b1a0e304e3e6acb', 'request_id': 'req-5927e0be-d62d-4743-bcce-7fbfce6ecd97'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:01.470907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-5927e0be-d62d-4743-bcce-7fbfce6ecd97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c476695077de41fc9b1a0e304e3e6acb', 'request_id': 'req-5927e0be-d62d-4743-bcce-7fbfce6ecd97'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:01.482393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-5927e0be-d62d-4743-bcce-7fbfce6ecd97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c476695077de41fc9b1a0e304e3e6acb', 'request_id': 'req-5927e0be-d62d-4743-bcce-7fbfce6ecd97'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:01.494215 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-5927e0be-d62d-4743-bcce-7fbfce6ecd97 admin admin] The token cache is being invalidate because project c476695077de41fc9b1a0e304e3e6acb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:01.494503 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-5927e0be-d62d-4743-bcce-7fbfce6ecd97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:01.496014 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-5927e0be-d62d-4743-bcce-7fbfce6ecd97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:01.497569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1197/2387] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:01 2022] DELETE /identity/v3/projects/c476695077de41fc9b1a0e304e3e6acb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:02.806849 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9820db-adec-4661-b72f-2072f87305d6 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:02.808369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0e9820db-adec-4661-b72f-2072f87305d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:02.823063 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9820db-adec-4661-b72f-2072f87305d6 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:02.882096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:02.882731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:02.883000 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:02.883295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] PATH_INFO: `/v3/users/4d04c8647fef490fbc992149f4816ada` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:02.884477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d04c8647fef490fbc992149f4816ada)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:02.886417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:02.924161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:02.941950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d04c8647fef490fbc992149f4816ada'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:02.956174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d04c8647fef490fbc992149f4816ada'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:02.956854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d04c8647fef490fbc992149f4816ada'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:02.957494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d04c8647fef490fbc992149f4816ada'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:02.967268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d04c8647fef490fbc992149f4816ada'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:02.979464 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1191/2388] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:02 2022] DELETE /identity/v3/users/4d04c8647fef490fbc992149f4816ada => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:24:02.984193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bffce8-4629-47c0-992b-8f236516d024 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:02.984690 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bffce8-4629-47c0-992b-8f236516d024 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:02.984799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bffce8-4629-47c0-992b-8f236516d024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:03.004211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d2bffce8-4629-47c0-992b-8f236516d024 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:03.005380 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d2bffce8-4629-47c0-992b-8f236516d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:03.018033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:03.074761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1198/2389] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:03.084795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:03.090339 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:03.176754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cd85f-b133-4bc5-acd1-effd53fdc4c8 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:03.181102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a849a-4bd0-4434-ae74-67fd6b22a184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:03.181740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a849a-4bd0-4434-ae74-67fd6b22a184 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:03.182009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a849a-4bd0-4434-ae74-67fd6b22a184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:03.182277 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a849a-4bd0-4434-ae74-67fd6b22a184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:03.192245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a849a-4bd0-4434-ae74-67fd6b22a184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:03.193715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a849a-4bd0-4434-ae74-67fd6b22a184 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:03.203881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1192/2390] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:03.510556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bffce8-4629-47c0-992b-8f236516d024 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:03.511978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d2bffce8-4629-47c0-992b-8f236516d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:03.524788 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bffce8-4629-47c0-992b-8f236516d024 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:03.529601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:03.530265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:03.530579 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:03.530890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] PATH_INFO: `/v3/projects/ace8226204f241f9aa2d3de72dbc9a92` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:03.531967 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace8226204f241f9aa2d3de72dbc9a92)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:03.533919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:03.605320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace8226204f241f9aa2d3de72dbc9a92', 'request_id': 'req-9765e81f-858d-4f6d-89bd-1773ee6431d1'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.616072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace8226204f241f9aa2d3de72dbc9a92', 'request_id': 'req-9765e81f-858d-4f6d-89bd-1773ee6431d1'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.623451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace8226204f241f9aa2d3de72dbc9a92', 'request_id': 'req-9765e81f-858d-4f6d-89bd-1773ee6431d1'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.635821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] The token cache is being invalidate because project ace8226204f241f9aa2d3de72dbc9a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:03.636107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.636764 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.638325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1199/2391] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:03 2022] DELETE /identity/v3/projects/ace8226204f241f9aa2d3de72dbc9a92 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:24:03.642567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a849a-4bd0-4434-ae74-67fd6b22a184 service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:03.653325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a849a-4bd0-4434-ae74-67fd6b22a184 service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:03.723561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103295c-e911-454c-9e18-898121f5023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:03.724198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103295c-e911-454c-9e18-898121f5023f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:03.724474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103295c-e911-454c-9e18-898121f5023f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:03.724747 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103295c-e911-454c-9e18-898121f5023f admin admin] PATH_INFO: `/v3/users/78d87016ae34456594dcac3ee2cdf8fd` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:03.726013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103295c-e911-454c-9e18-898121f5023f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d87016ae34456594dcac3ee2cdf8fd)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:03.728209 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103295c-e911-454c-9e18-898121f5023f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:03.769912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:03.780935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7103295c-e911-454c-9e18-898121f5023f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d87016ae34456594dcac3ee2cdf8fd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.794532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7103295c-e911-454c-9e18-898121f5023f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d87016ae34456594dcac3ee2cdf8fd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.795242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7103295c-e911-454c-9e18-898121f5023f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d87016ae34456594dcac3ee2cdf8fd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.795848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7103295c-e911-454c-9e18-898121f5023f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d87016ae34456594dcac3ee2cdf8fd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.805749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-7103295c-e911-454c-9e18-898121f5023f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d87016ae34456594dcac3ee2cdf8fd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.818024 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1193/2392] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:03 2022] DELETE /identity/v3/users/78d87016ae34456594dcac3ee2cdf8fd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:04.126542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.128157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:04.145054 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765e81f-858d-4f6d-89bd-1773ee6431d1 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.210822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f813f3-3939-46af-963b-9fc02208f27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.211485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f813f3-3939-46af-963b-9fc02208f27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.211759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f813f3-3939-46af-963b-9fc02208f27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.212062 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f813f3-3939-46af-963b-9fc02208f27d admin admin] PATH_INFO: `/v3/projects/8bd89496e9034ae8808c346ca8b99bf6` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.213237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f813f3-3939-46af-963b-9fc02208f27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd89496e9034ae8808c346ca8b99bf6)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.215142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f813f3-3939-46af-963b-9fc02208f27d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.261139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:04.265682 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-23f813f3-3939-46af-963b-9fc02208f27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd89496e9034ae8808c346ca8b99bf6', 'request_id': 'req-23f813f3-3939-46af-963b-9fc02208f27d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:04.276621 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-23f813f3-3939-46af-963b-9fc02208f27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd89496e9034ae8808c346ca8b99bf6', 'request_id': 'req-23f813f3-3939-46af-963b-9fc02208f27d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:04.283102 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-23f813f3-3939-46af-963b-9fc02208f27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd89496e9034ae8808c346ca8b99bf6', 'request_id': 'req-23f813f3-3939-46af-963b-9fc02208f27d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:04.294558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-23f813f3-3939-46af-963b-9fc02208f27d admin admin] The token cache is being invalidate because project 8bd89496e9034ae8808c346ca8b99bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:04.294838 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-23f813f3-3939-46af-963b-9fc02208f27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:04.295426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-23f813f3-3939-46af-963b-9fc02208f27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:04.296944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1200/2393] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:04 2022] DELETE /identity/v3/projects/8bd89496e9034ae8808c346ca8b99bf6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:04.301831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761615-c930-49a0-a726-508a6cfe257b None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.302112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761615-c930-49a0-a726-508a6cfe257b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.302383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761615-c930-49a0-a726-508a6cfe257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.323341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-34761615-c930-49a0-a726-508a6cfe257b None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:04.324559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-34761615-c930-49a0-a726-508a6cfe257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:04.390996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1194/2394] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:04.404844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187084ba-503c-454b-9d33-ff4f4feaa21e None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.405129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187084ba-503c-454b-9d33-ff4f4feaa21e None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.405457 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187084ba-503c-454b-9d33-ff4f4feaa21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.432871 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-187084ba-503c-454b-9d33-ff4f4feaa21e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:04.434653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-187084ba-503c-454b-9d33-ff4f4feaa21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:04.448426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1201/2395] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:04.454862 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761615-c930-49a0-a726-508a6cfe257b None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.469277 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761615-c930-49a0-a726-508a6cfe257b None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.475768 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6e2c9-d363-42c0-a736-0b9586cd9d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.476371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6e2c9-d363-42c0-a736-0b9586cd9d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.476652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6e2c9-d363-42c0-a736-0b9586cd9d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.476919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6e2c9-d363-42c0-a736-0b9586cd9d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.478008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6e2c9-d363-42c0-a736-0b9586cd9d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:24:04.478313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6e2c9-d363-42c0-a736-0b9586cd9d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.479920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6e2c9-d363-42c0-a736-0b9586cd9d2b admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.492512 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1195/2396] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:24:04.497162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187084ba-503c-454b-9d33-ff4f4feaa21e None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.506794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187084ba-503c-454b-9d33-ff4f4feaa21e None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.512429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578cfb8-6418-4f28-aaf9-206344e3f034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.513045 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578cfb8-6418-4f28-aaf9-206344e3f034 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.513362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578cfb8-6418-4f28-aaf9-206344e3f034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.513629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578cfb8-6418-4f28-aaf9-206344e3f034 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.514264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578cfb8-6418-4f28-aaf9-206344e3f034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.516171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578cfb8-6418-4f28-aaf9-206344e3f034 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.550117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1202/2397] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:04 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:04.554243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6e2c9-d363-42c0-a736-0b9586cd9d2b admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.564477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6e2c9-d363-42c0-a736-0b9586cd9d2b admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.625870 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf953a-8d5a-48b1-965d-d1cfaed204a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.626507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf953a-8d5a-48b1-965d-d1cfaed204a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.626775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf953a-8d5a-48b1-965d-d1cfaed204a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.627022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf953a-8d5a-48b1-965d-d1cfaed204a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.627635 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf953a-8d5a-48b1-965d-d1cfaed204a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.629589 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf953a-8d5a-48b1-965d-d1cfaed204a9 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.653824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1196/2398] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:04 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:04.658171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578cfb8-6418-4f28-aaf9-206344e3f034 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.668624 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578cfb8-6418-4f28-aaf9-206344e3f034 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.673646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdf5a3-7cb2-4993-9bbf-25944827d653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.674244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdf5a3-7cb2-4993-9bbf-25944827d653 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.674515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdf5a3-7cb2-4993-9bbf-25944827d653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.674774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdf5a3-7cb2-4993-9bbf-25944827d653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.675408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdf5a3-7cb2-4993-9bbf-25944827d653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.676978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdf5a3-7cb2-4993-9bbf-25944827d653 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.686847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1203/2399] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:04.690949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf953a-8d5a-48b1-965d-d1cfaed204a9 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.701957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf953a-8d5a-48b1-965d-d1cfaed204a9 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.707315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44739d-36c7-4a3e-9e7e-7d20d10f194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.707907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44739d-36c7-4a3e-9e7e-7d20d10f194e admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.708175 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44739d-36c7-4a3e-9e7e-7d20d10f194e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.708438 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44739d-36c7-4a3e-9e7e-7d20d10f194e admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.709068 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44739d-36c7-4a3e-9e7e-7d20d10f194e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.710707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44739d-36c7-4a3e-9e7e-7d20d10f194e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.721675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1197/2400] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:04.725960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdf5a3-7cb2-4993-9bbf-25944827d653 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.736150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdf5a3-7cb2-4993-9bbf-25944827d653 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.741849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc45621-147a-4eb8-b0a2-52f9d669760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.742513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc45621-147a-4eb8-b0a2-52f9d669760c admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.742903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc45621-147a-4eb8-b0a2-52f9d669760c admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.743177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc45621-147a-4eb8-b0a2-52f9d669760c admin admin] PATH_INFO: `/v3/projects/5c4409400e134ae38e5da92c1f89e238/users/410783021c1549a8bc2c3dfddbf15e1b/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.759342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc45621-147a-4eb8-b0a2-52f9d669760c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4409400e134ae38e5da92c1f89e238, user_id=410783021c1549a8bc2c3dfddbf15e1b, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.762305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc45621-147a-4eb8-b0a2-52f9d669760c admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.778987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1204/2401] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:04 2022] PUT /identity/v3/projects/5c4409400e134ae38e5da92c1f89e238/users/410783021c1549a8bc2c3dfddbf15e1b/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:04.789796 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44417673-5acf-4a91-af41-9c1240980f72 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.790190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44417673-5acf-4a91-af41-9c1240980f72 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.790475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44417673-5acf-4a91-af41-9c1240980f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.820110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-44417673-5acf-4a91-af41-9c1240980f72 None None] MFA Rules not processed for user `410783021c1549a8bc2c3dfddbf15e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:04.821265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-44417673-5acf-4a91-af41-9c1240980f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:04.826621 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:04.889832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1198/2402] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:04.902640 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc45621-147a-4eb8-b0a2-52f9d669760c admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.904574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-6fc45621-147a-4eb8-b0a2-52f9d669760c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:04.971882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc45621-147a-4eb8-b0a2-52f9d669760c admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.976399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf996c0-000a-4414-997b-8274cc48e34f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.977105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf996c0-000a-4414-997b-8274cc48e34f service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.977489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf996c0-000a-4414-997b-8274cc48e34f service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.977751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf996c0-000a-4414-997b-8274cc48e34f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.986793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf996c0-000a-4414-997b-8274cc48e34f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.988285 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf996c0-000a-4414-997b-8274cc48e34f service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.997848 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1205/2403] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:05.019206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44417673-5acf-4a91-af41-9c1240980f72 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:05.089488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44417673-5acf-4a91-af41-9c1240980f72 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:05.094716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:05.095489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:05.095788 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:05.096055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] PATH_INFO: `/v3/users/410783021c1549a8bc2c3dfddbf15e1b` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:05.097318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=410783021c1549a8bc2c3dfddbf15e1b)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:05.099242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:05.150682 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410783021c1549a8bc2c3dfddbf15e1b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:05.162842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410783021c1549a8bc2c3dfddbf15e1b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:05.163559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410783021c1549a8bc2c3dfddbf15e1b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:05.164215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410783021c1549a8bc2c3dfddbf15e1b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:05.173174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410783021c1549a8bc2c3dfddbf15e1b'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:05.186215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1199/2404] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:05 2022] DELETE /identity/v3/users/410783021c1549a8bc2c3dfddbf15e1b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:05.190794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcb4d9-a898-4458-96ec-6eb72abbf7b6 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:05.191305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcb4d9-a898-4458-96ec-6eb72abbf7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:05.191403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcb4d9-a898-4458-96ec-6eb72abbf7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:05.212216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c5dcb4d9-a898-4458-96ec-6eb72abbf7b6 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:05.213524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c5dcb4d9-a898-4458-96ec-6eb72abbf7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:05.279080 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1206/2405] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:05.289259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:05.290949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:05.322172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:05.353697 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a0f2-e899-4f50-9bd2-68e38b44b756 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:05.357571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ad836-a122-411a-b9c4-7f77477414ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:05.358175 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ad836-a122-411a-b9c4-7f77477414ac service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:05.358445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ad836-a122-411a-b9c4-7f77477414ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:05.358707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ad836-a122-411a-b9c4-7f77477414ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:05.370923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ad836-a122-411a-b9c4-7f77477414ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:05.372359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ad836-a122-411a-b9c4-7f77477414ac service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:05.383682 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1200/2406] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:05.822960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcb4d9-a898-4458-96ec-6eb72abbf7b6 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:05.824910 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c5dcb4d9-a898-4458-96ec-6eb72abbf7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:05.840448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcb4d9-a898-4458-96ec-6eb72abbf7b6 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:05.851386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670238c-f30d-48af-bbe8-20e0f70deaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:05.852223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670238c-f30d-48af-bbe8-20e0f70deaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:05.852499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670238c-f30d-48af-bbe8-20e0f70deaea admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:05.852770 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670238c-f30d-48af-bbe8-20e0f70deaea admin admin] PATH_INFO: `/v3/projects/5c4409400e134ae38e5da92c1f89e238` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:05.854052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670238c-f30d-48af-bbe8-20e0f70deaea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4409400e134ae38e5da92c1f89e238)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:05.855965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670238c-f30d-48af-bbe8-20e0f70deaea admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:05.863067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:05.917343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-5670238c-f30d-48af-bbe8-20e0f70deaea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4409400e134ae38e5da92c1f89e238', 'request_id': 'req-5670238c-f30d-48af-bbe8-20e0f70deaea'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:05.925983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-5670238c-f30d-48af-bbe8-20e0f70deaea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4409400e134ae38e5da92c1f89e238', 'request_id': 'req-5670238c-f30d-48af-bbe8-20e0f70deaea'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:05.932948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-5670238c-f30d-48af-bbe8-20e0f70deaea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4409400e134ae38e5da92c1f89e238', 'request_id': 'req-5670238c-f30d-48af-bbe8-20e0f70deaea'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:05.944618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-5670238c-f30d-48af-bbe8-20e0f70deaea admin admin] The token cache is being invalidate because project 5c4409400e134ae38e5da92c1f89e238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:05.945017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-5670238c-f30d-48af-bbe8-20e0f70deaea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:05.946028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-5670238c-f30d-48af-bbe8-20e0f70deaea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:05.947414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1207/2407] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:05 2022] DELETE /identity/v3/projects/5c4409400e134ae38e5da92c1f89e238 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:05.952697 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efb55b-17de-4d97-8f4c-4099162eb035 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:05.953238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efb55b-17de-4d97-8f4c-4099162eb035 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:05.953238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efb55b-17de-4d97-8f4c-4099162eb035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:05.973900 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d8efb55b-17de-4d97-8f4c-4099162eb035 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:05.975202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d8efb55b-17de-4d97-8f4c-4099162eb035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:06.039592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1201/2408] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:06.047607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dfdef-c3b8-4622-a8ae-76fcec0f7067 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.047887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dfdef-c3b8-4622-a8ae-76fcec0f7067 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.048158 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dfdef-c3b8-4622-a8ae-76fcec0f7067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.068950 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-2b7dfdef-c3b8-4622-a8ae-76fcec0f7067 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:06.070251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2b7dfdef-c3b8-4622-a8ae-76fcec0f7067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:06.078856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1208/2409] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:06.083345 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efb55b-17de-4d97-8f4c-4099162eb035 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:06.094376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efb55b-17de-4d97-8f4c-4099162eb035 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:06.099201 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682c40-c945-47ed-820e-b0573cdd3b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:06.099825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682c40-c945-47ed-820e-b0573cdd3b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.100098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682c40-c945-47ed-820e-b0573cdd3b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.100367 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682c40-c945-47ed-820e-b0573cdd3b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.101029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7682c40-c945-47ed-820e-b0573cdd3b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:24:06.101358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7682c40-c945-47ed-820e-b0573cdd3b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:06.102994 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7682c40-c945-47ed-820e-b0573cdd3b7d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:06.115856 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1202/2410] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:24:06.121141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dfdef-c3b8-4622-a8ae-76fcec0f7067 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:06.130874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dfdef-c3b8-4622-a8ae-76fcec0f7067 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:06.135553 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6332453-5dcc-469d-ab84-c5040ee916e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:06.136081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6332453-5dcc-469d-ab84-c5040ee916e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.136355 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6332453-5dcc-469d-ab84-c5040ee916e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.136642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6332453-5dcc-469d-ab84-c5040ee916e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.137243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6332453-5dcc-469d-ab84-c5040ee916e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:06.139149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6332453-5dcc-469d-ab84-c5040ee916e1 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:06.169239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1209/2411] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:06 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:06.173724 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682c40-c945-47ed-820e-b0573cdd3b7d admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:06.185172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682c40-c945-47ed-820e-b0573cdd3b7d admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:06.242585 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44ee2d-de84-476c-aab1-b3f39f0bd483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:06.243237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44ee2d-de84-476c-aab1-b3f39f0bd483 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.243589 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44ee2d-de84-476c-aab1-b3f39f0bd483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.243965 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44ee2d-de84-476c-aab1-b3f39f0bd483 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.244598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44ee2d-de84-476c-aab1-b3f39f0bd483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:06.246565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44ee2d-de84-476c-aab1-b3f39f0bd483 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:06.270017 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1203/2412] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:06 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:06.274400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6332453-5dcc-469d-ab84-c5040ee916e1 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:06.284944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6332453-5dcc-469d-ab84-c5040ee916e1 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:06.290028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786731e4-fbe7-4c19-87a5-f1a06f57c855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:06.291760 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786731e4-fbe7-4c19-87a5-f1a06f57c855 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.292035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786731e4-fbe7-4c19-87a5-f1a06f57c855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.292298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786731e4-fbe7-4c19-87a5-f1a06f57c855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.292935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786731e4-fbe7-4c19-87a5-f1a06f57c855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:06.294564 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786731e4-fbe7-4c19-87a5-f1a06f57c855 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:06.304642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1210/2413] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:06.308792 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44ee2d-de84-476c-aab1-b3f39f0bd483 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:06.319652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44ee2d-de84-476c-aab1-b3f39f0bd483 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:06.325900 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a13f4-7622-43c2-a85b-6edebeae5dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:06.326592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a13f4-7622-43c2-a85b-6edebeae5dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.326870 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a13f4-7622-43c2-a85b-6edebeae5dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.327140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a13f4-7622-43c2-a85b-6edebeae5dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.327794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a13f4-7622-43c2-a85b-6edebeae5dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:06.329408 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a13f4-7622-43c2-a85b-6edebeae5dc7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:06.340848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1204/2414] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:06.345358 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786731e4-fbe7-4c19-87a5-f1a06f57c855 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:06.356119 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786731e4-fbe7-4c19-87a5-f1a06f57c855 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:06.361519 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54689b-186e-4d4c-bff2-0061e9c41cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:06.362214 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54689b-186e-4d4c-bff2-0061e9c41cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.362508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54689b-186e-4d4c-bff2-0061e9c41cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.362909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54689b-186e-4d4c-bff2-0061e9c41cf6 admin admin] PATH_INFO: `/v3/projects/e6d48e0f1fb247989a05c73a1bddee0a/users/8e4cb1c1c96b4c4b8189b3cbbdfd3b46/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.378714 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54689b-186e-4d4c-bff2-0061e9c41cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d48e0f1fb247989a05c73a1bddee0a, user_id=8e4cb1c1c96b4c4b8189b3cbbdfd3b46, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:06.381410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54689b-186e-4d4c-bff2-0061e9c41cf6 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:06.397733 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1211/2415] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:06 2022] PUT /identity/v3/projects/e6d48e0f1fb247989a05c73a1bddee0a/users/8e4cb1c1c96b4c4b8189b3cbbdfd3b46/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:06.409783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37d78a-9fcb-4a12-9b4e-19adcb067a1d None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.410153 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37d78a-9fcb-4a12-9b4e-19adcb067a1d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.410491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37d78a-9fcb-4a12-9b4e-19adcb067a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.440007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-2d37d78a-9fcb-4a12-9b4e-19adcb067a1d None None] MFA Rules not processed for user `8e4cb1c1c96b4c4b8189b3cbbdfd3b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:06.441251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2d37d78a-9fcb-4a12-9b4e-19adcb067a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:06.467899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:06.516468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1205/2416] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:06.521589 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54689b-186e-4d4c-bff2-0061e9c41cf6 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:06.600095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54689b-186e-4d4c-bff2-0061e9c41cf6 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:06.604968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c60d6-d81a-4c8e-88d5-5b81b8894ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:06.605626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c60d6-d81a-4c8e-88d5-5b81b8894ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.605905 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c60d6-d81a-4c8e-88d5-5b81b8894ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.606177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c60d6-d81a-4c8e-88d5-5b81b8894ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.606829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c60d6-d81a-4c8e-88d5-5b81b8894ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:06.608782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c60d6-d81a-4c8e-88d5-5b81b8894ce3 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:06.641586 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1212/2417] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:06 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:06.645764 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37d78a-9fcb-4a12-9b4e-19adcb067a1d None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:06.658748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37d78a-9fcb-4a12-9b4e-19adcb067a1d None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:06.732239 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8551a-0631-4c16-8ec3-fa32e9ff3e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:06.732858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8551a-0631-4c16-8ec3-fa32e9ff3e29 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.733128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8551a-0631-4c16-8ec3-fa32e9ff3e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.733420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8551a-0631-4c16-8ec3-fa32e9ff3e29 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.734088 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8551a-0631-4c16-8ec3-fa32e9ff3e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:06.736065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8551a-0631-4c16-8ec3-fa32e9ff3e29 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:06.761945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1206/2418] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:06 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:06.766001 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c60d6-d81a-4c8e-88d5-5b81b8894ce3 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:06.781099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c60d6-d81a-4c8e-88d5-5b81b8894ce3 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:06.788493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa764c-5a01-4c05-a3d8-161745e35d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:06.789246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa764c-5a01-4c05-a3d8-161745e35d65 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.789567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa764c-5a01-4c05-a3d8-161745e35d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.789888 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa764c-5a01-4c05-a3d8-161745e35d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.790602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa764c-5a01-4c05-a3d8-161745e35d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:06.792335 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa764c-5a01-4c05-a3d8-161745e35d65 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:06.807139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1213/2419] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:06.811223 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8551a-0631-4c16-8ec3-fa32e9ff3e29 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:06.821582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8551a-0631-4c16-8ec3-fa32e9ff3e29 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:06.826336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be458a8b-cdec-4933-b32a-fae1012bbf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:06.827131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be458a8b-cdec-4933-b32a-fae1012bbf6c admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.827318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be458a8b-cdec-4933-b32a-fae1012bbf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.827686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be458a8b-cdec-4933-b32a-fae1012bbf6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.828400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be458a8b-cdec-4933-b32a-fae1012bbf6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:06.830119 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be458a8b-cdec-4933-b32a-fae1012bbf6c admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:06.841249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1207/2420] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:06.845163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa764c-5a01-4c05-a3d8-161745e35d65 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:06.852249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:06.869501 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa764c-5a01-4c05-a3d8-161745e35d65 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:06.874336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce021c5-b715-4497-a793-fb1a48f478c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:06.875009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce021c5-b715-4497-a793-fb1a48f478c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.875290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce021c5-b715-4497-a793-fb1a48f478c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.875894 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce021c5-b715-4497-a793-fb1a48f478c3 admin admin] PATH_INFO: `/v3/projects/2b46711a118848e3b213533bf456a407/users/dfb58cb1c1644d59b9070213a9578aac/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.894315 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce021c5-b715-4497-a793-fb1a48f478c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b46711a118848e3b213533bf456a407, user_id=dfb58cb1c1644d59b9070213a9578aac, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:06.897060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce021c5-b715-4497-a793-fb1a48f478c3 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:06.918577 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1214/2421] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:06 2022] PUT /identity/v3/projects/2b46711a118848e3b213533bf456a407/users/dfb58cb1c1644d59b9070213a9578aac/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:06.928748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242b044-6b4d-4e1f-807c-edb3293413f0 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.929674 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242b044-6b4d-4e1f-807c-edb3293413f0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.930369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242b044-6b4d-4e1f-807c-edb3293413f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.964657 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-b242b044-6b4d-4e1f-807c-edb3293413f0 None None] MFA Rules not processed for user `dfb58cb1c1644d59b9070213a9578aac`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:06.966791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b242b044-6b4d-4e1f-807c-edb3293413f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:07.047647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1208/2422] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:07.052228 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce021c5-b715-4497-a793-fb1a48f478c3 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:07.147575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce021c5-b715-4497-a793-fb1a48f478c3 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:07.152664 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f1583-7df1-4ec9-a86a-a278065ffd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:07.153427 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f1583-7df1-4ec9-a86a-a278065ffd62 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:07.153708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f1583-7df1-4ec9-a86a-a278065ffd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:07.154066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f1583-7df1-4ec9-a86a-a278065ffd62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:07.154763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f1583-7df1-4ec9-a86a-a278065ffd62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:07.156809 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f1583-7df1-4ec9-a86a-a278065ffd62 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:07.194619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1215/2423] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:07 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:07.196116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242b044-6b4d-4e1f-807c-edb3293413f0 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:07.208611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242b044-6b4d-4e1f-807c-edb3293413f0 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:07.241315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:07.274834 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb454e-fcba-4eb2-b658-c6cc71a54c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:07.275768 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb454e-fcba-4eb2-b658-c6cc71a54c23 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:07.276554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb454e-fcba-4eb2-b658-c6cc71a54c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:07.276993 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb454e-fcba-4eb2-b658-c6cc71a54c23 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:07.277853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb454e-fcba-4eb2-b658-c6cc71a54c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:07.280355 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb454e-fcba-4eb2-b658-c6cc71a54c23 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:07.305840 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1209/2424] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:07 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:07.310130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f1583-7df1-4ec9-a86a-a278065ffd62 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:07.346808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f1583-7df1-4ec9-a86a-a278065ffd62 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:07.353087 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb3ff3-809e-4ec7-a302-119331c53455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:07.354070 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb3ff3-809e-4ec7-a302-119331c53455 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:07.354209 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb3ff3-809e-4ec7-a302-119331c53455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:07.354396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb3ff3-809e-4ec7-a302-119331c53455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:07.355222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb3ff3-809e-4ec7-a302-119331c53455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:07.357090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb3ff3-809e-4ec7-a302-119331c53455 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:07.369238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1216/2425] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:07.373334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb454e-fcba-4eb2-b658-c6cc71a54c23 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:07.383819 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb454e-fcba-4eb2-b658-c6cc71a54c23 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:07.389973 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00109679-9bb7-45ac-a9d8-fddadce31f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:07.390763 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00109679-9bb7-45ac-a9d8-fddadce31f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:07.390942 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00109679-9bb7-45ac-a9d8-fddadce31f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:07.391165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00109679-9bb7-45ac-a9d8-fddadce31f63 admin admin] PATH_INFO: `/v3/projects/19b04ab09cc44d06bcbf4fc14b4c0230/users/38e2f596976d4f30b4f6c31b0fb33f12/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:07.410439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00109679-9bb7-45ac-a9d8-fddadce31f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b04ab09cc44d06bcbf4fc14b4c0230, user_id=38e2f596976d4f30b4f6c31b0fb33f12, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:07.413144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00109679-9bb7-45ac-a9d8-fddadce31f63 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:07.429122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1210/2426] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:07 2022] PUT /identity/v3/projects/19b04ab09cc44d06bcbf4fc14b4c0230/users/38e2f596976d4f30b4f6c31b0fb33f12/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:24:07.433327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb3ff3-809e-4ec7-a302-119331c53455 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:07.443544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb3ff3-809e-4ec7-a302-119331c53455 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:07.514453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60205a6b-4835-4cf4-8725-7ad3a8f647d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:07.515084 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60205a6b-4835-4cf4-8725-7ad3a8f647d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:07.515335 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60205a6b-4835-4cf4-8725-7ad3a8f647d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:07.515598 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60205a6b-4835-4cf4-8725-7ad3a8f647d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:07.516268 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60205a6b-4835-4cf4-8725-7ad3a8f647d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:07.517884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60205a6b-4835-4cf4-8725-7ad3a8f647d0 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:07.531272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1217/2427] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:07.532483 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00109679-9bb7-45ac-a9d8-fddadce31f63 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:07.543038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00109679-9bb7-45ac-a9d8-fddadce31f63 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:07.548441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5cf03-db97-4ef6-9c95-eae31be2d09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:07.549107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5cf03-db97-4ef6-9c95-eae31be2d09a admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:07.549418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5cf03-db97-4ef6-9c95-eae31be2d09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:07.549887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5cf03-db97-4ef6-9c95-eae31be2d09a admin admin] PATH_INFO: `/v3/projects/19b04ab09cc44d06bcbf4fc14b4c0230/users/38e2f596976d4f30b4f6c31b0fb33f12/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:07.551804 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5cf03-db97-4ef6-9c95-eae31be2d09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b04ab09cc44d06bcbf4fc14b4c0230, user_id=38e2f596976d4f30b4f6c31b0fb33f12, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:07.554496 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5cf03-db97-4ef6-9c95-eae31be2d09a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:07.565962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1211/2428] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:07 2022] PUT /identity/v3/projects/19b04ab09cc44d06bcbf4fc14b4c0230/users/38e2f596976d4f30b4f6c31b0fb33f12/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:07.577998 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1b5f9-80d4-48f5-bf69-7b4d951221d9 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:07.578321 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1b5f9-80d4-48f5-bf69-7b4d951221d9 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:07.578598 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1b5f9-80d4-48f5-bf69-7b4d951221d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:07.612850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-5dc1b5f9-80d4-48f5-bf69-7b4d951221d9 None None] MFA Rules not processed for user `38e2f596976d4f30b4f6c31b0fb33f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:07.614120 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-5dc1b5f9-80d4-48f5-bf69-7b4d951221d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:07.657704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:07.690497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1218/2429] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:07.702560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5cf03-db97-4ef6-9c95-eae31be2d09a admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:07.704403 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4bf5cf03-db97-4ef6-9c95-eae31be2d09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:07.793039 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5cf03-db97-4ef6-9c95-eae31be2d09a admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:07.796905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b50f54-e458-43fa-b969-deecd44308f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:07.797552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b50f54-e458-43fa-b969-deecd44308f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:07.797826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b50f54-e458-43fa-b969-deecd44308f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:07.798094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b50f54-e458-43fa-b969-deecd44308f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:07.856574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b50f54-e458-43fa-b969-deecd44308f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:07.858080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b50f54-e458-43fa-b969-deecd44308f3 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:07.867368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1212/2430] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:09.506468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1b5f9-80d4-48f5-bf69-7b4d951221d9 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:09.508033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-5dc1b5f9-80d4-48f5-bf69-7b4d951221d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:09.521237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1b5f9-80d4-48f5-bf69-7b4d951221d9 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:09.525778 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35711ea3-e3c9-4b2b-b6f1-6e35670a2734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:09.526391 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35711ea3-e3c9-4b2b-b6f1-6e35670a2734 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:09.526669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35711ea3-e3c9-4b2b-b6f1-6e35670a2734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:09.526935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35711ea3-e3c9-4b2b-b6f1-6e35670a2734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:09.591781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35711ea3-e3c9-4b2b-b6f1-6e35670a2734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:09.593238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35711ea3-e3c9-4b2b-b6f1-6e35670a2734 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:09.602900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1219/2431] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:10.182175 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b50f54-e458-43fa-b969-deecd44308f3 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:10.195608 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b50f54-e458-43fa-b969-deecd44308f3 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:10.200318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0e0ad-52cf-47c1-8bca-d69d614cdf72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:10.200930 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0e0ad-52cf-47c1-8bca-d69d614cdf72 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:10.201226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0e0ad-52cf-47c1-8bca-d69d614cdf72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:10.201495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0e0ad-52cf-47c1-8bca-d69d614cdf72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:10.211811 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0e0ad-52cf-47c1-8bca-d69d614cdf72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:10.213337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0e0ad-52cf-47c1-8bca-d69d614cdf72 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:10.223117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1213/2432] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:10.753418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52686-2bbc-4fe6-83af-b149ee7edf36 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:10.753888 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52686-2bbc-4fe6-83af-b149ee7edf36 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:10.753996 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52686-2bbc-4fe6-83af-b149ee7edf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:10.785378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-1bf52686-2bbc-4fe6-83af-b149ee7edf36 None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:10.786596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1bf52686-2bbc-4fe6-83af-b149ee7edf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:10.848681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1220/2433] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:24:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:10.899448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0e0ad-52cf-47c1-8bca-d69d614cdf72 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:10.900968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-75c0e0ad-52cf-47c1-8bca-d69d614cdf72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:10.917377 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:10.992803 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0e0ad-52cf-47c1-8bca-d69d614cdf72 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:11.000936 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cccfdb-b662-4a83-b732-8502d55f5e2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:11.001582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cccfdb-b662-4a83-b732-8502d55f5e2c service swift] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:11.001853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cccfdb-b662-4a83-b732-8502d55f5e2c service swift] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:11.002113 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cccfdb-b662-4a83-b732-8502d55f5e2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:11.011834 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cccfdb-b662-4a83-b732-8502d55f5e2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:11.013471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cccfdb-b662-4a83-b732-8502d55f5e2c service swift] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:11.021939 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1214/2434] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:24:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:24:14.370700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf52686-2bbc-4fe6-83af-b149ee7edf36 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:14.452959 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf52686-2bbc-4fe6-83af-b149ee7edf36 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:14.458588 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:14.459333 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:14.459681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:14.460141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] PATH_INFO: `/v3/users/8e4cb1c1c96b4c4b8189b3cbbdfd3b46` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:14.461406 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e4cb1c1c96b4c4b8189b3cbbdfd3b46)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:14.464468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:14.476326 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:14.532580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e4cb1c1c96b4c4b8189b3cbbdfd3b46'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:14.543192 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e4cb1c1c96b4c4b8189b3cbbdfd3b46'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:14.544066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e4cb1c1c96b4c4b8189b3cbbdfd3b46'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:14.552834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e4cb1c1c96b4c4b8189b3cbbdfd3b46'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:14.568835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e4cb1c1c96b4c4b8189b3cbbdfd3b46'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:14.577732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1221/2435] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:14 2022] DELETE /identity/v3/users/8e4cb1c1c96b4c4b8189b3cbbdfd3b46 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:14.582224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76defb-45c6-4676-af87-e8bd6db1eaa0 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:14.583157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76defb-45c6-4676-af87-e8bd6db1eaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:14.583825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76defb-45c6-4676-af87-e8bd6db1eaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:14.604899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-de76defb-45c6-4676-af87-e8bd6db1eaa0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:14.606035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-de76defb-45c6-4676-af87-e8bd6db1eaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:14.674442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1215/2436] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:14.684077 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:14.685678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:14.760269 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6b9df-8c13-4d3b-81a3-f29d023b8dd9 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:14.764546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23193a-5a42-4658-8200-f9e3b7670a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:14.765325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23193a-5a42-4658-8200-f9e3b7670a74 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:14.765632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23193a-5a42-4658-8200-f9e3b7670a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:14.765859 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23193a-5a42-4658-8200-f9e3b7670a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:14.778129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23193a-5a42-4658-8200-f9e3b7670a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:14.779581 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23193a-5a42-4658-8200-f9e3b7670a74 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:14.791068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1222/2437] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:24:15.128138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76defb-45c6-4676-af87-e8bd6db1eaa0 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:15.130080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-de76defb-45c6-4676-af87-e8bd6db1eaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:15.153647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76defb-45c6-4676-af87-e8bd6db1eaa0 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:15.168738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:15.169570 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:15.169960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:15.170316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] PATH_INFO: `/v3/projects/e6d48e0f1fb247989a05c73a1bddee0a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:15.171599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d48e0f1fb247989a05c73a1bddee0a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:15.174243 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:15.238237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d48e0f1fb247989a05c73a1bddee0a', 'request_id': 'req-4093002d-c154-4794-8706-3faf7a924b4e'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:15.247922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d48e0f1fb247989a05c73a1bddee0a', 'request_id': 'req-4093002d-c154-4794-8706-3faf7a924b4e'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:15.257694 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d48e0f1fb247989a05c73a1bddee0a', 'request_id': 'req-4093002d-c154-4794-8706-3faf7a924b4e'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:15.272532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] The token cache is being invalidate because project e6d48e0f1fb247989a05c73a1bddee0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:15.272848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:15.273603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:15.275272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1216/2438] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:15 2022] DELETE /identity/v3/projects/e6d48e0f1fb247989a05c73a1bddee0a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:24:15.279515 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23193a-5a42-4658-8200-f9e3b7670a74 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:15.290488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23193a-5a42-4658-8200-f9e3b7670a74 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:15.351535 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:15.352265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:15.352615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:15.353469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] PATH_INFO: `/v3/users/dfb58cb1c1644d59b9070213a9578aac` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:15.354860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb58cb1c1644d59b9070213a9578aac)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:15.356932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:15.395496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:15.425564 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb58cb1c1644d59b9070213a9578aac'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:15.438487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb58cb1c1644d59b9070213a9578aac'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:15.439404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb58cb1c1644d59b9070213a9578aac'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:15.448693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb58cb1c1644d59b9070213a9578aac'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:15.464085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb58cb1c1644d59b9070213a9578aac'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:15.473594 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1223/2439] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:15 2022] DELETE /identity/v3/users/dfb58cb1c1644d59b9070213a9578aac => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:15.813495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:15.815831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:15.839370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093002d-c154-4794-8706-3faf7a924b4e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:15.867244 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:15.917610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:15.918261 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:15.918530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:15.918800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] PATH_INFO: `/v3/projects/2b46711a118848e3b213533bf456a407` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:15.919944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b46711a118848e3b213533bf456a407)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:15.921982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:15.985504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b46711a118848e3b213533bf456a407', 'request_id': 'req-32ab8200-c43b-4202-8d6e-a220614145fc'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:15.998466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b46711a118848e3b213533bf456a407', 'request_id': 'req-32ab8200-c43b-4202-8d6e-a220614145fc'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.009378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b46711a118848e3b213533bf456a407', 'request_id': 'req-32ab8200-c43b-4202-8d6e-a220614145fc'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.027343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] The token cache is being invalidate because project 2b46711a118848e3b213533bf456a407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:16.027963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.029002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.033266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1217/2440] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:15 2022] DELETE /identity/v3/projects/2b46711a118848e3b213533bf456a407 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:16.034992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:16.036748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:16.051234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed03573-171e-4e72-b5e7-369d7ee7e4af admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:16.141410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad8c76-c4d7-4448-9abf-cd0a3a933f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:16.142199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad8c76-c4d7-4448-9abf-cd0a3a933f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:16.142480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad8c76-c4d7-4448-9abf-cd0a3a933f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:16.142748 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad8c76-c4d7-4448-9abf-cd0a3a933f6f admin admin] PATH_INFO: `/v3/users/38e2f596976d4f30b4f6c31b0fb33f12` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:16.144239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad8c76-c4d7-4448-9abf-cd0a3a933f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e2f596976d4f30b4f6c31b0fb33f12)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:16.146317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad8c76-c4d7-4448-9abf-cd0a3a933f6f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:16.207426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-daad8c76-c4d7-4448-9abf-cd0a3a933f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e2f596976d4f30b4f6c31b0fb33f12'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.217868 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-daad8c76-c4d7-4448-9abf-cd0a3a933f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e2f596976d4f30b4f6c31b0fb33f12'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.218616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-daad8c76-c4d7-4448-9abf-cd0a3a933f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e2f596976d4f30b4f6c31b0fb33f12'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.229102 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-daad8c76-c4d7-4448-9abf-cd0a3a933f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e2f596976d4f30b4f6c31b0fb33f12'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.245947 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-daad8c76-c4d7-4448-9abf-cd0a3a933f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e2f596976d4f30b4f6c31b0fb33f12'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.255244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1224/2441] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:16 2022] DELETE /identity/v3/users/38e2f596976d4f30b4f6c31b0fb33f12 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:16.611387 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:16.613119 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:16.658259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab8200-c43b-4202-8d6e-a220614145fc admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:16.746208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1643622-096e-4a42-92a4-bcb745bf90e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:16.746884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1643622-096e-4a42-92a4-bcb745bf90e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:16.748036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1643622-096e-4a42-92a4-bcb745bf90e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:16.748036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1643622-096e-4a42-92a4-bcb745bf90e6 admin admin] PATH_INFO: `/v3/projects/19b04ab09cc44d06bcbf4fc14b4c0230` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:16.751631 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1643622-096e-4a42-92a4-bcb745bf90e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b04ab09cc44d06bcbf4fc14b4c0230)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:16.753673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1643622-096e-4a42-92a4-bcb745bf90e6 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:16.840137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e1643622-096e-4a42-92a4-bcb745bf90e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b04ab09cc44d06bcbf4fc14b4c0230', 'request_id': 'req-e1643622-096e-4a42-92a4-bcb745bf90e6'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.844410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:16.866982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e1643622-096e-4a42-92a4-bcb745bf90e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b04ab09cc44d06bcbf4fc14b4c0230', 'request_id': 'req-e1643622-096e-4a42-92a4-bcb745bf90e6'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.874612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e1643622-096e-4a42-92a4-bcb745bf90e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b04ab09cc44d06bcbf4fc14b4c0230', 'request_id': 'req-e1643622-096e-4a42-92a4-bcb745bf90e6'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.885917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e1643622-096e-4a42-92a4-bcb745bf90e6 admin admin] The token cache is being invalidate because project 19b04ab09cc44d06bcbf4fc14b4c0230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:16.886206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e1643622-096e-4a42-92a4-bcb745bf90e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.886935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e1643622-096e-4a42-92a4-bcb745bf90e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.888452 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1218/2442] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:16 2022] DELETE /identity/v3/projects/19b04ab09cc44d06bcbf4fc14b4c0230 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:16.894443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384d0d2-6ef6-4b0f-8334-31d5938b18a4 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:16.894981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384d0d2-6ef6-4b0f-8334-31d5938b18a4 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:16.895082 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384d0d2-6ef6-4b0f-8334-31d5938b18a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:16.917268 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-f384d0d2-6ef6-4b0f-8334-31d5938b18a4 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:16.918574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f384d0d2-6ef6-4b0f-8334-31d5938b18a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:16.945154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:16.999066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1225/2443] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:17.004891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93295bf8-bd75-4e4a-8462-f57772b12305 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.005306 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93295bf8-bd75-4e4a-8462-f57772b12305 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.005588 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93295bf8-bd75-4e4a-8462-f57772b12305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.028827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-93295bf8-bd75-4e4a-8462-f57772b12305 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:17.029998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-93295bf8-bd75-4e4a-8462-f57772b12305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:17.040870 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1219/2444] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:17.043636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384d0d2-6ef6-4b0f-8334-31d5938b18a4 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:17.055092 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384d0d2-6ef6-4b0f-8334-31d5938b18a4 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:17.062687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204eac0-2d6c-442f-b88f-886db013d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:17.063460 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204eac0-2d6c-442f-b88f-886db013d431 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.063850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204eac0-2d6c-442f-b88f-886db013d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.064341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204eac0-2d6c-442f-b88f-886db013d431 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.065269 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204eac0-2d6c-442f-b88f-886db013d431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:24:17.066377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204eac0-2d6c-442f-b88f-886db013d431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:17.067887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204eac0-2d6c-442f-b88f-886db013d431 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:17.088689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1226/2445] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:24:17.095229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93295bf8-bd75-4e4a-8462-f57772b12305 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:17.106008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93295bf8-bd75-4e4a-8462-f57772b12305 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:17.111845 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667898f2-2295-4f12-a566-149ee6827fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:17.112468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667898f2-2295-4f12-a566-149ee6827fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.112742 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667898f2-2295-4f12-a566-149ee6827fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.113012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667898f2-2295-4f12-a566-149ee6827fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.113819 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667898f2-2295-4f12-a566-149ee6827fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:17.115739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667898f2-2295-4f12-a566-149ee6827fd1 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:17.157130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1220/2446] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:17 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:17.158594 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204eac0-2d6c-442f-b88f-886db013d431 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:17.177568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204eac0-2d6c-442f-b88f-886db013d431 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:17.246788 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ac811-53bc-4d4a-a6a3-537f6ee6beaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:17.247793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ac811-53bc-4d4a-a6a3-537f6ee6beaf admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.248072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ac811-53bc-4d4a-a6a3-537f6ee6beaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.248531 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ac811-53bc-4d4a-a6a3-537f6ee6beaf admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.249417 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ac811-53bc-4d4a-a6a3-537f6ee6beaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:17.252373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ac811-53bc-4d4a-a6a3-537f6ee6beaf admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:17.291625 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1227/2447] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:17 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:17.292936 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667898f2-2295-4f12-a566-149ee6827fd1 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:17.306628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667898f2-2295-4f12-a566-149ee6827fd1 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:17.312202 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6466855-8569-4d7a-9c1e-4ce3226504c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:17.312828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6466855-8569-4d7a-9c1e-4ce3226504c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.313101 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6466855-8569-4d7a-9c1e-4ce3226504c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.313424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6466855-8569-4d7a-9c1e-4ce3226504c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.314055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6466855-8569-4d7a-9c1e-4ce3226504c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:17.315675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6466855-8569-4d7a-9c1e-4ce3226504c6 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:17.337300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1221/2448] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:17.340738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ac811-53bc-4d4a-a6a3-537f6ee6beaf admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:17.351561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ac811-53bc-4d4a-a6a3-537f6ee6beaf admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:17.356722 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6e3cb-a341-4643-afb6-10d0505fb76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:17.357449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6e3cb-a341-4643-afb6-10d0505fb76a admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.357785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6e3cb-a341-4643-afb6-10d0505fb76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.358141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6e3cb-a341-4643-afb6-10d0505fb76a admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.358847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6e3cb-a341-4643-afb6-10d0505fb76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:17.360498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6e3cb-a341-4643-afb6-10d0505fb76a admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:17.374659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1228/2449] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:17.379010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6466855-8569-4d7a-9c1e-4ce3226504c6 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:17.390297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6466855-8569-4d7a-9c1e-4ce3226504c6 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:17.395691 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde08ec-460f-4646-bd1b-98ec026d6fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:17.396357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde08ec-460f-4646-bd1b-98ec026d6fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.396637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde08ec-460f-4646-bd1b-98ec026d6fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.396910 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde08ec-460f-4646-bd1b-98ec026d6fd3 admin admin] PATH_INFO: `/v3/projects/b76362a40ce54fefbeb56c3c257975b9/users/b1f764e7a9994fb6a3433817aed09a28/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.414154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde08ec-460f-4646-bd1b-98ec026d6fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76362a40ce54fefbeb56c3c257975b9, user_id=b1f764e7a9994fb6a3433817aed09a28, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:17.416896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde08ec-460f-4646-bd1b-98ec026d6fd3 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:17.431528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1222/2450] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:17 2022] PUT /identity/v3/projects/b76362a40ce54fefbeb56c3c257975b9/users/b1f764e7a9994fb6a3433817aed09a28/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:17.442319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dbe3f-e444-44b2-b69a-1903bf255875 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.442660 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dbe3f-e444-44b2-b69a-1903bf255875 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.442993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dbe3f-e444-44b2-b69a-1903bf255875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.477096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e15dbe3f-e444-44b2-b69a-1903bf255875 None None] MFA Rules not processed for user `b1f764e7a9994fb6a3433817aed09a28`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:17.478972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e15dbe3f-e444-44b2-b69a-1903bf255875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:17.574708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1229/2451] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:17.579614 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde08ec-460f-4646-bd1b-98ec026d6fd3 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:17.665748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde08ec-460f-4646-bd1b-98ec026d6fd3 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:17.671640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf82b77-a0c8-47f6-b1eb-1e2b7b75e514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:17.672258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf82b77-a0c8-47f6-b1eb-1e2b7b75e514 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.672534 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf82b77-a0c8-47f6-b1eb-1e2b7b75e514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.672806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf82b77-a0c8-47f6-b1eb-1e2b7b75e514 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.673481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf82b77-a0c8-47f6-b1eb-1e2b7b75e514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:17.675402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf82b77-a0c8-47f6-b1eb-1e2b7b75e514 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:17.707315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1223/2452] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:17 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:24:17.711356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dbe3f-e444-44b2-b69a-1903bf255875 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:17.727344 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dbe3f-e444-44b2-b69a-1903bf255875 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:17.748423 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:17.800325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27cd71-1db7-4d4e-b57c-3af4177634e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:17.801306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27cd71-1db7-4d4e-b57c-3af4177634e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.801728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27cd71-1db7-4d4e-b57c-3af4177634e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.802144 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27cd71-1db7-4d4e-b57c-3af4177634e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.803105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27cd71-1db7-4d4e-b57c-3af4177634e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:17.805026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27cd71-1db7-4d4e-b57c-3af4177634e4 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:17.837668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1230/2453] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:17 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:17.838740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf82b77-a0c8-47f6-b1eb-1e2b7b75e514 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:17.852008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf82b77-a0c8-47f6-b1eb-1e2b7b75e514 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:17.857164 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601653ba-426b-42ad-9659-ae2f3967996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:17.857808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601653ba-426b-42ad-9659-ae2f3967996d admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.858082 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601653ba-426b-42ad-9659-ae2f3967996d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.858354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601653ba-426b-42ad-9659-ae2f3967996d admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.859002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601653ba-426b-42ad-9659-ae2f3967996d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:17.860598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601653ba-426b-42ad-9659-ae2f3967996d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:17.872831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1224/2454] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:17.877557 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27cd71-1db7-4d4e-b57c-3af4177634e4 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:17.902855 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27cd71-1db7-4d4e-b57c-3af4177634e4 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:17.915051 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3a9d2-8428-4d2b-b8ea-98d1cfea161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:17.916091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3a9d2-8428-4d2b-b8ea-98d1cfea161f admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.916435 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3a9d2-8428-4d2b-b8ea-98d1cfea161f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.916774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3a9d2-8428-4d2b-b8ea-98d1cfea161f admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.917600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3a9d2-8428-4d2b-b8ea-98d1cfea161f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:17.919356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3a9d2-8428-4d2b-b8ea-98d1cfea161f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:17.936496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1231/2455] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:24:17.940978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601653ba-426b-42ad-9659-ae2f3967996d admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:17.952421 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601653ba-426b-42ad-9659-ae2f3967996d admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:17.958575 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4c77a-dbef-4bee-ba4b-cf62fb8590d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:17.959388 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4c77a-dbef-4bee-ba4b-cf62fb8590d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.959761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4c77a-dbef-4bee-ba4b-cf62fb8590d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.960127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4c77a-dbef-4bee-ba4b-cf62fb8590d3 admin admin] PATH_INFO: `/v3/projects/c733338c97f6408693e96aaf3bbffccc/users/136aa3f896bf4f60ab70f7e21adb115b/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.979734 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4c77a-dbef-4bee-ba4b-cf62fb8590d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c733338c97f6408693e96aaf3bbffccc, user_id=136aa3f896bf4f60ab70f7e21adb115b, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:17.982623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4c77a-dbef-4bee-ba4b-cf62fb8590d3 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:18.005962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1225/2456] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:17 2022] PUT /identity/v3/projects/c733338c97f6408693e96aaf3bbffccc/users/136aa3f896bf4f60ab70f7e21adb115b/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:18.019619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a3e74-4880-438b-9d38-e1a7e56fae92 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:18.020007 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a3e74-4880-438b-9d38-e1a7e56fae92 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:18.020381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a3e74-4880-438b-9d38-e1a7e56fae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:18.064760 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-049a3e74-4880-438b-9d38-e1a7e56fae92 None None] MFA Rules not processed for user `136aa3f896bf4f60ab70f7e21adb115b`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:18.066968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-049a3e74-4880-438b-9d38-e1a7e56fae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:18.159945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1232/2457] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:18.164135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4c77a-dbef-4bee-ba4b-cf62fb8590d3 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:18.199222 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:18.238007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4c77a-dbef-4bee-ba4b-cf62fb8590d3 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:18.242870 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dd33e-dcdd-432f-9002-b6d01bd3e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:18.243553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dd33e-dcdd-432f-9002-b6d01bd3e513 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:18.243854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dd33e-dcdd-432f-9002-b6d01bd3e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:18.244322 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dd33e-dcdd-432f-9002-b6d01bd3e513 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:18.245069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dd33e-dcdd-432f-9002-b6d01bd3e513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:18.247027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dd33e-dcdd-432f-9002-b6d01bd3e513 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:18.282420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1226/2458] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:18 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:24:18.286538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a3e74-4880-438b-9d38-e1a7e56fae92 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:18.301078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a3e74-4880-438b-9d38-e1a7e56fae92 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:18.371264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209885e3-191c-49d0-b665-a1c1c6309874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:18.371798 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209885e3-191c-49d0-b665-a1c1c6309874 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:18.372076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209885e3-191c-49d0-b665-a1c1c6309874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:18.372342 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209885e3-191c-49d0-b665-a1c1c6309874 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:18.373171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209885e3-191c-49d0-b665-a1c1c6309874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:18.375261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209885e3-191c-49d0-b665-a1c1c6309874 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:18.404665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1233/2459] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:18 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:24:18.408682 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dd33e-dcdd-432f-9002-b6d01bd3e513 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:18.423409 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dd33e-dcdd-432f-9002-b6d01bd3e513 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:18.429295 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7825f-6fec-48c8-a641-2c3687f15558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:18.429983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7825f-6fec-48c8-a641-2c3687f15558 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:18.430313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7825f-6fec-48c8-a641-2c3687f15558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:18.430644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7825f-6fec-48c8-a641-2c3687f15558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:18.431573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7825f-6fec-48c8-a641-2c3687f15558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:18.433283 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7825f-6fec-48c8-a641-2c3687f15558 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:18.450100 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1227/2460] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:18.454544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209885e3-191c-49d0-b665-a1c1c6309874 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:18.465402 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209885e3-191c-49d0-b665-a1c1c6309874 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:18.471322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd349d07-f7a1-4308-a06e-36d868c26ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:18.472006 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd349d07-f7a1-4308-a06e-36d868c26ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:18.472285 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd349d07-f7a1-4308-a06e-36d868c26ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:18.472557 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd349d07-f7a1-4308-a06e-36d868c26ad5 admin admin] PATH_INFO: `/v3/projects/59722b613a0848658042d222bc363ee6/users/ca2357611fc34c1789d1633a0bef951b/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:18.496514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd349d07-f7a1-4308-a06e-36d868c26ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59722b613a0848658042d222bc363ee6, user_id=ca2357611fc34c1789d1633a0bef951b, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:18.501102 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd349d07-f7a1-4308-a06e-36d868c26ad5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:18.503341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:18.524412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1234/2461] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:18 2022] PUT /identity/v3/projects/59722b613a0848658042d222bc363ee6/users/ca2357611fc34c1789d1633a0bef951b/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:18.526018 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7825f-6fec-48c8-a641-2c3687f15558 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:18.537422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7825f-6fec-48c8-a641-2c3687f15558 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:18.607653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7e6eb-51b4-4aac-be1a-16cc31b929d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:18.608381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e6eb-51b4-4aac-be1a-16cc31b929d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:18.608751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e6eb-51b4-4aac-be1a-16cc31b929d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:18.609025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e6eb-51b4-4aac-be1a-16cc31b929d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:18.609722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7e6eb-51b4-4aac-be1a-16cc31b929d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:18.611354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7e6eb-51b4-4aac-be1a-16cc31b929d8 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:18.622793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1228/2462] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:18.627121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd349d07-f7a1-4308-a06e-36d868c26ad5 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:18.638436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd349d07-f7a1-4308-a06e-36d868c26ad5 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:18.643193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e07b6-2bed-4c6c-91f1-2104efe8d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:18.644277 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e07b6-2bed-4c6c-91f1-2104efe8d9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:18.644617 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e07b6-2bed-4c6c-91f1-2104efe8d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:18.644956 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e07b6-2bed-4c6c-91f1-2104efe8d9e5 admin admin] PATH_INFO: `/v3/projects/59722b613a0848658042d222bc363ee6/users/ca2357611fc34c1789d1633a0bef951b/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:18.647000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e07b6-2bed-4c6c-91f1-2104efe8d9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59722b613a0848658042d222bc363ee6, user_id=ca2357611fc34c1789d1633a0bef951b, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:18.649779 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e07b6-2bed-4c6c-91f1-2104efe8d9e5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:18.661483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1235/2463] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:18 2022] PUT /identity/v3/projects/59722b613a0848658042d222bc363ee6/users/ca2357611fc34c1789d1633a0bef951b/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:18.673439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc387d-447a-41e8-b64b-bfd2d664f3cb None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:18.673762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc387d-447a-41e8-b64b-bfd2d664f3cb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:18.673988 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc387d-447a-41e8-b64b-bfd2d664f3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:18.704240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d0cc387d-447a-41e8-b64b-bfd2d664f3cb None None] MFA Rules not processed for user `ca2357611fc34c1789d1633a0bef951b`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:18.705120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d0cc387d-447a-41e8-b64b-bfd2d664f3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:18.807118 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1229/2464] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:18.815906 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e07b6-2bed-4c6c-91f1-2104efe8d9e5 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:18.817989 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-947e07b6-2bed-4c6c-91f1-2104efe8d9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:18.888979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e07b6-2bed-4c6c-91f1-2104efe8d9e5 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:18.895489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd40f3a-5723-4009-bab5-6e2c24843b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:18.896672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd40f3a-5723-4009-bab5-6e2c24843b09 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:18.897108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd40f3a-5723-4009-bab5-6e2c24843b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:18.897683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd40f3a-5723-4009-bab5-6e2c24843b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:18.973570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd40f3a-5723-4009-bab5-6e2c24843b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:18.975724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd40f3a-5723-4009-bab5-6e2c24843b09 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:18.987105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1236/2465] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:20.582265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc387d-447a-41e8-b64b-bfd2d664f3cb None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:20.583654 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d0cc387d-447a-41e8-b64b-bfd2d664f3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:20.595870 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc387d-447a-41e8-b64b-bfd2d664f3cb None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:20.599319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430229c-1282-47b8-bf95-210490716424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:20.599903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430229c-1282-47b8-bf95-210490716424 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:20.600154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430229c-1282-47b8-bf95-210490716424 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:20.600521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430229c-1282-47b8-bf95-210490716424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:20.621638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:20.670068 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430229c-1282-47b8-bf95-210490716424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:20.671525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430229c-1282-47b8-bf95-210490716424 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:20.682333 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1230/2466] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:21.261171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd40f3a-5723-4009-bab5-6e2c24843b09 service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:21.270990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd40f3a-5723-4009-bab5-6e2c24843b09 service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:21.275448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57077283-ea57-4e54-bec9-b6e986a6e0eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:21.276106 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57077283-ea57-4e54-bec9-b6e986a6e0eb service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:21.276635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57077283-ea57-4e54-bec9-b6e986a6e0eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:21.276909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57077283-ea57-4e54-bec9-b6e986a6e0eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:21.286835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57077283-ea57-4e54-bec9-b6e986a6e0eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:21.288481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57077283-ea57-4e54-bec9-b6e986a6e0eb service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:21.299033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1237/2467] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:24:23.899746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430229c-1282-47b8-bf95-210490716424 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:23.901447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f430229c-1282-47b8-bf95-210490716424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:24.017164 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430229c-1282-47b8-bf95-210490716424 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:24.023875 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecd276-647a-4282-bbe2-df8e48f9d498 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227f958b82a446e19a4d5b29d74193bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:24.024608 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecd276-647a-4282-bbe2-df8e48f9d498 service placement] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:24.024988 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecd276-647a-4282-bbe2-df8e48f9d498 service placement] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:24.026009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecd276-647a-4282-bbe2-df8e48f9d498 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:24.028383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-54ecd276-647a-4282-bbe2-df8e48f9d498 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:24.042925 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecd276-647a-4282-bbe2-df8e48f9d498 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:24.044525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecd276-647a-4282-bbe2-df8e48f9d498 service placement] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:24.064814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1231/2468] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:25.318012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57077283-ea57-4e54-bec9-b6e986a6e0eb service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:25.403999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57077283-ea57-4e54-bec9-b6e986a6e0eb service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:25.409045 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:25.409717 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:25.409999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:25.410266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] PATH_INFO: `/v3/users/b1f764e7a9994fb6a3433817aed09a28` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:25.411408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f764e7a9994fb6a3433817aed09a28)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:25.413379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:25.442322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:INSERT=2,keystone:SELECT=94,keystone:DELETE=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:25.474976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f764e7a9994fb6a3433817aed09a28'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:25.484687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f764e7a9994fb6a3433817aed09a28'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:25.485472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f764e7a9994fb6a3433817aed09a28'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:25.492700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f764e7a9994fb6a3433817aed09a28'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:25.505803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f764e7a9994fb6a3433817aed09a28'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:25.512572 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1238/2469] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:25 2022] DELETE /identity/v3/users/b1f764e7a9994fb6a3433817aed09a28 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:25.517238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda934e-b8da-4732-91a9-bede662a9cb4 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:25.517773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda934e-b8da-4732-91a9-bede662a9cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:25.517773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda934e-b8da-4732-91a9-bede662a9cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:25.537267 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-7eda934e-b8da-4732-91a9-bede662a9cb4 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:25.538460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7eda934e-b8da-4732-91a9-bede662a9cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:25.603218 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1232/2470] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:25.614263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:25.615847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:25.686480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac174f-fced-4584-9376-6666372ad51d admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:25.691484 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5a980-eb52-4a60-abbf-55ff0b05e3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:25.692143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a980-eb52-4a60-abbf-55ff0b05e3dc service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:25.692451 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a980-eb52-4a60-abbf-55ff0b05e3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:25.692725 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a980-eb52-4a60-abbf-55ff0b05e3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:25.703180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5a980-eb52-4a60-abbf-55ff0b05e3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:25.704805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5a980-eb52-4a60-abbf-55ff0b05e3dc service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:25.716374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1239/2471] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:26.012616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda934e-b8da-4732-91a9-bede662a9cb4 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:26.013755 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7eda934e-b8da-4732-91a9-bede662a9cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:26.028371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda934e-b8da-4732-91a9-bede662a9cb4 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:26.034645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:26.035454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:26.035798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:26.036139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf admin admin] PATH_INFO: `/v3/projects/b76362a40ce54fefbeb56c3c257975b9` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:26.037984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76362a40ce54fefbeb56c3c257975b9)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:26.040077 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:26.085397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:26.110076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76362a40ce54fefbeb56c3c257975b9', 'request_id': 'req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.120539 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76362a40ce54fefbeb56c3c257975b9', 'request_id': 'req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.127641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76362a40ce54fefbeb56c3c257975b9', 'request_id': 'req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.147981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf admin admin] The token cache is being invalidate because project b76362a40ce54fefbeb56c3c257975b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:26.147981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.147981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d7bbfb66-6df8-4a15-89de-52d6b94d26cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.147981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1233/2472] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:26 2022] DELETE /identity/v3/projects/b76362a40ce54fefbeb56c3c257975b9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:26.150433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5a980-eb52-4a60-abbf-55ff0b05e3dc service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:26.160847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5a980-eb52-4a60-abbf-55ff0b05e3dc service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:26.230037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32378a-699d-4ba1-8366-86c1d1038d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:26.231070 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32378a-699d-4ba1-8366-86c1d1038d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:26.231335 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32378a-699d-4ba1-8366-86c1d1038d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:26.231592 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32378a-699d-4ba1-8366-86c1d1038d46 admin admin] PATH_INFO: `/v3/users/136aa3f896bf4f60ab70f7e21adb115b` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:26.232719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32378a-699d-4ba1-8366-86c1d1038d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=136aa3f896bf4f60ab70f7e21adb115b)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:26.234817 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32378a-699d-4ba1-8366-86c1d1038d46 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:26.294239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:26.295919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-3a32378a-699d-4ba1-8366-86c1d1038d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136aa3f896bf4f60ab70f7e21adb115b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.306709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-3a32378a-699d-4ba1-8366-86c1d1038d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136aa3f896bf4f60ab70f7e21adb115b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.308789 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-3a32378a-699d-4ba1-8366-86c1d1038d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136aa3f896bf4f60ab70f7e21adb115b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.320877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-3a32378a-699d-4ba1-8366-86c1d1038d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136aa3f896bf4f60ab70f7e21adb115b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.333409 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-3a32378a-699d-4ba1-8366-86c1d1038d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136aa3f896bf4f60ab70f7e21adb115b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.339816 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1240/2473] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:26 2022] DELETE /identity/v3/users/136aa3f896bf4f60ab70f7e21adb115b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:26.543265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78902048-8e3c-4465-bb67-04a5936b07c4 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:26.544505 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78902048-8e3c-4465-bb67-04a5936b07c4 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:26.545180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78902048-8e3c-4465-bb67-04a5936b07c4 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:26.546596 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1234/2474] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:24:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:24:26.553812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ab84d-67db-4f81-a143-728813bd4b1c None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:26.554668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ab84d-67db-4f81-a143-728813bd4b1c None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:26.554668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ab84d-67db-4f81-a143-728813bd4b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:26.589749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e57ab84d-67db-4f81-a143-728813bd4b1c None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:26.591153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e57ab84d-67db-4f81-a143-728813bd4b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:26.673159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1241/2475] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:24:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:26.686055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78902048-8e3c-4465-bb67-04a5936b07c4 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:26.687974 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-78902048-8e3c-4465-bb67-04a5936b07c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:26.739362 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ab84d-67db-4f81-a143-728813bd4b1c None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:26.741305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e57ab84d-67db-4f81-a143-728813bd4b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:26.769319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78902048-8e3c-4465-bb67-04a5936b07c4 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:26.773836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dedc70-06b4-4b97-b5ae-2bba71fe2942 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd967a3fa32ef48b68c9e3a174f0c9a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:26.774507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dedc70-06b4-4b97-b5ae-2bba71fe2942 service glance] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:26.774842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dedc70-06b4-4b97-b5ae-2bba71fe2942 service glance] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:26.775111 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dedc70-06b4-4b97-b5ae-2bba71fe2942 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:26.786142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dedc70-06b4-4b97-b5ae-2bba71fe2942 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:26.787547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dedc70-06b4-4b97-b5ae-2bba71fe2942 service glance] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:26.799716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1235/2476] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:26.821497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ab84d-67db-4f81-a143-728813bd4b1c None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:26.826729 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:26.827386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:26.827820 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:26.828090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] PATH_INFO: `/v3/projects/c733338c97f6408693e96aaf3bbffccc` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:26.829256 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c733338c97f6408693e96aaf3bbffccc)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:26.831199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:26.872416 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61687-8805-411d-bb3c-9b16ab109606 None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:26.872693 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61687-8805-411d-bb3c-9b16ab109606 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:26.874164 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:26.874858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61687-8805-411d-bb3c-9b16ab109606 None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:26.876645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1236/2477] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:24:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:24:26.881666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0f532-6fb7-4f9b-9dd1-59d1f4ca8380 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:26.881915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0f532-6fb7-4f9b-9dd1-59d1f4ca8380 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:26.882179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0f532-6fb7-4f9b-9dd1-59d1f4ca8380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:26.886060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c733338c97f6408693e96aaf3bbffccc', 'request_id': 'req-2acdfaca-2601-46ab-82b2-7e4423098f09'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.895157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c733338c97f6408693e96aaf3bbffccc', 'request_id': 'req-2acdfaca-2601-46ab-82b2-7e4423098f09'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.901924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c733338c97f6408693e96aaf3bbffccc', 'request_id': 'req-2acdfaca-2601-46ab-82b2-7e4423098f09'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.903436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-2cf0f532-6fb7-4f9b-9dd1-59d1f4ca8380 None None] MFA Rules not processed for user `d4f2b852544b450a86fdcb5fa18fd290`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:26.904661 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2cf0f532-6fb7-4f9b-9dd1-59d1f4ca8380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:26.912808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] The token cache is being invalidate because project c733338c97f6408693e96aaf3bbffccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:26.913108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.913762 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:26.915298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1242/2478] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:26 2022] DELETE /identity/v3/projects/c733338c97f6408693e96aaf3bbffccc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:24:26.919957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:26.921306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:26.956928 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1237/2479] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:24:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:26.969647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0f532-6fb7-4f9b-9dd1-59d1f4ca8380 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:26.971012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2cf0f532-6fb7-4f9b-9dd1-59d1f4ca8380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:26.981441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0f532-6fb7-4f9b-9dd1-59d1f4ca8380 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:26.985331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee33ee-1397-4fcb-ade1-f709fa4db6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:26.985937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee33ee-1397-4fcb-ade1-f709fa4db6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:26.986212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee33ee-1397-4fcb-ade1-f709fa4db6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:26.986482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee33ee-1397-4fcb-ade1-f709fa4db6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:26.986984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdfaca-2601-46ab-82b2-7e4423098f09 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:26.992054 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355bb9f-00ed-4ec5-ae13-9da77c28a413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:26.992684 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355bb9f-00ed-4ec5-ae13-9da77c28a413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:26.993047 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355bb9f-00ed-4ec5-ae13-9da77c28a413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:26.993270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355bb9f-00ed-4ec5-ae13-9da77c28a413 admin admin] PATH_INFO: `/v3/users/ca2357611fc34c1789d1633a0bef951b` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:26.994550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee33ee-1397-4fcb-ade1-f709fa4db6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:26.994678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355bb9f-00ed-4ec5-ae13-9da77c28a413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2357611fc34c1789d1633a0bef951b)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:26.995908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee33ee-1397-4fcb-ade1-f709fa4db6f7 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:26.996369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355bb9f-00ed-4ec5-ae13-9da77c28a413 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:27.005131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1238/2480] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:24:27.048756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0355bb9f-00ed-4ec5-ae13-9da77c28a413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2357611fc34c1789d1633a0bef951b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:27.058778 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0355bb9f-00ed-4ec5-ae13-9da77c28a413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2357611fc34c1789d1633a0bef951b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:27.059486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0355bb9f-00ed-4ec5-ae13-9da77c28a413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2357611fc34c1789d1633a0bef951b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:27.067039 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0355bb9f-00ed-4ec5-ae13-9da77c28a413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2357611fc34c1789d1633a0bef951b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:27.084440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0355bb9f-00ed-4ec5-ae13-9da77c28a413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2357611fc34c1789d1633a0bef951b'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:27.091265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1243/2481] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:26 2022] DELETE /identity/v3/users/ca2357611fc34c1789d1633a0bef951b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:24:27.102330 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb3b6d-9fd9-4e00-943a-17fd4b54979c None None] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:27.102715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb3b6d-9fd9-4e00-943a-17fd4b54979c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:27.103058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb3b6d-9fd9-4e00-943a-17fd4b54979c None None] PATH_INFO: `/` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:27.104625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1239/2482] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 31 00:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:24:27.110408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea5dd5-e169-4f32-be34-ea7d46cf4771 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:27.110833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea5dd5-e169-4f32-be34-ea7d46cf4771 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:27.110997 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea5dd5-e169-4f32-be34-ea7d46cf4771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:27.130755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-8eea5dd5-e169-4f32-be34-ea7d46cf4771 None None] MFA Rules not processed for user `2016ed84211d412481d512eae23d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:27.131991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8eea5dd5-e169-4f32-be34-ea7d46cf4771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:27.192654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:27.226640 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1244/2483] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 31 00:24:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:27.238360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb3b6d-9fd9-4e00-943a-17fd4b54979c None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:27.240098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0abb3b6d-9fd9-4e00-943a-17fd4b54979c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:27.302547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb3b6d-9fd9-4e00-943a-17fd4b54979c None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:27.306694 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d680162-ff7e-4cba-a4f5-55a7078bed00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:27.307493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d680162-ff7e-4cba-a4f5-55a7078bed00 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:27.307995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d680162-ff7e-4cba-a4f5-55a7078bed00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:27.308230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d680162-ff7e-4cba-a4f5-55a7078bed00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:27.317241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:27.320176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d680162-ff7e-4cba-a4f5-55a7078bed00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:27.322168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d680162-ff7e-4cba-a4f5-55a7078bed00 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:27.338197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1240/2484] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:24:27.383906 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea5dd5-e169-4f32-be34-ea7d46cf4771 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:27.385780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-8eea5dd5-e169-4f32-be34-ea7d46cf4771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:27.474008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea5dd5-e169-4f32-be34-ea7d46cf4771 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:27.479237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01edc48-3332-4589-8bb3-5dea4217112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:27.480000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edc48-3332-4589-8bb3-5dea4217112a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:27.480000 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edc48-3332-4589-8bb3-5dea4217112a admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:27.480263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edc48-3332-4589-8bb3-5dea4217112a admin admin] PATH_INFO: `/v3/projects/59722b613a0848658042d222bc363ee6` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:27.481490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01edc48-3332-4589-8bb3-5dea4217112a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59722b613a0848658042d222bc363ee6)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:27.483534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01edc48-3332-4589-8bb3-5dea4217112a admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:27.533971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a01edc48-3332-4589-8bb3-5dea4217112a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59722b613a0848658042d222bc363ee6', 'request_id': 'req-a01edc48-3332-4589-8bb3-5dea4217112a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:27.544298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a01edc48-3332-4589-8bb3-5dea4217112a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59722b613a0848658042d222bc363ee6', 'request_id': 'req-a01edc48-3332-4589-8bb3-5dea4217112a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:27.552465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a01edc48-3332-4589-8bb3-5dea4217112a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59722b613a0848658042d222bc363ee6', 'request_id': 'req-a01edc48-3332-4589-8bb3-5dea4217112a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:27.564221 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a01edc48-3332-4589-8bb3-5dea4217112a admin admin] The token cache is being invalidate because project 59722b613a0848658042d222bc363ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:27.564513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a01edc48-3332-4589-8bb3-5dea4217112a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:27.565167 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a01edc48-3332-4589-8bb3-5dea4217112a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:27.567163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1245/2485] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:27 2022] DELETE /identity/v3/projects/59722b613a0848658042d222bc363ee6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:27.572357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4f63d-e5eb-4636-9a42-be53862cf272 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:27.572938 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4f63d-e5eb-4636-9a42-be53862cf272 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:27.573503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4f63d-e5eb-4636-9a42-be53862cf272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:27.608621 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-00d4f63d-e5eb-4636-9a42-be53862cf272 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:27.609929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-00d4f63d-e5eb-4636-9a42-be53862cf272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:27.685537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1241/2486] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:27.692625 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d50102-b024-460a-afd0-0f74da854a6a None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:27.692906 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d50102-b024-460a-afd0-0f74da854a6a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:27.693175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d50102-b024-460a-afd0-0f74da854a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:27.714531 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-11d50102-b024-460a-afd0-0f74da854a6a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:27.715728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-11d50102-b024-460a-afd0-0f74da854a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:27.724374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1246/2487] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:27.729150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4f63d-e5eb-4636-9a42-be53862cf272 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:27.739490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4f63d-e5eb-4636-9a42-be53862cf272 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:27.744225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aa4cf-3865-4e4a-acc4-9f6392e14248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:27.744860 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aa4cf-3865-4e4a-acc4-9f6392e14248 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:27.745134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aa4cf-3865-4e4a-acc4-9f6392e14248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:27.745452 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aa4cf-3865-4e4a-acc4-9f6392e14248 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:27.746102 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aa4cf-3865-4e4a-acc4-9f6392e14248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:24:27.746403 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aa4cf-3865-4e4a-acc4-9f6392e14248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:27.748286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aa4cf-3865-4e4a-acc4-9f6392e14248 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:27.762001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1242/2488] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:24:27.766680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d50102-b024-460a-afd0-0f74da854a6a None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:27.776965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d50102-b024-460a-afd0-0f74da854a6a None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:27.782575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd9ca3-07b7-41de-ad36-fa1dfa0f1e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:27.783289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd9ca3-07b7-41de-ad36-fa1dfa0f1e8b admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:27.783728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd9ca3-07b7-41de-ad36-fa1dfa0f1e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:27.783999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd9ca3-07b7-41de-ad36-fa1dfa0f1e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:27.784751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd9ca3-07b7-41de-ad36-fa1dfa0f1e8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:27.786750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd9ca3-07b7-41de-ad36-fa1dfa0f1e8b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:27.824410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1247/2489] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:27 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:27.825356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aa4cf-3865-4e4a-acc4-9f6392e14248 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:27.839521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aa4cf-3865-4e4a-acc4-9f6392e14248 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:27.913560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff94e31-1f9b-4827-b210-61d5bc3be731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:27.914339 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff94e31-1f9b-4827-b210-61d5bc3be731 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:27.914685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff94e31-1f9b-4827-b210-61d5bc3be731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:27.915021 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff94e31-1f9b-4827-b210-61d5bc3be731 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:27.915664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff94e31-1f9b-4827-b210-61d5bc3be731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:27.917843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff94e31-1f9b-4827-b210-61d5bc3be731 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:27.948900 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1243/2490] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:27 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:24:27.953482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd9ca3-07b7-41de-ad36-fa1dfa0f1e8b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:27.965180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd9ca3-07b7-41de-ad36-fa1dfa0f1e8b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:27.971273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b5b6c-4d91-400f-a439-4b27d63929cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:27.971891 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b5b6c-4d91-400f-a439-4b27d63929cb admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:27.972184 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b5b6c-4d91-400f-a439-4b27d63929cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:27.972454 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b5b6c-4d91-400f-a439-4b27d63929cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:27.973096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b5b6c-4d91-400f-a439-4b27d63929cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:27.975167 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b5b6c-4d91-400f-a439-4b27d63929cb admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:27.988303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1248/2491] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:27.990900 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff94e31-1f9b-4827-b210-61d5bc3be731 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:28.003095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff94e31-1f9b-4827-b210-61d5bc3be731 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:28.008498 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c4ac9-5d9d-4041-af16-b0ce22a22337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:28.009525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c4ac9-5d9d-4041-af16-b0ce22a22337 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.009998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c4ac9-5d9d-4041-af16-b0ce22a22337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.010266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c4ac9-5d9d-4041-af16-b0ce22a22337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.011062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c4ac9-5d9d-4041-af16-b0ce22a22337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:28.012958 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c4ac9-5d9d-4041-af16-b0ce22a22337 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:28.027062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1244/2492] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:28.030985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b5b6c-4d91-400f-a439-4b27d63929cb admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:28.044735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b5b6c-4d91-400f-a439-4b27d63929cb admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:28.050550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8602ad3-e633-430f-87e9-8e0a9c1bd003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:28.051373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8602ad3-e633-430f-87e9-8e0a9c1bd003 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.051651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8602ad3-e633-430f-87e9-8e0a9c1bd003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.051955 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8602ad3-e633-430f-87e9-8e0a9c1bd003 admin admin] PATH_INFO: `/v3/projects/cf0251b2aee345449dce705793b60602/users/8eb4a41e502748019656c21a8ac65743/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.074494 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8602ad3-e633-430f-87e9-8e0a9c1bd003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0251b2aee345449dce705793b60602, user_id=8eb4a41e502748019656c21a8ac65743, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:28.077088 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8602ad3-e633-430f-87e9-8e0a9c1bd003 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:28.099693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1249/2493] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:28 2022] PUT /identity/v3/projects/cf0251b2aee345449dce705793b60602/users/8eb4a41e502748019656c21a8ac65743/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:28.110277 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fdfe2-d270-4e29-b061-c00613fb7dc7 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.110575 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fdfe2-d270-4e29-b061-c00613fb7dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.110847 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fdfe2-d270-4e29-b061-c00613fb7dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.138938 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-864fdfe2-d270-4e29-b061-c00613fb7dc7 None None] MFA Rules not processed for user `8eb4a41e502748019656c21a8ac65743`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:28.140148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-864fdfe2-d270-4e29-b061-c00613fb7dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:28.193593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:28.212625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1245/2494] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:28.217496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8602ad3-e633-430f-87e9-8e0a9c1bd003 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:28.221968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:28.288323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8602ad3-e633-430f-87e9-8e0a9c1bd003 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:28.293979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f0f2d-8626-4568-a5b9-7ff5fb248a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:28.294589 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f0f2d-8626-4568-a5b9-7ff5fb248a9c admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.294870 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f0f2d-8626-4568-a5b9-7ff5fb248a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.295161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f0f2d-8626-4568-a5b9-7ff5fb248a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.295839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f0f2d-8626-4568-a5b9-7ff5fb248a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:28.298177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f0f2d-8626-4568-a5b9-7ff5fb248a9c admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:28.326750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1250/2495] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:28 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:24:28.330946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fdfe2-d270-4e29-b061-c00613fb7dc7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:28.342001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fdfe2-d270-4e29-b061-c00613fb7dc7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:28.403340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ae8a8-2732-4d10-a27a-80e0d1b578ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:28.403950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ae8a8-2732-4d10-a27a-80e0d1b578ad admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.404215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ae8a8-2732-4d10-a27a-80e0d1b578ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.404481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ae8a8-2732-4d10-a27a-80e0d1b578ad admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.405125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ae8a8-2732-4d10-a27a-80e0d1b578ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:28.407060 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ae8a8-2732-4d10-a27a-80e0d1b578ad admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:28.430328 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1246/2496] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:28 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:24:28.434717 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f0f2d-8626-4568-a5b9-7ff5fb248a9c admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:28.445946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f0f2d-8626-4568-a5b9-7ff5fb248a9c admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:28.451272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998f6c1-05ec-4da4-9698-7f88e93ab562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:28.451939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998f6c1-05ec-4da4-9698-7f88e93ab562 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.452227 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998f6c1-05ec-4da4-9698-7f88e93ab562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.452497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998f6c1-05ec-4da4-9698-7f88e93ab562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.453143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998f6c1-05ec-4da4-9698-7f88e93ab562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:28.454777 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998f6c1-05ec-4da4-9698-7f88e93ab562 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:28.467984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1251/2497] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:28.472188 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ae8a8-2732-4d10-a27a-80e0d1b578ad admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:28.482463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ae8a8-2732-4d10-a27a-80e0d1b578ad admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:28.488085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d31a1c-854f-4091-9ce2-394ca556a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:28.488676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d31a1c-854f-4091-9ce2-394ca556a9bb admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.488945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d31a1c-854f-4091-9ce2-394ca556a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.489231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d31a1c-854f-4091-9ce2-394ca556a9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.489894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d31a1c-854f-4091-9ce2-394ca556a9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:28.491562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d31a1c-854f-4091-9ce2-394ca556a9bb admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:28.502002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1247/2498] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:28.506349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998f6c1-05ec-4da4-9698-7f88e93ab562 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:28.516750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998f6c1-05ec-4da4-9698-7f88e93ab562 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:28.522567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7c4cd-d97b-4569-9f71-7a58a9313388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:28.523238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7c4cd-d97b-4569-9f71-7a58a9313388 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.523514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7c4cd-d97b-4569-9f71-7a58a9313388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.523777 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7c4cd-d97b-4569-9f71-7a58a9313388 admin admin] PATH_INFO: `/v3/projects/283d8f8229364a28b0e450067818505f/users/ee08329d3e434c2296a6bb9f1203871a/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.539360 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7c4cd-d97b-4569-9f71-7a58a9313388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283d8f8229364a28b0e450067818505f, user_id=ee08329d3e434c2296a6bb9f1203871a, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:28.542354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7c4cd-d97b-4569-9f71-7a58a9313388 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:28.558004 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1252/2499] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:28 2022] PUT /identity/v3/projects/283d8f8229364a28b0e450067818505f/users/ee08329d3e434c2296a6bb9f1203871a/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:24:28.568640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a125b-30a2-4541-a7a7-84a94b168dc0 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.568916 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a125b-30a2-4541-a7a7-84a94b168dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.569186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a125b-30a2-4541-a7a7-84a94b168dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.600587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-c98a125b-30a2-4541-a7a7-84a94b168dc0 None None] MFA Rules not processed for user `ee08329d3e434c2296a6bb9f1203871a`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:28.601694 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c98a125b-30a2-4541-a7a7-84a94b168dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:28.680978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1248/2500] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:28.686202 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7c4cd-d97b-4569-9f71-7a58a9313388 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:28.755462 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7c4cd-d97b-4569-9f71-7a58a9313388 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:28.760844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0be89b-e2b6-4c4e-a26c-71e01c935d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:28.761493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0be89b-e2b6-4c4e-a26c-71e01c935d1d admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.761770 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0be89b-e2b6-4c4e-a26c-71e01c935d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.762035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0be89b-e2b6-4c4e-a26c-71e01c935d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.762671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0be89b-e2b6-4c4e-a26c-71e01c935d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:28.764597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0be89b-e2b6-4c4e-a26c-71e01c935d1d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:28.796418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1253/2501] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:28 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:28.801831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a125b-30a2-4541-a7a7-84a94b168dc0 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:28.817086 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a125b-30a2-4541-a7a7-84a94b168dc0 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:28.878669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae36932-a06f-4ab8-b5a2-5e6a5e2f6e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:28.879171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae36932-a06f-4ab8-b5a2-5e6a5e2f6e0c admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.879463 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae36932-a06f-4ab8-b5a2-5e6a5e2f6e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.879727 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae36932-a06f-4ab8-b5a2-5e6a5e2f6e0c admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.880376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae36932-a06f-4ab8-b5a2-5e6a5e2f6e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:28.882448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae36932-a06f-4ab8-b5a2-5e6a5e2f6e0c admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:28.891099 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:28.907929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1249/2502] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:28 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:28.912171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0be89b-e2b6-4c4e-a26c-71e01c935d1d admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:28.922845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0be89b-e2b6-4c4e-a26c-71e01c935d1d admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:28.927901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17531f7-8b83-4b5a-bb5a-ef90506d3fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:28.928505 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17531f7-8b83-4b5a-bb5a-ef90506d3fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.928778 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17531f7-8b83-4b5a-bb5a-ef90506d3fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.929043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17531f7-8b83-4b5a-bb5a-ef90506d3fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.929730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17531f7-8b83-4b5a-bb5a-ef90506d3fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:28.931361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17531f7-8b83-4b5a-bb5a-ef90506d3fbd admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:28.949857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1254/2503] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:28.953472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae36932-a06f-4ab8-b5a2-5e6a5e2f6e0c admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:28.982907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae36932-a06f-4ab8-b5a2-5e6a5e2f6e0c admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:28.992706 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef291793-56ba-4193-bcd3-388550ba3f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:28.993420 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef291793-56ba-4193-bcd3-388550ba3f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.993711 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef291793-56ba-4193-bcd3-388550ba3f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.993960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef291793-56ba-4193-bcd3-388550ba3f12 admin admin] PATH_INFO: `/v3/projects/3992f61be2914a30ba71835b3e5ed55f/users/3f58847bc15948cebf1f2fe65b728f1d/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:29.014006 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef291793-56ba-4193-bcd3-388550ba3f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3992f61be2914a30ba71835b3e5ed55f, user_id=3f58847bc15948cebf1f2fe65b728f1d, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:29.017037 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef291793-56ba-4193-bcd3-388550ba3f12 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:29.032435 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1250/2504] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:28 2022] PUT /identity/v3/projects/3992f61be2914a30ba71835b3e5ed55f/users/3f58847bc15948cebf1f2fe65b728f1d/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:29.036547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17531f7-8b83-4b5a-bb5a-ef90506d3fbd admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:29.046763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17531f7-8b83-4b5a-bb5a-ef90506d3fbd admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:29.072481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:29.115163 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb24873-50f2-40e6-9f77-b60c56328063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:29.115857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb24873-50f2-40e6-9f77-b60c56328063 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:29.116364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb24873-50f2-40e6-9f77-b60c56328063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:29.116632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb24873-50f2-40e6-9f77-b60c56328063 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:29.117328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb24873-50f2-40e6-9f77-b60c56328063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:29.118919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb24873-50f2-40e6-9f77-b60c56328063 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:29.130730 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1255/2505] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:29.135045 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef291793-56ba-4193-bcd3-388550ba3f12 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:29.146356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef291793-56ba-4193-bcd3-388550ba3f12 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:29.150943 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b525ee-fa10-427d-8b61-1efa404b4c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:29.151614 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b525ee-fa10-427d-8b61-1efa404b4c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:29.151887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b525ee-fa10-427d-8b61-1efa404b4c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:29.152157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b525ee-fa10-427d-8b61-1efa404b4c10 admin admin] PATH_INFO: `/v3/projects/3992f61be2914a30ba71835b3e5ed55f/users/3f58847bc15948cebf1f2fe65b728f1d/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:29.154073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b525ee-fa10-427d-8b61-1efa404b4c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3992f61be2914a30ba71835b3e5ed55f, user_id=3f58847bc15948cebf1f2fe65b728f1d, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:29.156690 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b525ee-fa10-427d-8b61-1efa404b4c10 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:29.170174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1251/2506] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:29 2022] PUT /identity/v3/projects/3992f61be2914a30ba71835b3e5ed55f/users/3f58847bc15948cebf1f2fe65b728f1d/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:29.182823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f37b-61a3-4a11-917c-5749d0895724 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:29.183114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f37b-61a3-4a11-917c-5749d0895724 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:29.183410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f37b-61a3-4a11-917c-5749d0895724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:29.212936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-4442f37b-61a3-4a11-917c-5749d0895724 None None] MFA Rules not processed for user `3f58847bc15948cebf1f2fe65b728f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:29.214213 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-4442f37b-61a3-4a11-917c-5749d0895724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:29.289230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1256/2507] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:29.301345 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b525ee-fa10-427d-8b61-1efa404b4c10 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:29.303219 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-42b525ee-fa10-427d-8b61-1efa404b4c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:29.364894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b525ee-fa10-427d-8b61-1efa404b4c10 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:29.368909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a601d5-fb85-4314-ba22-9de4ded9a269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:29.369540 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a601d5-fb85-4314-ba22-9de4ded9a269 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:29.369810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a601d5-fb85-4314-ba22-9de4ded9a269 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:29.370161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a601d5-fb85-4314-ba22-9de4ded9a269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:29.428031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a601d5-fb85-4314-ba22-9de4ded9a269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:29.429396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a601d5-fb85-4314-ba22-9de4ded9a269 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:29.438750 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1252/2508] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:30.711334 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dfc42-e801-4dfa-89fa-b0e79a02ca96 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:30.711860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dfc42-e801-4dfa-89fa-b0e79a02ca96 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:30.711946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dfc42-e801-4dfa-89fa-b0e79a02ca96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:30.736796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-0f6dfc42-e801-4dfa-89fa-b0e79a02ca96 None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:30.738061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0f6dfc42-e801-4dfa-89fa-b0e79a02ca96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:30.796960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1257/2509] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:24:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:30.809390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a601d5-fb85-4314-ba22-9de4ded9a269 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:30.810987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-84a601d5-fb85-4314-ba22-9de4ded9a269 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:30.883023 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a601d5-fb85-4314-ba22-9de4ded9a269 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:30.889304 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8840781-d917-44c3-992a-abf43bac9d5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:30.889969 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8840781-d917-44c3-992a-abf43bac9d5b service swift] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:30.890245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8840781-d917-44c3-992a-abf43bac9d5b service swift] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:30.890508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8840781-d917-44c3-992a-abf43bac9d5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:30.897956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:30.900580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8840781-d917-44c3-992a-abf43bac9d5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:30.902568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8840781-d917-44c3-992a-abf43bac9d5b service swift] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:30.911986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1253/2510] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:24:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:24:31.012549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6dfc42-e801-4dfa-89fa-b0e79a02ca96 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:31.014688 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0f6dfc42-e801-4dfa-89fa-b0e79a02ca96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:31.031151 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6dfc42-e801-4dfa-89fa-b0e79a02ca96 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:31.035738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd27a73-5dd3-47be-b8b8-be7aa872ea0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:31.036916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd27a73-5dd3-47be-b8b8-be7aa872ea0a service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:31.037536 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd27a73-5dd3-47be-b8b8-be7aa872ea0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:31.038021 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd27a73-5dd3-47be-b8b8-be7aa872ea0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:31.105172 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:31.115170 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd27a73-5dd3-47be-b8b8-be7aa872ea0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:31.116619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd27a73-5dd3-47be-b8b8-be7aa872ea0a service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:31.125913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1258/2511] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:31.807695 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8840781-d917-44c3-992a-abf43bac9d5b service swift] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:31.818526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8840781-d917-44c3-992a-abf43bac9d5b service swift] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:31.822642 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f1e76-70b4-43c6-b74c-af469e740770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:31.823403 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f1e76-70b4-43c6-b74c-af469e740770 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:31.823767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f1e76-70b4-43c6-b74c-af469e740770 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:31.824137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f1e76-70b4-43c6-b74c-af469e740770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:31.834233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f1e76-70b4-43c6-b74c-af469e740770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:31.835725 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f1e76-70b4-43c6-b74c-af469e740770 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:31.845402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1254/2512] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:35.870367 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd27a73-5dd3-47be-b8b8-be7aa872ea0a service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:35.937337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd27a73-5dd3-47be-b8b8-be7aa872ea0a service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:35.942497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:35.943142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:35.943414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:35.943678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] PATH_INFO: `/v3/users/8eb4a41e502748019656c21a8ac65743` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:35.944827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb4a41e502748019656c21a8ac65743)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:35.946768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:36.001286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb4a41e502748019656c21a8ac65743'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.015846 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb4a41e502748019656c21a8ac65743'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.021769 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb4a41e502748019656c21a8ac65743'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.038194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb4a41e502748019656c21a8ac65743'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.054037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb4a41e502748019656c21a8ac65743'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.061814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1259/2513] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:35 2022] DELETE /identity/v3/users/8eb4a41e502748019656c21a8ac65743 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:36.066591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c9399-114b-40c5-927d-316b99079021 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:36.067166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c9399-114b-40c5-927d-316b99079021 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:36.067166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c9399-114b-40c5-927d-316b99079021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:36.088454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-8c5c9399-114b-40c5-927d-316b99079021 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:36.090137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8c5c9399-114b-40c5-927d-316b99079021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:36.161708 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1255/2514] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:36.173534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:36.175130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:36.236728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f98bf9-3b6c-4582-9d18-cacd1f64faec admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:36.240463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ebc0c-ea07-4866-8d4e-1fc256790b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:36.241185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ebc0c-ea07-4866-8d4e-1fc256790b36 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:36.241513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ebc0c-ea07-4866-8d4e-1fc256790b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:36.241786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ebc0c-ea07-4866-8d4e-1fc256790b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:36.253218 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ebc0c-ea07-4866-8d4e-1fc256790b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:36.254695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ebc0c-ea07-4866-8d4e-1fc256790b36 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:36.266579 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1260/2515] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:36.592608 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c9399-114b-40c5-927d-316b99079021 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:36.594107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8c5c9399-114b-40c5-927d-316b99079021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:36.611719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c9399-114b-40c5-927d-316b99079021 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:36.624562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:36.625269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:36.625585 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:36.625891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] PATH_INFO: `/v3/projects/cf0251b2aee345449dce705793b60602` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:36.627168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0251b2aee345449dce705793b60602)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:36.629097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:36.687259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0251b2aee345449dce705793b60602', 'request_id': 'req-3ba9868d-90d9-450f-98d5-097109689fe2'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.697526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0251b2aee345449dce705793b60602', 'request_id': 'req-3ba9868d-90d9-450f-98d5-097109689fe2'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.710776 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0251b2aee345449dce705793b60602', 'request_id': 'req-3ba9868d-90d9-450f-98d5-097109689fe2'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.731689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] The token cache is being invalidate because project cf0251b2aee345449dce705793b60602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:36.732427 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.733493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.736440 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1256/2516] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:36 2022] DELETE /identity/v3/projects/cf0251b2aee345449dce705793b60602 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:24:36.740260 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ebc0c-ea07-4866-8d4e-1fc256790b36 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:36.751083 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ebc0c-ea07-4866-8d4e-1fc256790b36 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:36.760547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:36.822901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:36.823561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:36.823882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:36.824150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] PATH_INFO: `/v3/users/ee08329d3e434c2296a6bb9f1203871a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:36.825463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee08329d3e434c2296a6bb9f1203871a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:36.827481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:36.882326 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee08329d3e434c2296a6bb9f1203871a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.892483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee08329d3e434c2296a6bb9f1203871a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.893663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee08329d3e434c2296a6bb9f1203871a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.905328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee08329d3e434c2296a6bb9f1203871a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.923156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee08329d3e434c2296a6bb9f1203871a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:36.929554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1261/2517] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:36 2022] DELETE /identity/v3/users/ee08329d3e434c2296a6bb9f1203871a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:37.238643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:37.240864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:37.260710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9868d-90d9-450f-98d5-097109689fe2 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:37.327921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:37.328578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:37.328850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:37.329117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] PATH_INFO: `/v3/projects/283d8f8229364a28b0e450067818505f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:37.330302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=283d8f8229364a28b0e450067818505f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:37.332228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:37.343680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:37.394291 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283d8f8229364a28b0e450067818505f', 'request_id': 'req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:37.403771 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283d8f8229364a28b0e450067818505f', 'request_id': 'req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:37.410765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283d8f8229364a28b0e450067818505f', 'request_id': 'req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:37.423697 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] The token cache is being invalidate because project 283d8f8229364a28b0e450067818505f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:37.423993 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:37.424650 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:37.426197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1257/2518] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:37 2022] DELETE /identity/v3/projects/283d8f8229364a28b0e450067818505f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:37.430662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:37.432513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:37.449096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba0c29-9076-447d-862c-0c817972475d admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:37.508281 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b72ee-36f2-42bb-a6e4-0cfb841fcf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:37.509434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b72ee-36f2-42bb-a6e4-0cfb841fcf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:37.509887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b72ee-36f2-42bb-a6e4-0cfb841fcf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:37.510314 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b72ee-36f2-42bb-a6e4-0cfb841fcf4e admin admin] PATH_INFO: `/v3/users/3f58847bc15948cebf1f2fe65b728f1d` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:37.511639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b72ee-36f2-42bb-a6e4-0cfb841fcf4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f58847bc15948cebf1f2fe65b728f1d)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:37.515677 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b72ee-36f2-42bb-a6e4-0cfb841fcf4e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:37.563628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:37.573916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8b4b72ee-36f2-42bb-a6e4-0cfb841fcf4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f58847bc15948cebf1f2fe65b728f1d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:37.593999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8b4b72ee-36f2-42bb-a6e4-0cfb841fcf4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f58847bc15948cebf1f2fe65b728f1d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:37.596181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8b4b72ee-36f2-42bb-a6e4-0cfb841fcf4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f58847bc15948cebf1f2fe65b728f1d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:37.605523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8b4b72ee-36f2-42bb-a6e4-0cfb841fcf4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f58847bc15948cebf1f2fe65b728f1d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:37.624999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-8b4b72ee-36f2-42bb-a6e4-0cfb841fcf4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f58847bc15948cebf1f2fe65b728f1d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:37.632262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1262/2519] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:37 2022] DELETE /identity/v3/users/3f58847bc15948cebf1f2fe65b728f1d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:37.943904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:37.945552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:37.960881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c4198-fb8a-42bd-8148-eeb13d69bc3c admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:38.023884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:38.024540 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:38.024815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:38.025087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff admin admin] PATH_INFO: `/v3/projects/3992f61be2914a30ba71835b3e5ed55f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:38.026259 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3992f61be2914a30ba71835b3e5ed55f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:38.028266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:38.082035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3992f61be2914a30ba71835b3e5ed55f', 'request_id': 'req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:38.091010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3992f61be2914a30ba71835b3e5ed55f', 'request_id': 'req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:38.098298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3992f61be2914a30ba71835b3e5ed55f', 'request_id': 'req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:38.109180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff admin admin] The token cache is being invalidate because project 3992f61be2914a30ba71835b3e5ed55f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:38.109575 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:38.110152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f6b1cbc6-d41b-4ed8-9032-a6b308fe62ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:38.113329 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1258/2520] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:37 2022] DELETE /identity/v3/projects/3992f61be2914a30ba71835b3e5ed55f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:38.117095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051c4c-1dcb-433c-ab90-1c090b76118a None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:38.117643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051c4c-1dcb-433c-ab90-1c090b76118a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:38.117752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051c4c-1dcb-433c-ab90-1c090b76118a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:38.140416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-02051c4c-1dcb-433c-ab90-1c090b76118a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:38.141703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-02051c4c-1dcb-433c-ab90-1c090b76118a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:38.211224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1263/2521] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:38.220035 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd5169-b6c9-4319-8a2c-10ed0073560f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:38.220449 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd5169-b6c9-4319-8a2c-10ed0073560f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:38.220808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd5169-b6c9-4319-8a2c-10ed0073560f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:38.244169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-cbcd5169-b6c9-4319-8a2c-10ed0073560f None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:38.245542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-cbcd5169-b6c9-4319-8a2c-10ed0073560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:38.255323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1259/2522] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:38.260044 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051c4c-1dcb-433c-ab90-1c090b76118a None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:38.270573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051c4c-1dcb-433c-ab90-1c090b76118a None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:38.275375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857f7b6-0afd-4dfb-ac71-08b90141c94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:38.275989 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857f7b6-0afd-4dfb-ac71-08b90141c94a admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:38.276269 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857f7b6-0afd-4dfb-ac71-08b90141c94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:38.276539 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857f7b6-0afd-4dfb-ac71-08b90141c94a admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:38.277190 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857f7b6-0afd-4dfb-ac71-08b90141c94a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:24:38.277566 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857f7b6-0afd-4dfb-ac71-08b90141c94a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:38.279688 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857f7b6-0afd-4dfb-ac71-08b90141c94a admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:38.292150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1264/2523] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:24:38.297344 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd5169-b6c9-4319-8a2c-10ed0073560f None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:38.307903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd5169-b6c9-4319-8a2c-10ed0073560f None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:38.318705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be742bf-0988-407c-aff3-0857b7b66852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:38.319647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be742bf-0988-407c-aff3-0857b7b66852 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:38.320145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be742bf-0988-407c-aff3-0857b7b66852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:38.320578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be742bf-0988-407c-aff3-0857b7b66852 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:38.321964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be742bf-0988-407c-aff3-0857b7b66852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:38.324505 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be742bf-0988-407c-aff3-0857b7b66852 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:38.352044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:38.360942 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1260/2524] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:38 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:38.365646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857f7b6-0afd-4dfb-ac71-08b90141c94a admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:38.378336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857f7b6-0afd-4dfb-ac71-08b90141c94a admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:38.440907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e242981-009e-4c5a-9829-fccd8549be87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:38.441609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e242981-009e-4c5a-9829-fccd8549be87 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:38.441952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e242981-009e-4c5a-9829-fccd8549be87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:38.442200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e242981-009e-4c5a-9829-fccd8549be87 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:38.442854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e242981-009e-4c5a-9829-fccd8549be87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:38.444861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e242981-009e-4c5a-9829-fccd8549be87 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:38.473826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1265/2525] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:38 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:24:38.477853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be742bf-0988-407c-aff3-0857b7b66852 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:38.490047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be742bf-0988-407c-aff3-0857b7b66852 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:38.494825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9878798-8395-426a-8761-8c6744d97063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:38.495460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9878798-8395-426a-8761-8c6744d97063 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:38.495729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9878798-8395-426a-8761-8c6744d97063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:38.495995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9878798-8395-426a-8761-8c6744d97063 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:38.496667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9878798-8395-426a-8761-8c6744d97063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:38.498756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9878798-8395-426a-8761-8c6744d97063 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:38.509661 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1261/2526] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:24:38.514558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e242981-009e-4c5a-9829-fccd8549be87 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:38.526009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e242981-009e-4c5a-9829-fccd8549be87 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:38.533976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10dda0-6e73-4464-905f-2cc005fe3408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:38.535009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10dda0-6e73-4464-905f-2cc005fe3408 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:38.535555 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10dda0-6e73-4464-905f-2cc005fe3408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:38.536076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10dda0-6e73-4464-905f-2cc005fe3408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:38.537247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10dda0-6e73-4464-905f-2cc005fe3408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:38.540084 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10dda0-6e73-4464-905f-2cc005fe3408 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:38.552755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1266/2527] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:38.557059 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9878798-8395-426a-8761-8c6744d97063 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:38.567230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9878798-8395-426a-8761-8c6744d97063 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:38.571850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adccc0-1194-499d-9103-e375dbc16f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:38.572484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adccc0-1194-499d-9103-e375dbc16f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:38.572756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adccc0-1194-499d-9103-e375dbc16f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:38.573026 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adccc0-1194-499d-9103-e375dbc16f8d admin admin] PATH_INFO: `/v3/projects/af8fbcd5569840cda41758c3b4e05003/users/94c043aab93d4c0bae8f8a898eed7595/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:38.593186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11adccc0-1194-499d-9103-e375dbc16f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8fbcd5569840cda41758c3b4e05003, user_id=94c043aab93d4c0bae8f8a898eed7595, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:38.595894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11adccc0-1194-499d-9103-e375dbc16f8d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:38.613878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1262/2528] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:38 2022] PUT /identity/v3/projects/af8fbcd5569840cda41758c3b4e05003/users/94c043aab93d4c0bae8f8a898eed7595/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:24:38.626229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78160ab4-e7c7-4ff7-be60-c381ec6f1042 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:38.626471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78160ab4-e7c7-4ff7-be60-c381ec6f1042 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:38.626765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78160ab4-e7c7-4ff7-be60-c381ec6f1042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:38.658358 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-78160ab4-e7c7-4ff7-be60-c381ec6f1042 None None] MFA Rules not processed for user `94c043aab93d4c0bae8f8a898eed7595`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:38.659685 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-78160ab4-e7c7-4ff7-be60-c381ec6f1042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:38.665735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:38.737357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1267/2529] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:38.745723 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adccc0-1194-499d-9103-e375dbc16f8d admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:38.748077 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-11adccc0-1194-499d-9103-e375dbc16f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:38.826319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adccc0-1194-499d-9103-e375dbc16f8d admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:38.830544 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92448e-c872-4892-9602-5b7332d9c16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:38.831242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92448e-c872-4892-9602-5b7332d9c16e service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:38.831516 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92448e-c872-4892-9602-5b7332d9c16e service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:38.831854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92448e-c872-4892-9602-5b7332d9c16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:38.843561 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92448e-c872-4892-9602-5b7332d9c16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:38.845384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92448e-c872-4892-9602-5b7332d9c16e service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:38.857262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1263/2530] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:40.254823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b167f8-80ba-47d4-9ba3-243dc91f30e4 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:40.255794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b167f8-80ba-47d4-9ba3-243dc91f30e4 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:40.255794 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b167f8-80ba-47d4-9ba3-243dc91f30e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:40.277427 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-98b167f8-80ba-47d4-9ba3-243dc91f30e4 None None] MFA Rules not processed for user `94c043aab93d4c0bae8f8a898eed7595`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:40.279408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-98b167f8-80ba-47d4-9ba3-243dc91f30e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:40.291422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1268/2531] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:24:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:48.851008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:50.271779 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=27 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:52.979192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9cf6-7f39-42cd-ad07-dea7845691db None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:52.980040 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9cf6-7f39-42cd-ad07-dea7845691db None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:52.980314 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9cf6-7f39-42cd-ad07-dea7845691db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:53.000935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-073a9cf6-7f39-42cd-ad07-dea7845691db None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:53.002190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-073a9cf6-7f39-42cd-ad07-dea7845691db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:53.060673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1264/2532] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 31 00:24:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:53.074020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b167f8-80ba-47d4-9ba3-243dc91f30e4 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:53.075556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-98b167f8-80ba-47d4-9ba3-243dc91f30e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:53.177556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b167f8-80ba-47d4-9ba3-243dc91f30e4 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:53.182833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6de2e-34ea-4755-b926-95f00637d7ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:53.183456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6de2e-34ea-4755-b926-95f00637d7ec service swift] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:53.184559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6de2e-34ea-4755-b926-95f00637d7ec service swift] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:53.184858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6de2e-34ea-4755-b926-95f00637d7ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:53.196263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6de2e-34ea-4755-b926-95f00637d7ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:53.199066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6de2e-34ea-4755-b926-95f00637d7ec service swift] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:53.208768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1269/2533] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:24:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:25:02.181036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a9cf6-7f39-42cd-ad07-dea7845691db None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:02.183453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-073a9cf6-7f39-42cd-ad07-dea7845691db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:02.251083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a9cf6-7f39-42cd-ad07-dea7845691db None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:02.255092 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c440e-c8dc-4830-80d3-684798164651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:02.255735 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c440e-c8dc-4830-80d3-684798164651 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:02.256016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c440e-c8dc-4830-80d3-684798164651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:02.256313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c440e-c8dc-4830-80d3-684798164651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:02.258334 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0c4c440e-c8dc-4830-80d3-684798164651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:02.325461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c440e-c8dc-4830-80d3-684798164651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:02.326946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c440e-c8dc-4830-80d3-684798164651 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:02.336966 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1265/2534] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:03.205351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=32 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:06.601154 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6de2e-34ea-4755-b926-95f00637d7ec service swift] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:06.603230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-acc6de2e-34ea-4755-b926-95f00637d7ec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:06.618306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6de2e-34ea-4755-b926-95f00637d7ec service swift] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:06.623263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38608abb-f78a-4d17-8b3a-e9764e933d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:06.623886 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38608abb-f78a-4d17-8b3a-e9764e933d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:06.624159 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38608abb-f78a-4d17-8b3a-e9764e933d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:06.624424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38608abb-f78a-4d17-8b3a-e9764e933d79 admin admin] PATH_INFO: `/v3/users/cb42eefa189049d4bdaddd776eb735e0` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:06.625554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38608abb-f78a-4d17-8b3a-e9764e933d79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb42eefa189049d4bdaddd776eb735e0)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:06.627591 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38608abb-f78a-4d17-8b3a-e9764e933d79 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:06.686597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-38608abb-f78a-4d17-8b3a-e9764e933d79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb42eefa189049d4bdaddd776eb735e0'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:06.696982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-38608abb-f78a-4d17-8b3a-e9764e933d79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb42eefa189049d4bdaddd776eb735e0'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:06.697892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-38608abb-f78a-4d17-8b3a-e9764e933d79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb42eefa189049d4bdaddd776eb735e0'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:06.705691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-38608abb-f78a-4d17-8b3a-e9764e933d79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb42eefa189049d4bdaddd776eb735e0'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:06.717992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-38608abb-f78a-4d17-8b3a-e9764e933d79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb42eefa189049d4bdaddd776eb735e0'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:06.723937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1270/2535] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:25:06 2022] DELETE /identity/v3/users/cb42eefa189049d4bdaddd776eb735e0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:06.914446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c440e-c8dc-4830-80d3-684798164651 service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:06.932262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c440e-c8dc-4830-80d3-684798164651 service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:06.987640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:06.994908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b597e-f0fc-4c84-a273-e627198ee447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:06.995563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b597e-f0fc-4c84-a273-e627198ee447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:06.995835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b597e-f0fc-4c84-a273-e627198ee447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:06.996101 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b597e-f0fc-4c84-a273-e627198ee447 admin admin] PATH_INFO: `/v3/projects/fc00a4bf834242da8514abc68c3460dc` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:06.997229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b597e-f0fc-4c84-a273-e627198ee447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc00a4bf834242da8514abc68c3460dc)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:06.999143 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b597e-f0fc-4c84-a273-e627198ee447 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:07.048065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e98b597e-f0fc-4c84-a273-e627198ee447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc00a4bf834242da8514abc68c3460dc', 'request_id': 'req-e98b597e-f0fc-4c84-a273-e627198ee447'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:07.057080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e98b597e-f0fc-4c84-a273-e627198ee447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc00a4bf834242da8514abc68c3460dc', 'request_id': 'req-e98b597e-f0fc-4c84-a273-e627198ee447'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:07.063914 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e98b597e-f0fc-4c84-a273-e627198ee447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc00a4bf834242da8514abc68c3460dc', 'request_id': 'req-e98b597e-f0fc-4c84-a273-e627198ee447'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:07.077116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e98b597e-f0fc-4c84-a273-e627198ee447 admin admin] The token cache is being invalidate because project fc00a4bf834242da8514abc68c3460dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:25:07.077656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e98b597e-f0fc-4c84-a273-e627198ee447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:07.078310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e98b597e-f0fc-4c84-a273-e627198ee447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:07.079825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1266/2536] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:25:06 2022] DELETE /identity/v3/projects/fc00a4bf834242da8514abc68c3460dc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:25:07.084937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720a271-0d3a-4f22-ad8c-2fd5fbbaa913 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.085240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720a271-0d3a-4f22-ad8c-2fd5fbbaa913 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.085571 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720a271-0d3a-4f22-ad8c-2fd5fbbaa913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.087356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7dd1a-7a03-457a-a9fe-cd5fb50190de None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.087642 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7dd1a-7a03-457a-a9fe-cd5fb50190de None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.088047 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7dd1a-7a03-457a-a9fe-cd5fb50190de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.107631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-3720a271-0d3a-4f22-ad8c-2fd5fbbaa913 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:07.108858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-3720a271-0d3a-4f22-ad8c-2fd5fbbaa913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:07.109095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-2fb7dd1a-7a03-457a-a9fe-cd5fb50190de None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:07.110412 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2fb7dd1a-7a03-457a-a9fe-cd5fb50190de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:07.179981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1267/2537] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:25:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:07.180607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1271/2538] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:07.188901 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeccb01-675e-4c13-bcdf-6687dd5cbb0b None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.189224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeccb01-675e-4c13-bcdf-6687dd5cbb0b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.189495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeccb01-675e-4c13-bcdf-6687dd5cbb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.193301 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720a271-0d3a-4f22-ad8c-2fd5fbbaa913 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:07.194860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-3720a271-0d3a-4f22-ad8c-2fd5fbbaa913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:07.209640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-deeccb01-675e-4c13-bcdf-6687dd5cbb0b None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:07.210831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-deeccb01-675e-4c13-bcdf-6687dd5cbb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:07.219405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1268/2539] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:07.223083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeccb01-675e-4c13-bcdf-6687dd5cbb0b None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:07.234058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeccb01-675e-4c13-bcdf-6687dd5cbb0b None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:07.238878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44facbd0-f853-4a78-a505-3096234f179e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:07.239422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44facbd0-f853-4a78-a505-3096234f179e admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.239689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44facbd0-f853-4a78-a505-3096234f179e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.239949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44facbd0-f853-4a78-a505-3096234f179e admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.240589 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44facbd0-f853-4a78-a505-3096234f179e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:25:07.240883 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44facbd0-f853-4a78-a505-3096234f179e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:07.242502 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44facbd0-f853-4a78-a505-3096234f179e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:07.254244 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1269/2540] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:25:07.258991 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44facbd0-f853-4a78-a505-3096234f179e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:07.269490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44facbd0-f853-4a78-a505-3096234f179e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:07.271600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720a271-0d3a-4f22-ad8c-2fd5fbbaa913 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:07.274190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb682d-4314-4a67-a862-3e28f4dce129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:07.274785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb682d-4314-4a67-a862-3e28f4dce129 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.275063 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb682d-4314-4a67-a862-3e28f4dce129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.275340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb682d-4314-4a67-a862-3e28f4dce129 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.276364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb682d-4314-4a67-a862-3e28f4dce129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:07.277405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350377e-325a-4f86-a443-cc5dcb929014 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:07.278022 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350377e-325a-4f86-a443-cc5dcb929014 service swift] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.278299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350377e-325a-4f86-a443-cc5dcb929014 service swift] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.278564 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350377e-325a-4f86-a443-cc5dcb929014 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.278769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb682d-4314-4a67-a862-3e28f4dce129 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:07.287201 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350377e-325a-4f86-a443-cc5dcb929014 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:07.288779 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350377e-325a-4f86-a443-cc5dcb929014 service swift] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:07.298488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1272/2541] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:25:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:25:07.312703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1270/2542] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:07 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:07.314094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350377e-325a-4f86-a443-cc5dcb929014 service swift] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:07.319582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:07.327347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350377e-325a-4f86-a443-cc5dcb929014 service swift] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:07.399307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a33bc-6670-4085-9163-32c4098164cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:07.399961 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a33bc-6670-4085-9163-32c4098164cd admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.400234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a33bc-6670-4085-9163-32c4098164cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.400499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a33bc-6670-4085-9163-32c4098164cd admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.401187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a33bc-6670-4085-9163-32c4098164cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:07.403170 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a33bc-6670-4085-9163-32c4098164cd admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:07.425759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1273/2543] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:07 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:07.430132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb682d-4314-4a67-a862-3e28f4dce129 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:07.441231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb682d-4314-4a67-a862-3e28f4dce129 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:07.445922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22e577-6656-44b4-8634-c9a51ab792f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:07.446522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22e577-6656-44b4-8634-c9a51ab792f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.446799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22e577-6656-44b4-8634-c9a51ab792f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.447067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22e577-6656-44b4-8634-c9a51ab792f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.447818 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22e577-6656-44b4-8634-c9a51ab792f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:07.449753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22e577-6656-44b4-8634-c9a51ab792f1 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:07.459892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1271/2544] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:07.464640 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a33bc-6670-4085-9163-32c4098164cd admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:07.476076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a33bc-6670-4085-9163-32c4098164cd admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:07.482493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ef524-0b6a-44fc-9dd2-5ab8fc553499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:07.483109 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ef524-0b6a-44fc-9dd2-5ab8fc553499 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.483637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ef524-0b6a-44fc-9dd2-5ab8fc553499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.483913 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ef524-0b6a-44fc-9dd2-5ab8fc553499 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.484541 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ef524-0b6a-44fc-9dd2-5ab8fc553499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:07.486172 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ef524-0b6a-44fc-9dd2-5ab8fc553499 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:07.496861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1274/2545] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:07.501337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22e577-6656-44b4-8634-c9a51ab792f1 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:07.511933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22e577-6656-44b4-8634-c9a51ab792f1 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:07.516572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8074ae6-7b28-4a7f-8299-90074337b9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:07.517150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8074ae6-7b28-4a7f-8299-90074337b9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.517456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8074ae6-7b28-4a7f-8299-90074337b9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.517722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8074ae6-7b28-4a7f-8299-90074337b9fe admin admin] PATH_INFO: `/v3/projects/43152008ba924507bf56b4f834d97ea0/users/8b8b858008fa4d61a2b0ede0d3b67994/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.533746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8074ae6-7b28-4a7f-8299-90074337b9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=43152008ba924507bf56b4f834d97ea0, user_id=8b8b858008fa4d61a2b0ede0d3b67994, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:07.536373 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8074ae6-7b28-4a7f-8299-90074337b9fe admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:07.551489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1272/2546] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:07 2022] PUT /identity/v3/projects/43152008ba924507bf56b4f834d97ea0/users/8b8b858008fa4d61a2b0ede0d3b67994/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:07.567955 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4fc96-4d9f-42f5-b9a0-e359bf6f1fdb None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.568220 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4fc96-4d9f-42f5-b9a0-e359bf6f1fdb None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.568585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4fc96-4d9f-42f5-b9a0-e359bf6f1fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.605186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-f7d4fc96-4d9f-42f5-b9a0-e359bf6f1fdb None None] MFA Rules not processed for user `8b8b858008fa4d61a2b0ede0d3b67994`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:07.606532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f7d4fc96-4d9f-42f5-b9a0-e359bf6f1fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:07.674356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1275/2547] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:07.679148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8074ae6-7b28-4a7f-8299-90074337b9fe admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:07.693692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:07.750568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8074ae6-7b28-4a7f-8299-90074337b9fe admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:07.755796 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95752963-177a-454e-9d3e-d5c55a4c6524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:07.756417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95752963-177a-454e-9d3e-d5c55a4c6524 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.756694 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95752963-177a-454e-9d3e-d5c55a4c6524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.756960 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95752963-177a-454e-9d3e-d5c55a4c6524 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.757667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95752963-177a-454e-9d3e-d5c55a4c6524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:07.759559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95752963-177a-454e-9d3e-d5c55a4c6524 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:07.790222 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1273/2548] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:07 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:25:07.795576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4fc96-4d9f-42f5-b9a0-e359bf6f1fdb None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:07.806825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4fc96-4d9f-42f5-b9a0-e359bf6f1fdb None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:07.849523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdc03d-3f9c-4c43-9412-2341c1afc6ee None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.849808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdc03d-3f9c-4c43-9412-2341c1afc6ee None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.850083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdc03d-3f9c-4c43-9412-2341c1afc6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.871740 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-6fcdc03d-3f9c-4c43-9412-2341c1afc6ee None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:07.871961 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77e57c-81b9-42cf-8b6b-34beea8112c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:07.872554 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77e57c-81b9-42cf-8b6b-34beea8112c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.872831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77e57c-81b9-42cf-8b6b-34beea8112c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.872949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6fcdc03d-3f9c-4c43-9412-2341c1afc6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:07.873100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77e57c-81b9-42cf-8b6b-34beea8112c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.873774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77e57c-81b9-42cf-8b6b-34beea8112c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:07.875686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77e57c-81b9-42cf-8b6b-34beea8112c1 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:07.895141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:07.901038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1276/2549] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:07 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:07.905710 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77e57c-81b9-42cf-8b6b-34beea8112c1 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:07.916861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77e57c-81b9-42cf-8b6b-34beea8112c1 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:07.922190 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72b4b0-5c92-4df3-bb40-e4f7e4256cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:07.922798 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b4b0-5c92-4df3-bb40-e4f7e4256cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.923074 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b4b0-5c92-4df3-bb40-e4f7e4256cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.923405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b4b0-5c92-4df3-bb40-e4f7e4256cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.924049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72b4b0-5c92-4df3-bb40-e4f7e4256cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:07.925662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72b4b0-5c92-4df3-bb40-e4f7e4256cb5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:07.934577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1274/2550] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 31 00:25:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:07.936034 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1277/2551] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:25:07.940337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdc03d-3f9c-4c43-9412-2341c1afc6ee None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:07.946942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72b4b0-5c92-4df3-bb40-e4f7e4256cb5 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:07.952541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdc03d-3f9c-4c43-9412-2341c1afc6ee None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:07.957605 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd0445-b20b-4ae6-92e3-e566e5484f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:07.958423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd0445-b20b-4ae6-92e3-e566e5484f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.958690 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd0445-b20b-4ae6-92e3-e566e5484f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.959119 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd0445-b20b-4ae6-92e3-e566e5484f1e admin admin] PATH_INFO: `/v3/projects/2e14d7f21ab440a8b9597017f571dec5/users/f15f4247572f4b3a91a9d5d32688ecb2/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.975211 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd0445-b20b-4ae6-92e3-e566e5484f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e14d7f21ab440a8b9597017f571dec5, user_id=f15f4247572f4b3a91a9d5d32688ecb2, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:07.977909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd0445-b20b-4ae6-92e3-e566e5484f1e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:07.993049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1275/2552] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:07 2022] PUT /identity/v3/projects/2e14d7f21ab440a8b9597017f571dec5/users/f15f4247572f4b3a91a9d5d32688ecb2/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:07.997425 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd0445-b20b-4ae6-92e3-e566e5484f1e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:08.020316 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72b4b0-5c92-4df3-bb40-e4f7e4256cb5 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:08.060336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd0445-b20b-4ae6-92e3-e566e5484f1e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:08.066150 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6f147-82f6-4720-aeab-a6573ec7cf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:08.066766 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6f147-82f6-4720-aeab-a6573ec7cf3d admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:08.067032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6f147-82f6-4720-aeab-a6573ec7cf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:08.067417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6f147-82f6-4720-aeab-a6573ec7cf3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:08.068049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6f147-82f6-4720-aeab-a6573ec7cf3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:08.069689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6f147-82f6-4720-aeab-a6573ec7cf3d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:08.083626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1276/2553] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:08.083826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457ef2a-6f4e-4483-8b87-7a9238021351 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:08.084318 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457ef2a-6f4e-4483-8b87-7a9238021351 service swift] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:08.084703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457ef2a-6f4e-4483-8b87-7a9238021351 service swift] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:08.084792 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6f147-82f6-4720-aeab-a6573ec7cf3d admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:08.085012 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457ef2a-6f4e-4483-8b87-7a9238021351 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:08.104123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6f147-82f6-4720-aeab-a6573ec7cf3d admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:08.109001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce0786-531e-4b76-9647-38e19f3f48fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:08.109682 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce0786-531e-4b76-9647-38e19f3f48fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:08.109972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce0786-531e-4b76-9647-38e19f3f48fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:08.110198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce0786-531e-4b76-9647-38e19f3f48fe admin admin] PATH_INFO: `/v3/projects/2e14d7f21ab440a8b9597017f571dec5/users/f15f4247572f4b3a91a9d5d32688ecb2/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:08.112147 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce0786-531e-4b76-9647-38e19f3f48fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e14d7f21ab440a8b9597017f571dec5, user_id=f15f4247572f4b3a91a9d5d32688ecb2, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:08.115093 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce0786-531e-4b76-9647-38e19f3f48fe admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:08.127388 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1277/2554] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:08 2022] PUT /identity/v3/projects/2e14d7f21ab440a8b9597017f571dec5/users/f15f4247572f4b3a91a9d5d32688ecb2/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:08.138352 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17628e3-710e-4667-b6ae-ec2b63a10b34 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:08.138635 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17628e3-710e-4667-b6ae-ec2b63a10b34 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:08.138904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17628e3-710e-4667-b6ae-ec2b63a10b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:08.147289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:08.159382 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457ef2a-6f4e-4483-8b87-7a9238021351 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:08.161155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457ef2a-6f4e-4483-8b87-7a9238021351 service swift] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:08.170084 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1278/2555] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:25:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:25:08.170283 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-f17628e3-710e-4667-b6ae-ec2b63a10b34 None None] MFA Rules not processed for user `f15f4247572f4b3a91a9d5d32688ecb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:08.171395 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f17628e3-710e-4667-b6ae-ec2b63a10b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:08.243838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1278/2556] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:08.255964 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457ef2a-6f4e-4483-8b87-7a9238021351 service swift] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:08.257547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b457ef2a-6f4e-4483-8b87-7a9238021351 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:08.305820 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:08.331924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457ef2a-6f4e-4483-8b87-7a9238021351 service swift] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:08.388522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9a672-13a0-4c6b-ade8-c0e4bf51b637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:08.389181 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9a672-13a0-4c6b-ade8-c0e4bf51b637 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:08.389533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9a672-13a0-4c6b-ade8-c0e4bf51b637 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:08.389845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9a672-13a0-4c6b-ade8-c0e4bf51b637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:08.399793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9a672-13a0-4c6b-ade8-c0e4bf51b637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:08.402052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9a672-13a0-4c6b-ade8-c0e4bf51b637 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:08.411643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba95e80-d41c-49c9-afce-2d749effe023 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:08.412008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba95e80-d41c-49c9-afce-2d749effe023 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:08.412317 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1279/2557] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:08.412450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba95e80-d41c-49c9-afce-2d749effe023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:08.433230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-fba95e80-d41c-49c9-afce-2d749effe023 None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:08.434300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-fba95e80-d41c-49c9-afce-2d749effe023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:08.492586 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1279/2558] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 31 00:25:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:08.493720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9a672-13a0-4c6b-ade8-c0e4bf51b637 service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:08.503938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9a672-13a0-4c6b-ade8-c0e4bf51b637 service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:08.504587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba95e80-d41c-49c9-afce-2d749effe023 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:08.508094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02d365-e538-4674-baa9-8b4c603dbfcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:08.508702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02d365-e538-4674-baa9-8b4c603dbfcd service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:08.508972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02d365-e538-4674-baa9-8b4c603dbfcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:08.509263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02d365-e538-4674-baa9-8b4c603dbfcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:08.570074 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02d365-e538-4674-baa9-8b4c603dbfcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:08.571621 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02d365-e538-4674-baa9-8b4c603dbfcd service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:08.572749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba95e80-d41c-49c9-afce-2d749effe023 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:08.578233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21911ca2-b90c-4106-8078-44e7c169e6cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:08.578849 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21911ca2-b90c-4106-8078-44e7c169e6cc service swift] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:08.579288 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21911ca2-b90c-4106-8078-44e7c169e6cc service swift] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:08.579424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21911ca2-b90c-4106-8078-44e7c169e6cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:08.581675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1280/2559] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:08.590541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21911ca2-b90c-4106-8078-44e7c169e6cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:08.592317 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21911ca2-b90c-4106-8078-44e7c169e6cc service swift] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:08.600970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1280/2560] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:25:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:25:08.956929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261c1d4-18f0-42f5-8da6-aca64bc4053a None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:08.957411 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261c1d4-18f0-42f5-8da6-aca64bc4053a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:08.957516 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261c1d4-18f0-42f5-8da6-aca64bc4053a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:08.979198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7261c1d4-18f0-42f5-8da6-aca64bc4053a None None] MFA Rules not processed for user `ab3f95b2205c4429acb61bf01ea1ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:08.980581 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7261c1d4-18f0-42f5-8da6-aca64bc4053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:08.988855 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1281/2561] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 31 00:25:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:09.003481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21911ca2-b90c-4106-8078-44e7c169e6cc service swift] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:09.014573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21911ca2-b90c-4106-8078-44e7c169e6cc service swift] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:09.021717 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bd2d5-8ccf-41c9-b4de-db3947d9efc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85c5a65170b046d08b0d1f01c6550730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:09.022311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bd2d5-8ccf-41c9-b4de-db3947d9efc9 service swift] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:09.022577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bd2d5-8ccf-41c9-b4de-db3947d9efc9 service swift] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:09.022836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bd2d5-8ccf-41c9-b4de-db3947d9efc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:09.035547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bd2d5-8ccf-41c9-b4de-db3947d9efc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:09.038283 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bd2d5-8ccf-41c9-b4de-db3947d9efc9 service swift] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:09.048040 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1281/2562] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 31 00:25:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:25:11.221176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261c1d4-18f0-42f5-8da6-aca64bc4053a None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:11.222751 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7261c1d4-18f0-42f5-8da6-aca64bc4053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:11.290545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261c1d4-18f0-42f5-8da6-aca64bc4053a None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:11.295597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:11.296246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:11.296521 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:11.296793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] PATH_INFO: `/v3/users/94c043aab93d4c0bae8f8a898eed7595` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:11.298084 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c043aab93d4c0bae8f8a898eed7595)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:11.300176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:11.332862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:11.354146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c043aab93d4c0bae8f8a898eed7595'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:11.363641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c043aab93d4c0bae8f8a898eed7595'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:11.364467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c043aab93d4c0bae8f8a898eed7595'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:11.372200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c043aab93d4c0bae8f8a898eed7595'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:11.389129 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c043aab93d4c0bae8f8a898eed7595'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:11.397874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1282/2563] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:25:11 2022] DELETE /identity/v3/users/94c043aab93d4c0bae8f8a898eed7595 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:11.403302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7702f53-d4b4-43e8-9b4e-d399bd136001 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:11.403999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7702f53-d4b4-43e8-9b4e-d399bd136001 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:11.403999 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7702f53-d4b4-43e8-9b4e-d399bd136001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:11.424653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-c7702f53-d4b4-43e8-9b4e-d399bd136001 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:11.425946 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c7702f53-d4b4-43e8-9b4e-d399bd136001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:11.430159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:11.488466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1282/2564] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:11.499121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:11.500663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:11.559551 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdf84f-10d9-4410-9b5b-e1f1574ddc1c admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:11.563862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0f543-b362-4687-9c4c-b3f56f2f167c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:11.564482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0f543-b362-4687-9c4c-b3f56f2f167c service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:11.564757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0f543-b362-4687-9c4c-b3f56f2f167c service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:11.565023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0f543-b362-4687-9c4c-b3f56f2f167c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:11.574541 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0f543-b362-4687-9c4c-b3f56f2f167c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:11.575983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0f543-b362-4687-9c4c-b3f56f2f167c service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:11.585569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1283/2565] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:11.766718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7702f53-d4b4-43e8-9b4e-d399bd136001 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:11.768735 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c7702f53-d4b4-43e8-9b4e-d399bd136001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:11.782414 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7702f53-d4b4-43e8-9b4e-d399bd136001 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:11.787348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:11.788015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:11.788282 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:11.789031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] PATH_INFO: `/v3/projects/af8fbcd5569840cda41758c3b4e05003` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:11.790167 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8fbcd5569840cda41758c3b4e05003)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:11.792520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:11.842615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8fbcd5569840cda41758c3b4e05003', 'request_id': 'req-baf466c7-3201-4cd0-94ab-51b848c1107a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:11.851847 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8fbcd5569840cda41758c3b4e05003', 'request_id': 'req-baf466c7-3201-4cd0-94ab-51b848c1107a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:11.858680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8fbcd5569840cda41758c3b4e05003', 'request_id': 'req-baf466c7-3201-4cd0-94ab-51b848c1107a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:11.869764 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] The token cache is being invalidate because project af8fbcd5569840cda41758c3b4e05003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:25:11.870083 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:11.870777 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:11.872298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1283/2566] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:25:11 2022] DELETE /identity/v3/projects/af8fbcd5569840cda41758c3b4e05003 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:21.581229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:DELETE=6,keystone:SELECT=45,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:21.866782 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:38.796392 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0f543-b362-4687-9c4c-b3f56f2f167c service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:38.806306 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0f543-b362-4687-9c4c-b3f56f2f167c service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:38.858860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf55f2-6102-4a9a-94d7-8972320a982b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:38.859471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf55f2-6102-4a9a-94d7-8972320a982b service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:38.859746 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf55f2-6102-4a9a-94d7-8972320a982b service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:38.860015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf55f2-6102-4a9a-94d7-8972320a982b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:38.861976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-00cf55f2-6102-4a9a-94d7-8972320a982b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:38.926270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf55f2-6102-4a9a-94d7-8972320a982b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:38.927689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf55f2-6102-4a9a-94d7-8972320a982b service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:38.937745 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1284/2567] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:39.884171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:39.885758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:39.901077 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf466c7-3201-4cd0-94ab-51b848c1107a admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:39.907253 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:39.907912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:39.908193 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:39.908629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] PATH_INFO: `/v3/users/8b8b858008fa4d61a2b0ede0d3b67994` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:39.909853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8b858008fa4d61a2b0ede0d3b67994)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:39.911864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:39.975504 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8b858008fa4d61a2b0ede0d3b67994'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:39.991029 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8b858008fa4d61a2b0ede0d3b67994'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:39.991802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8b858008fa4d61a2b0ede0d3b67994'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:39.992843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8b858008fa4d61a2b0ede0d3b67994'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:40.004106 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8b858008fa4d61a2b0ede0d3b67994'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:40.019548 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1284/2568] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:25:39 2022] DELETE /identity/v3/users/8b8b858008fa4d61a2b0ede0d3b67994 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:40.024996 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb87c-65ae-477a-8c86-2b8bc12fa4ee None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:40.025543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb87c-65ae-477a-8c86-2b8bc12fa4ee None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:40.025630 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb87c-65ae-477a-8c86-2b8bc12fa4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:40.046182 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-bdafb87c-65ae-477a-8c86-2b8bc12fa4ee None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:40.047397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-bdafb87c-65ae-477a-8c86-2b8bc12fa4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:40.118615 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1285/2569] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:40.129256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:40.130759 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:40.195354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe61076-03cb-44dd-b05d-9ecd60d0b4a4 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:40.199116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc04204-57f0-486d-9afc-037ed9e34688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:40.199718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc04204-57f0-486d-9afc-037ed9e34688 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:40.200004 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc04204-57f0-486d-9afc-037ed9e34688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:40.200281 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc04204-57f0-486d-9afc-037ed9e34688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:40.210581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc04204-57f0-486d-9afc-037ed9e34688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:40.212048 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc04204-57f0-486d-9afc-037ed9e34688 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:40.222871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1285/2570] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:40.671305 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafb87c-65ae-477a-8c86-2b8bc12fa4ee None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:40.672785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-bdafb87c-65ae-477a-8c86-2b8bc12fa4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:40.687479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafb87c-65ae-477a-8c86-2b8bc12fa4ee None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:40.695647 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:40.696642 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:40.696927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:40.697216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] PATH_INFO: `/v3/projects/43152008ba924507bf56b4f834d97ea0` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:40.699882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43152008ba924507bf56b4f834d97ea0)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:40.700450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:40.758875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:40.763142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43152008ba924507bf56b4f834d97ea0', 'request_id': 'req-37c71a50-5657-4c92-b9bc-c7ae07472cc6'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:40.775314 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43152008ba924507bf56b4f834d97ea0', 'request_id': 'req-37c71a50-5657-4c92-b9bc-c7ae07472cc6'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:40.789721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43152008ba924507bf56b4f834d97ea0', 'request_id': 'req-37c71a50-5657-4c92-b9bc-c7ae07472cc6'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:40.806929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] The token cache is being invalidate because project 43152008ba924507bf56b4f834d97ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:25:40.807350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:40.808195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:40.812742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1286/2571] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:25:40 2022] DELETE /identity/v3/projects/43152008ba924507bf56b4f834d97ea0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:40.814032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc04204-57f0-486d-9afc-037ed9e34688 service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:40.824087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc04204-57f0-486d-9afc-037ed9e34688 service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:40.887071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759de336-9a89-4f35-becf-e9fb283e4275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:40.887787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759de336-9a89-4f35-becf-e9fb283e4275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:40.887976 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759de336-9a89-4f35-becf-e9fb283e4275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:40.888251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759de336-9a89-4f35-becf-e9fb283e4275 admin admin] PATH_INFO: `/v3/users/f15f4247572f4b3a91a9d5d32688ecb2` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:40.889424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759de336-9a89-4f35-becf-e9fb283e4275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15f4247572f4b3a91a9d5d32688ecb2)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:40.891383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759de336-9a89-4f35-becf-e9fb283e4275 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:40.908831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:40.947450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-759de336-9a89-4f35-becf-e9fb283e4275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15f4247572f4b3a91a9d5d32688ecb2'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:40.961684 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-759de336-9a89-4f35-becf-e9fb283e4275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15f4247572f4b3a91a9d5d32688ecb2'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:40.962712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-759de336-9a89-4f35-becf-e9fb283e4275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15f4247572f4b3a91a9d5d32688ecb2'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:40.963592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-759de336-9a89-4f35-becf-e9fb283e4275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15f4247572f4b3a91a9d5d32688ecb2'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:40.973198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-759de336-9a89-4f35-becf-e9fb283e4275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15f4247572f4b3a91a9d5d32688ecb2'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:40.988545 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1286/2572] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:25:40 2022] DELETE /identity/v3/users/f15f4247572f4b3a91a9d5d32688ecb2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:41.377937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:41.380295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:41.404480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c71a50-5657-4c92-b9bc-c7ae07472cc6 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:41.476999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca4c22-e86a-4734-8f55-3de21a85ea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:41.477812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca4c22-e86a-4734-8f55-3de21a85ea18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:41.478183 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca4c22-e86a-4734-8f55-3de21a85ea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:41.478524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca4c22-e86a-4734-8f55-3de21a85ea18 admin admin] PATH_INFO: `/v3/projects/2e14d7f21ab440a8b9597017f571dec5` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:41.479717 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca4c22-e86a-4734-8f55-3de21a85ea18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e14d7f21ab440a8b9597017f571dec5)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:41.481734 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca4c22-e86a-4734-8f55-3de21a85ea18 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:41.532440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-21ca4c22-e86a-4734-8f55-3de21a85ea18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e14d7f21ab440a8b9597017f571dec5', 'request_id': 'req-21ca4c22-e86a-4734-8f55-3de21a85ea18'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:41.541555 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-21ca4c22-e86a-4734-8f55-3de21a85ea18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e14d7f21ab440a8b9597017f571dec5', 'request_id': 'req-21ca4c22-e86a-4734-8f55-3de21a85ea18'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:41.548507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-21ca4c22-e86a-4734-8f55-3de21a85ea18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e14d7f21ab440a8b9597017f571dec5', 'request_id': 'req-21ca4c22-e86a-4734-8f55-3de21a85ea18'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:41.561373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-21ca4c22-e86a-4734-8f55-3de21a85ea18 admin admin] The token cache is being invalidate because project 2e14d7f21ab440a8b9597017f571dec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:25:41.561631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-21ca4c22-e86a-4734-8f55-3de21a85ea18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:41.562329 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-21ca4c22-e86a-4734-8f55-3de21a85ea18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:41.563852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1287/2573] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:25:41 2022] DELETE /identity/v3/projects/2e14d7f21ab440a8b9597017f571dec5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:41.569002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee409f35-843f-43f9-92d1-fa8eac2294f0 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:41.569397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee409f35-843f-43f9-92d1-fa8eac2294f0 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:41.569687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee409f35-843f-43f9-92d1-fa8eac2294f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:41.591393 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ee409f35-843f-43f9-92d1-fa8eac2294f0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:41.592817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ee409f35-843f-43f9-92d1-fa8eac2294f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:41.656187 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1287/2574] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:41.665361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83d12-35b1-443e-ade2-cbb968b47509 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:41.665840 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83d12-35b1-443e-ade2-cbb968b47509 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:41.666184 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83d12-35b1-443e-ade2-cbb968b47509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:41.687564 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-6fa83d12-35b1-443e-ade2-cbb968b47509 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:41.688832 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-6fa83d12-35b1-443e-ade2-cbb968b47509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:41.697251 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1288/2575] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:41.701859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee409f35-843f-43f9-92d1-fa8eac2294f0 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:41.712138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee409f35-843f-43f9-92d1-fa8eac2294f0 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:41.718216 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d19db9-590a-4c14-a3d2-db6153363ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:41.718860 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d19db9-590a-4c14-a3d2-db6153363ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:41.719132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d19db9-590a-4c14-a3d2-db6153363ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:41.719399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d19db9-590a-4c14-a3d2-db6153363ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:41.720046 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d19db9-590a-4c14-a3d2-db6153363ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:25:41.720343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d19db9-590a-4c14-a3d2-db6153363ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:41.722007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d19db9-590a-4c14-a3d2-db6153363ec1 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:41.735209 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1288/2576] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:25:41.739582 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa83d12-35b1-443e-ade2-cbb968b47509 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:41.752182 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa83d12-35b1-443e-ade2-cbb968b47509 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:41.758629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8a88d-db7c-4d8d-8613-09bcb1e7f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:41.759270 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8a88d-db7c-4d8d-8613-09bcb1e7f344 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:41.759542 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8a88d-db7c-4d8d-8613-09bcb1e7f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:41.759797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8a88d-db7c-4d8d-8613-09bcb1e7f344 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:41.761024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8a88d-db7c-4d8d-8613-09bcb1e7f344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:41.762383 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8a88d-db7c-4d8d-8613-09bcb1e7f344 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:41.802864 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1289/2577] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:41 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:25:41.806523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d19db9-590a-4c14-a3d2-db6153363ec1 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:41.817606 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d19db9-590a-4c14-a3d2-db6153363ec1 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:41.898665 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28526de-bbba-460c-bcae-33857e0bd494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:41.900095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28526de-bbba-460c-bcae-33857e0bd494 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:41.900590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28526de-bbba-460c-bcae-33857e0bd494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:41.901072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28526de-bbba-460c-bcae-33857e0bd494 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:41.902404 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28526de-bbba-460c-bcae-33857e0bd494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:41.904846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28526de-bbba-460c-bcae-33857e0bd494 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:41.934956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1289/2578] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:41 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:41.936292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8a88d-db7c-4d8d-8613-09bcb1e7f344 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:41.948481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8a88d-db7c-4d8d-8613-09bcb1e7f344 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:41.953857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44a572-f6ae-425c-b3a5-3c3093042c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:41.954405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44a572-f6ae-425c-b3a5-3c3093042c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:41.954675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44a572-f6ae-425c-b3a5-3c3093042c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:41.954944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44a572-f6ae-425c-b3a5-3c3093042c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:41.955998 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44a572-f6ae-425c-b3a5-3c3093042c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:41.957180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44a572-f6ae-425c-b3a5-3c3093042c43 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:41.970722 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1290/2579] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:41.975033 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28526de-bbba-460c-bcae-33857e0bd494 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:41.985427 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28526de-bbba-460c-bcae-33857e0bd494 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:41.990521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e0c87-6d18-4665-8b26-f0ae60887a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:41.991121 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e0c87-6d18-4665-8b26-f0ae60887a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:41.991396 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e0c87-6d18-4665-8b26-f0ae60887a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:41.991666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e0c87-6d18-4665-8b26-f0ae60887a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:41.992309 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e0c87-6d18-4665-8b26-f0ae60887a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:41.993959 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e0c87-6d18-4665-8b26-f0ae60887a72 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:42.000171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:42.007139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1290/2580] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:42.012038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44a572-f6ae-425c-b3a5-3c3093042c43 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:42.023591 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44a572-f6ae-425c-b3a5-3c3093042c43 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:42.029157 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803a8cd-1ac6-4782-9632-9daf9201c198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:42.030070 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803a8cd-1ac6-4782-9632-9daf9201c198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:42.030407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803a8cd-1ac6-4782-9632-9daf9201c198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:42.030744 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803a8cd-1ac6-4782-9632-9daf9201c198 admin admin] PATH_INFO: `/v3/projects/515cbb39ade04ff78fe5b578627abbc8/users/7dc37614e8534da9872ab851c1f55998/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:42.046141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803a8cd-1ac6-4782-9632-9daf9201c198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=515cbb39ade04ff78fe5b578627abbc8, user_id=7dc37614e8534da9872ab851c1f55998, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:42.048782 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803a8cd-1ac6-4782-9632-9daf9201c198 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:42.060285 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:42.066158 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1291/2581] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:42 2022] PUT /identity/v3/projects/515cbb39ade04ff78fe5b578627abbc8/users/7dc37614e8534da9872ab851c1f55998/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:42.077176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a912211-f4c2-4295-b958-19ca1b36edcb None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:42.077563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a912211-f4c2-4295-b958-19ca1b36edcb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:42.077858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a912211-f4c2-4295-b958-19ca1b36edcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:42.115615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-7a912211-f4c2-4295-b958-19ca1b36edcb None None] MFA Rules not processed for user `7dc37614e8534da9872ab851c1f55998`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:42.116838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7a912211-f4c2-4295-b958-19ca1b36edcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:42.189905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1291/2582] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:42.194863 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803a8cd-1ac6-4782-9632-9daf9201c198 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:42.283996 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803a8cd-1ac6-4782-9632-9daf9201c198 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:42.292493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee38fc-eee2-4a76-9e57-2422be662c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:42.293195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee38fc-eee2-4a76-9e57-2422be662c02 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:42.293528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee38fc-eee2-4a76-9e57-2422be662c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:42.293796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee38fc-eee2-4a76-9e57-2422be662c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:42.294453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee38fc-eee2-4a76-9e57-2422be662c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:42.296374 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee38fc-eee2-4a76-9e57-2422be662c02 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:42.331485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1292/2583] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:42 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:25:42.335550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a912211-f4c2-4295-b958-19ca1b36edcb None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:42.350840 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a912211-f4c2-4295-b958-19ca1b36edcb None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:42.422226 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee38fc-eee2-4a76-9e57-2422be662c02 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:42.424183 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-08ee38fc-eee2-4a76-9e57-2422be662c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:42.443335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cc986-1fa9-4d30-91a6-7dee405e1992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:42.443995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cc986-1fa9-4d30-91a6-7dee405e1992 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:42.444300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cc986-1fa9-4d30-91a6-7dee405e1992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:42.444568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cc986-1fa9-4d30-91a6-7dee405e1992 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:42.445272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cc986-1fa9-4d30-91a6-7dee405e1992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:42.447207 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cc986-1fa9-4d30-91a6-7dee405e1992 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:42.479286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1292/2584] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:42 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:42.480478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cc986-1fa9-4d30-91a6-7dee405e1992 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:42.491246 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cc986-1fa9-4d30-91a6-7dee405e1992 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:42.496059 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480480f-829f-4fd9-84f9-101d3d95d306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:42.496677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480480f-829f-4fd9-84f9-101d3d95d306 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:42.496948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480480f-829f-4fd9-84f9-101d3d95d306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:42.497241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480480f-829f-4fd9-84f9-101d3d95d306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:42.497898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480480f-829f-4fd9-84f9-101d3d95d306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:42.499535 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480480f-829f-4fd9-84f9-101d3d95d306 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:42.503933 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee38fc-eee2-4a76-9e57-2422be662c02 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:42.511398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:42.511547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1293/2585] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:42.512338 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:42.512621 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:42.512881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] PATH_INFO: `/v3/users/a899638fd4f44d738d98fed19c35babc` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:42.514075 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a899638fd4f44d738d98fed19c35babc)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:42.515671 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480480f-829f-4fd9-84f9-101d3d95d306 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:42.516358 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:42.526330 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480480f-829f-4fd9-84f9-101d3d95d306 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:42.531192 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a52b-98b6-4caf-b4c2-11c53421fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:42.531784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a52b-98b6-4caf-b4c2-11c53421fdae admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:42.532058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a52b-98b6-4caf-b4c2-11c53421fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:42.532328 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a52b-98b6-4caf-b4c2-11c53421fdae admin admin] PATH_INFO: `/v3/projects/5015fac966f148a487600583dce08aec/users/0010d54d40fa443fbe5a12467f0cd7f1/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:42.549077 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508a52b-98b6-4caf-b4c2-11c53421fdae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5015fac966f148a487600583dce08aec, user_id=0010d54d40fa443fbe5a12467f0cd7f1, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:42.552081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508a52b-98b6-4caf-b4c2-11c53421fdae admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:42.567370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1294/2586] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:42 2022] PUT /identity/v3/projects/5015fac966f148a487600583dce08aec/users/0010d54d40fa443fbe5a12467f0cd7f1/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:25:42.570915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a52b-98b6-4caf-b4c2-11c53421fdae admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:42.581482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a899638fd4f44d738d98fed19c35babc'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:42.593289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a899638fd4f44d738d98fed19c35babc'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:42.594061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a899638fd4f44d738d98fed19c35babc'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:42.602874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a899638fd4f44d738d98fed19c35babc'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:42.614979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a899638fd4f44d738d98fed19c35babc'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:42.619689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:42.621603 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1293/2587] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:25:42 2022] DELETE /identity/v3/users/a899638fd4f44d738d98fed19c35babc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:42.637763 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a52b-98b6-4caf-b4c2-11c53421fdae admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:42.699365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdcda3-f698-4e0c-9c80-377efe6fc456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:42.699996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdcda3-f698-4e0c-9c80-377efe6fc456 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:42.700268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdcda3-f698-4e0c-9c80-377efe6fc456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:42.700532 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdcda3-f698-4e0c-9c80-377efe6fc456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:42.701197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdcda3-f698-4e0c-9c80-377efe6fc456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:42.702821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdcda3-f698-4e0c-9c80-377efe6fc456 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:42.713975 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1295/2588] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:25:42.718080 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:42.719559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:42.729481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:42.733701 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826777e-0c49-4330-9e7f-10b3d16af994 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:42.740366 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a9b92-2a15-46d3-9974-f573dba28b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:42.741920 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a9b92-2a15-46d3-9974-f573dba28b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:42.742351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a9b92-2a15-46d3-9974-f573dba28b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:42.742800 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a9b92-2a15-46d3-9974-f573dba28b3c admin admin] PATH_INFO: `/v3/projects/5015fac966f148a487600583dce08aec/users/0010d54d40fa443fbe5a12467f0cd7f1/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:42.745109 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a9b92-2a15-46d3-9974-f573dba28b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5015fac966f148a487600583dce08aec, user_id=0010d54d40fa443fbe5a12467f0cd7f1, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:42.747830 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a9b92-2a15-46d3-9974-f573dba28b3c admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:42.758414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1294/2589] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:42 2022] PUT /identity/v3/projects/5015fac966f148a487600583dce08aec/users/0010d54d40fa443fbe5a12467f0cd7f1/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:42.769234 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83a2eb-3660-42cc-a14e-ba0ee03d6050 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:42.769568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83a2eb-3660-42cc-a14e-ba0ee03d6050 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:42.769839 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83a2eb-3660-42cc-a14e-ba0ee03d6050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:42.798952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ef83a2eb-3660-42cc-a14e-ba0ee03d6050 None None] MFA Rules not processed for user `0010d54d40fa443fbe5a12467f0cd7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:42.800521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ef83a2eb-3660-42cc-a14e-ba0ee03d6050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:42.805075 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a9b92-2a15-46d3-9974-f573dba28b3c admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:42.807949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-871a9b92-2a15-46d3-9974-f573dba28b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:42.880237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1296/2590] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:42.884847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a9b92-2a15-46d3-9974-f573dba28b3c admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:42.889899 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a86ab-2fb3-4e26-8e3a-0021ba996e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:42.890713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a86ab-2fb3-4e26-8e3a-0021ba996e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:42.891085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a86ab-2fb3-4e26-8e3a-0021ba996e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:42.891359 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a86ab-2fb3-4e26-8e3a-0021ba996e20 admin admin] PATH_INFO: `/v3/projects/7eb9f2afc1a34e62874b87b7e5f90483` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:42.891867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83a2eb-3660-42cc-a14e-ba0ee03d6050 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:42.892669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a86ab-2fb3-4e26-8e3a-0021ba996e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb9f2afc1a34e62874b87b7e5f90483)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:42.893589 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ef83a2eb-3660-42cc-a14e-ba0ee03d6050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:42.894942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a86ab-2fb3-4e26-8e3a-0021ba996e20 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:42.943862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-625a86ab-2fb3-4e26-8e3a-0021ba996e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb9f2afc1a34e62874b87b7e5f90483', 'request_id': 'req-625a86ab-2fb3-4e26-8e3a-0021ba996e20'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:42.952761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-625a86ab-2fb3-4e26-8e3a-0021ba996e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb9f2afc1a34e62874b87b7e5f90483', 'request_id': 'req-625a86ab-2fb3-4e26-8e3a-0021ba996e20'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:42.953382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83a2eb-3660-42cc-a14e-ba0ee03d6050 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:42.959940 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-625a86ab-2fb3-4e26-8e3a-0021ba996e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb9f2afc1a34e62874b87b7e5f90483', 'request_id': 'req-625a86ab-2fb3-4e26-8e3a-0021ba996e20'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:42.970512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-625a86ab-2fb3-4e26-8e3a-0021ba996e20 admin admin] The token cache is being invalidate because project 7eb9f2afc1a34e62874b87b7e5f90483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:25:42.970740 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-625a86ab-2fb3-4e26-8e3a-0021ba996e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:42.971418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-625a86ab-2fb3-4e26-8e3a-0021ba996e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:42.972951 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1295/2591] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:25:42 2022] DELETE /identity/v3/projects/7eb9f2afc1a34e62874b87b7e5f90483 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:25:42.978064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a32f93-22cc-4c2e-9402-2c92c4fdf4c8 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:42.978344 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a32f93-22cc-4c2e-9402-2c92c4fdf4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:42.978618 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a32f93-22cc-4c2e-9402-2c92c4fdf4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:42.980800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:42.999259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-44a32f93-22cc-4c2e-9402-2c92c4fdf4c8 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:43.000583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-44a32f93-22cc-4c2e-9402-2c92c4fdf4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:43.004873 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717b2ea-1dd7-4b49-b4de-31331e65e06c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:43.005562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717b2ea-1dd7-4b49-b4de-31331e65e06c service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.005825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717b2ea-1dd7-4b49-b4de-31331e65e06c service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.006595 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717b2ea-1dd7-4b49-b4de-31331e65e06c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.008305 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c717b2ea-1dd7-4b49-b4de-31331e65e06c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:43.061818 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1296/2592] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:43.071310 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06653638-a9b9-4dd8-a83d-b9fa3b2db7c4 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.071584 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06653638-a9b9-4dd8-a83d-b9fa3b2db7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.071867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06653638-a9b9-4dd8-a83d-b9fa3b2db7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.074212 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717b2ea-1dd7-4b49-b4de-31331e65e06c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:43.075664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717b2ea-1dd7-4b49-b4de-31331e65e06c service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:43.092090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1297/2593] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:25:43.093433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-06653638-a9b9-4dd8-a83d-b9fa3b2db7c4 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:43.094837 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-06653638-a9b9-4dd8-a83d-b9fa3b2db7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:43.106773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1297/2594] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:43.107917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717b2ea-1dd7-4b49-b4de-31331e65e06c service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:43.119151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717b2ea-1dd7-4b49-b4de-31331e65e06c service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:43.125505 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbbf92-b79a-4da5-8f23-1de7e8d5750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:43.125985 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbbf92-b79a-4da5-8f23-1de7e8d5750f admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.126489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbbf92-b79a-4da5-8f23-1de7e8d5750f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.126489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbbf92-b79a-4da5-8f23-1de7e8d5750f admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.127144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbbf92-b79a-4da5-8f23-1de7e8d5750f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:25:43.127437 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbbf92-b79a-4da5-8f23-1de7e8d5750f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:43.129877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbbf92-b79a-4da5-8f23-1de7e8d5750f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:43.144577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1298/2595] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:25:43.149072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06653638-a9b9-4dd8-a83d-b9fa3b2db7c4 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:43.160321 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06653638-a9b9-4dd8-a83d-b9fa3b2db7c4 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:43.166525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838a185-093b-45aa-b2be-fdf7600d07f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:43.169232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838a185-093b-45aa-b2be-fdf7600d07f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.169232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838a185-093b-45aa-b2be-fdf7600d07f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.169232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838a185-093b-45aa-b2be-fdf7600d07f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.169232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838a185-093b-45aa-b2be-fdf7600d07f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:43.171005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838a185-093b-45aa-b2be-fdf7600d07f6 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:43.180670 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbbf92-b79a-4da5-8f23-1de7e8d5750f admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:43.183667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-37bbbf92-b79a-4da5-8f23-1de7e8d5750f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:43.188214 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:43.200961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbbf92-b79a-4da5-8f23-1de7e8d5750f admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:43.206445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cf9e9-42b6-4f98-b9dd-949b35fa6b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:43.207145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cf9e9-42b6-4f98-b9dd-949b35fa6b45 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.207650 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cf9e9-42b6-4f98-b9dd-949b35fa6b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.207783 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1298/2596] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:43 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:43.209526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cf9e9-42b6-4f98-b9dd-949b35fa6b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.211465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3f7cf9e9-42b6-4f98-b9dd-949b35fa6b45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:43.211817 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838a185-093b-45aa-b2be-fdf7600d07f6 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:43.282489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cf9e9-42b6-4f98-b9dd-949b35fa6b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:43.284050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cf9e9-42b6-4f98-b9dd-949b35fa6b45 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:43.284240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838a185-093b-45aa-b2be-fdf7600d07f6 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:43.289001 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623b2f-bae7-4e6b-9463-46796913eff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:43.289702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623b2f-bae7-4e6b-9463-46796913eff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.289974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623b2f-bae7-4e6b-9463-46796913eff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.290243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623b2f-bae7-4e6b-9463-46796913eff2 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.290878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca623b2f-bae7-4e6b-9463-46796913eff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:43.292799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca623b2f-bae7-4e6b-9463-46796913eff2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:43.294789 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1299/2597] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:25:43.316831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1299/2598] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:43 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:25:43.321637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cf9e9-42b6-4f98-b9dd-949b35fa6b45 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:43.333128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cf9e9-42b6-4f98-b9dd-949b35fa6b45 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:43.339824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22565fe-a1e4-4709-a810-522db8017682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:43.340563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22565fe-a1e4-4709-a810-522db8017682 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.340935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22565fe-a1e4-4709-a810-522db8017682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.341050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22565fe-a1e4-4709-a810-522db8017682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.341934 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22565fe-a1e4-4709-a810-522db8017682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:43.343911 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22565fe-a1e4-4709-a810-522db8017682 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:43.361582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1300/2599] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:43.362833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623b2f-bae7-4e6b-9463-46796913eff2 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:43.373541 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623b2f-bae7-4e6b-9463-46796913eff2 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:43.378936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cd5ee-f4c0-46b7-9508-2fdc27048642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:43.379598 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd5ee-f4c0-46b7-9508-2fdc27048642 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.379989 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd5ee-f4c0-46b7-9508-2fdc27048642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.380407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd5ee-f4c0-46b7-9508-2fdc27048642 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.381064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cd5ee-f4c0-46b7-9508-2fdc27048642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:43.382718 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cd5ee-f4c0-46b7-9508-2fdc27048642 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:43.394500 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1300/2600] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:25:43.399400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22565fe-a1e4-4709-a810-522db8017682 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:43.415522 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22565fe-a1e4-4709-a810-522db8017682 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:43.420403 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa3f79-82a2-41fb-adf4-d509595ee7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:43.421165 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa3f79-82a2-41fb-adf4-d509595ee7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.421389 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa3f79-82a2-41fb-adf4-d509595ee7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.421690 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa3f79-82a2-41fb-adf4-d509595ee7b3 admin admin] PATH_INFO: `/v3/projects/dcdc3372c24f4eb594be2e389931d467/users/bb8a9601d47643919dbe9f17a4ea0e11/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.438712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa3f79-82a2-41fb-adf4-d509595ee7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcdc3372c24f4eb594be2e389931d467, user_id=bb8a9601d47643919dbe9f17a4ea0e11, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:43.441477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa3f79-82a2-41fb-adf4-d509595ee7b3 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:43.456313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1301/2601] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:43 2022] PUT /identity/v3/projects/dcdc3372c24f4eb594be2e389931d467/users/bb8a9601d47643919dbe9f17a4ea0e11/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:43.467388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b5dd5-7c45-40a1-b559-d477f1fd0d6a None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.467916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b5dd5-7c45-40a1-b559-d477f1fd0d6a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.467916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b5dd5-7c45-40a1-b559-d477f1fd0d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.630133 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-0f6b5dd5-7c45-40a1-b559-d477f1fd0d6a None None] MFA Rules not processed for user `bb8a9601d47643919dbe9f17a4ea0e11`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:43.631390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0f6b5dd5-7c45-40a1-b559-d477f1fd0d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:43.703292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1301/2602] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:43.707937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa3f79-82a2-41fb-adf4-d509595ee7b3 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:43.741148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:43.784426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa3f79-82a2-41fb-adf4-d509595ee7b3 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:43.789445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1e047-9334-4ab0-bccc-8708eee3d176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:43.790042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1e047-9334-4ab0-bccc-8708eee3d176 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.790309 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1e047-9334-4ab0-bccc-8708eee3d176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.790571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1e047-9334-4ab0-bccc-8708eee3d176 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.791173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1e047-9334-4ab0-bccc-8708eee3d176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:43.793056 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1e047-9334-4ab0-bccc-8708eee3d176 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:43.827373 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1302/2603] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:43 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:43.833740 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b5dd5-7c45-40a1-b559-d477f1fd0d6a None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:43.844482 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b5dd5-7c45-40a1-b559-d477f1fd0d6a None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:43.916185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94698f-874e-4d21-9f49-5b3bfea2dbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:43.916973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94698f-874e-4d21-9f49-5b3bfea2dbef admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.917352 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94698f-874e-4d21-9f49-5b3bfea2dbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.917665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94698f-874e-4d21-9f49-5b3bfea2dbef admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.918568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94698f-874e-4d21-9f49-5b3bfea2dbef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:43.921752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94698f-874e-4d21-9f49-5b3bfea2dbef admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:43.931483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:43.948839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1302/2604] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:43 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:43.953054 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1e047-9334-4ab0-bccc-8708eee3d176 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:43.963594 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1e047-9334-4ab0-bccc-8708eee3d176 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:43.968475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fe7e7-6568-4a0a-b69b-ce73c62473e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:43.969096 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fe7e7-6568-4a0a-b69b-ce73c62473e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.969407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fe7e7-6568-4a0a-b69b-ce73c62473e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.969680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fe7e7-6568-4a0a-b69b-ce73c62473e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.970342 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fe7e7-6568-4a0a-b69b-ce73c62473e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:43.971932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fe7e7-6568-4a0a-b69b-ce73c62473e9 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:43.982944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1303/2605] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:43.987259 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94698f-874e-4d21-9f49-5b3bfea2dbef admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:43.997540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94698f-874e-4d21-9f49-5b3bfea2dbef admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:44.003534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee304d-7e86-4cae-ac47-f49e16632755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:44.004219 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee304d-7e86-4cae-ac47-f49e16632755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:44.004479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee304d-7e86-4cae-ac47-f49e16632755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:44.004738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee304d-7e86-4cae-ac47-f49e16632755 admin admin] PATH_INFO: `/v3/projects/f1da734c3514496bb4ecdfa2e3a3424a/users/f7d5114426074aea8efaaa2fbe7cb92f/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:44.020195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee304d-7e86-4cae-ac47-f49e16632755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1da734c3514496bb4ecdfa2e3a3424a, user_id=f7d5114426074aea8efaaa2fbe7cb92f, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:44.022979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee304d-7e86-4cae-ac47-f49e16632755 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:44.037753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1303/2606] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:43 2022] PUT /identity/v3/projects/f1da734c3514496bb4ecdfa2e3a3424a/users/f7d5114426074aea8efaaa2fbe7cb92f/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:44.041713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fe7e7-6568-4a0a-b69b-ce73c62473e9 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:44.052644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fe7e7-6568-4a0a-b69b-ce73c62473e9 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:44.114000 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecc370-c510-45b6-bc6d-21a5599af1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:44.115172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecc370-c510-45b6-bc6d-21a5599af1ca admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:44.115456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecc370-c510-45b6-bc6d-21a5599af1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:44.115721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecc370-c510-45b6-bc6d-21a5599af1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:44.116359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aecc370-c510-45b6-bc6d-21a5599af1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:44.118042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aecc370-c510-45b6-bc6d-21a5599af1ca admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:44.128032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1304/2607] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:44.133065 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee304d-7e86-4cae-ac47-f49e16632755 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:44.143726 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee304d-7e86-4cae-ac47-f49e16632755 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:44.149386 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981b440-f534-4746-b059-247c1107a353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:44.150028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981b440-f534-4746-b059-247c1107a353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:44.150304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981b440-f534-4746-b059-247c1107a353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:44.150568 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981b440-f534-4746-b059-247c1107a353 admin admin] PATH_INFO: `/v3/projects/f1da734c3514496bb4ecdfa2e3a3424a/users/f7d5114426074aea8efaaa2fbe7cb92f/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:44.152525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981b440-f534-4746-b059-247c1107a353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1da734c3514496bb4ecdfa2e3a3424a, user_id=f7d5114426074aea8efaaa2fbe7cb92f, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:44.155153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981b440-f534-4746-b059-247c1107a353 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:44.167029 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1304/2608] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:44 2022] PUT /identity/v3/projects/f1da734c3514496bb4ecdfa2e3a3424a/users/f7d5114426074aea8efaaa2fbe7cb92f/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:44.179378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43e0b-73c0-42ab-be63-2c250fd2278c None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:44.179633 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43e0b-73c0-42ab-be63-2c250fd2278c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:44.179915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43e0b-73c0-42ab-be63-2c250fd2278c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:44.209890 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-26c43e0b-73c0-42ab-be63-2c250fd2278c None None] MFA Rules not processed for user `f7d5114426074aea8efaaa2fbe7cb92f`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:44.211108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-26c43e0b-73c0-42ab-be63-2c250fd2278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:44.282142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1305/2609] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:44.293385 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981b440-f534-4746-b059-247c1107a353 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:44.352927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981b440-f534-4746-b059-247c1107a353 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:44.357489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54215022-2ef3-4957-b348-b8f88bc3ad52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:44.358106 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54215022-2ef3-4957-b348-b8f88bc3ad52 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:44.358383 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54215022-2ef3-4957-b348-b8f88bc3ad52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:44.358649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54215022-2ef3-4957-b348-b8f88bc3ad52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:44.422145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54215022-2ef3-4957-b348-b8f88bc3ad52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:44.423590 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54215022-2ef3-4957-b348-b8f88bc3ad52 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:44.433199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1305/2610] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:47.055017 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c43e0b-73c0-42ab-be63-2c250fd2278c None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:47.066157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c43e0b-73c0-42ab-be63-2c250fd2278c None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:47.070307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaf2c5-42e0-46ea-b580-1f592d4aace1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:47.070907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf2c5-42e0-46ea-b580-1f592d4aace1 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:47.071433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf2c5-42e0-46ea-b580-1f592d4aace1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:47.071683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf2c5-42e0-46ea-b580-1f592d4aace1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:47.080834 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaf2c5-42e0-46ea-b580-1f592d4aace1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:47.082267 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaf2c5-42e0-46ea-b580-1f592d4aace1 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:47.092017 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1306/2611] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:50.437189 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54215022-2ef3-4957-b348-b8f88bc3ad52 service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:50.438653 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-54215022-2ef3-4957-b348-b8f88bc3ad52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:50.503886 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54215022-2ef3-4957-b348-b8f88bc3ad52 service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:50.508432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:50.509088 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:50.509403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:50.509693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] PATH_INFO: `/v3/users/7dc37614e8534da9872ab851c1f55998` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:50.510890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc37614e8534da9872ab851c1f55998)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:50.512766 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:50.523131 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:50.560107 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc37614e8534da9872ab851c1f55998'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:50.568496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc37614e8534da9872ab851c1f55998'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:50.569118 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc37614e8534da9872ab851c1f55998'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:50.575987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc37614e8534da9872ab851c1f55998'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:50.588811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc37614e8534da9872ab851c1f55998'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:50.595761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1306/2612] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:25:50 2022] DELETE /identity/v3/users/7dc37614e8534da9872ab851c1f55998 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:50.600326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485bb16-127c-459d-a5c7-0b538c377883 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:50.600790 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485bb16-127c-459d-a5c7-0b538c377883 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:50.600888 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485bb16-127c-459d-a5c7-0b538c377883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:50.620407 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-2485bb16-127c-459d-a5c7-0b538c377883 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:50.621655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2485bb16-127c-459d-a5c7-0b538c377883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:50.627222 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:50.690617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1307/2613] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:50.703851 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:50.705441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:50.775626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880e35c-2187-4e6c-9c5e-dacb18a4c2a9 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:50.779930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a0dd6-300f-400c-bba9-a4adb73da598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:50.780540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a0dd6-300f-400c-bba9-a4adb73da598 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:50.780815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a0dd6-300f-400c-bba9-a4adb73da598 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:50.781083 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a0dd6-300f-400c-bba9-a4adb73da598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:50.790586 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a0dd6-300f-400c-bba9-a4adb73da598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:50.792390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a0dd6-300f-400c-bba9-a4adb73da598 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:50.802083 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1307/2614] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:51.082258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485bb16-127c-459d-a5c7-0b538c377883 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:51.088799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2485bb16-127c-459d-a5c7-0b538c377883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:51.117644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485bb16-127c-459d-a5c7-0b538c377883 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:51.122814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:51.124095 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:51.124550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:51.124893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] PATH_INFO: `/v3/projects/515cbb39ade04ff78fe5b578627abbc8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:51.127077 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=515cbb39ade04ff78fe5b578627abbc8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:51.129137 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:51.187036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '515cbb39ade04ff78fe5b578627abbc8', 'request_id': 'req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.195321 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '515cbb39ade04ff78fe5b578627abbc8', 'request_id': 'req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.201853 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '515cbb39ade04ff78fe5b578627abbc8', 'request_id': 'req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.212867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] The token cache is being invalidate because project 515cbb39ade04ff78fe5b578627abbc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:25:51.213114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.213866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.215546 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1308/2615] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:25:51 2022] DELETE /identity/v3/projects/515cbb39ade04ff78fe5b578627abbc8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:51.219668 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a0dd6-300f-400c-bba9-a4adb73da598 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:51.229589 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a0dd6-300f-400c-bba9-a4adb73da598 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:51.287900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb392f-20d1-4267-87cf-86e380ead427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:51.288526 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb392f-20d1-4267-87cf-86e380ead427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:51.288799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb392f-20d1-4267-87cf-86e380ead427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:51.289057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb392f-20d1-4267-87cf-86e380ead427 admin admin] PATH_INFO: `/v3/users/0010d54d40fa443fbe5a12467f0cd7f1` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:51.290191 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb392f-20d1-4267-87cf-86e380ead427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0010d54d40fa443fbe5a12467f0cd7f1)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:51.292309 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb392f-20d1-4267-87cf-86e380ead427 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:51.335996 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:51.350039 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a3bb392f-20d1-4267-87cf-86e380ead427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0010d54d40fa443fbe5a12467f0cd7f1'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.358400 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a3bb392f-20d1-4267-87cf-86e380ead427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0010d54d40fa443fbe5a12467f0cd7f1'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.359054 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a3bb392f-20d1-4267-87cf-86e380ead427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0010d54d40fa443fbe5a12467f0cd7f1'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.366874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a3bb392f-20d1-4267-87cf-86e380ead427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0010d54d40fa443fbe5a12467f0cd7f1'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.380046 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-a3bb392f-20d1-4267-87cf-86e380ead427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0010d54d40fa443fbe5a12467f0cd7f1'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.386440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1308/2616] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:25:51 2022] DELETE /identity/v3/users/0010d54d40fa443fbe5a12467f0cd7f1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:51.689836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:51.691292 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:51.706147 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a5f21-cb66-4c80-80bb-b77454d3ea59 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:51.765489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76cf80-c78a-4b1b-8f41-c46358b730c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:51.766127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76cf80-c78a-4b1b-8f41-c46358b730c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:51.766399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76cf80-c78a-4b1b-8f41-c46358b730c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:51.766671 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76cf80-c78a-4b1b-8f41-c46358b730c6 admin admin] PATH_INFO: `/v3/projects/5015fac966f148a487600583dce08aec` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:51.767822 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76cf80-c78a-4b1b-8f41-c46358b730c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5015fac966f148a487600583dce08aec)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:51.770108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76cf80-c78a-4b1b-8f41-c46358b730c6 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:51.813055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:51.823155 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-af76cf80-c78a-4b1b-8f41-c46358b730c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5015fac966f148a487600583dce08aec', 'request_id': 'req-af76cf80-c78a-4b1b-8f41-c46358b730c6'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.831950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-af76cf80-c78a-4b1b-8f41-c46358b730c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5015fac966f148a487600583dce08aec', 'request_id': 'req-af76cf80-c78a-4b1b-8f41-c46358b730c6'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.838461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-af76cf80-c78a-4b1b-8f41-c46358b730c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5015fac966f148a487600583dce08aec', 'request_id': 'req-af76cf80-c78a-4b1b-8f41-c46358b730c6'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.851124 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-af76cf80-c78a-4b1b-8f41-c46358b730c6 admin admin] The token cache is being invalidate because project 5015fac966f148a487600583dce08aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:25:51.851523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-af76cf80-c78a-4b1b-8f41-c46358b730c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.852460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-af76cf80-c78a-4b1b-8f41-c46358b730c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:51.854449 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1309/2617] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:25:51 2022] DELETE /identity/v3/projects/5015fac966f148a487600583dce08aec => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:51.859583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaae720-2c3d-47e2-a5e8-16d1a98bd699 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:51.860100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaae720-2c3d-47e2-a5e8-16d1a98bd699 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:51.860100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaae720-2c3d-47e2-a5e8-16d1a98bd699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:51.881119 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-baaae720-2c3d-47e2-a5e8-16d1a98bd699 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:51.882319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-baaae720-2c3d-47e2-a5e8-16d1a98bd699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:51.946595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1309/2618] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:51.954657 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151d078-c084-46d4-bfe4-f99c6fe2957c None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:51.954934 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151d078-c084-46d4-bfe4-f99c6fe2957c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:51.955206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151d078-c084-46d4-bfe4-f99c6fe2957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:51.975383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d151d078-c084-46d4-bfe4-f99c6fe2957c None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:51.976501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d151d078-c084-46d4-bfe4-f99c6fe2957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:51.985292 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1310/2619] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:51.990171 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaae720-2c3d-47e2-a5e8-16d1a98bd699 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.000319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaae720-2c3d-47e2-a5e8-16d1a98bd699 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.005148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40896f-bd39-4267-a10e-616913a578d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.005852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40896f-bd39-4267-a10e-616913a578d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.006127 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40896f-bd39-4267-a10e-616913a578d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.006388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40896f-bd39-4267-a10e-616913a578d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.007029 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40896f-bd39-4267-a10e-616913a578d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:25:52.007322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40896f-bd39-4267-a10e-616913a578d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:52.008883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40896f-bd39-4267-a10e-616913a578d4 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:52.024716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1310/2620] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:25:52.026316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151d078-c084-46d4-bfe4-f99c6fe2957c None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.035844 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151d078-c084-46d4-bfe4-f99c6fe2957c None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.041064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b6711-8ab7-43f1-83a9-f0e4d7bb6ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.041896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b6711-8ab7-43f1-83a9-f0e4d7bb6ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.042168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b6711-8ab7-43f1-83a9-f0e4d7bb6ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.042460 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b6711-8ab7-43f1-83a9-f0e4d7bb6ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.043098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b6711-8ab7-43f1-83a9-f0e4d7bb6ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:52.045028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b6711-8ab7-43f1-83a9-f0e4d7bb6ed7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:52.088531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1311/2621] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:52 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:52.091602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40896f-bd39-4267-a10e-616913a578d4 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.103987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40896f-bd39-4267-a10e-616913a578d4 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.163128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545f0bc-1056-4ab6-a32e-7f87683ebb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.163834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545f0bc-1056-4ab6-a32e-7f87683ebb2e admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.165565 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545f0bc-1056-4ab6-a32e-7f87683ebb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.166112 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545f0bc-1056-4ab6-a32e-7f87683ebb2e admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.169361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545f0bc-1056-4ab6-a32e-7f87683ebb2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:52.171758 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545f0bc-1056-4ab6-a32e-7f87683ebb2e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:52.199788 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1311/2622] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:52 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:52.204158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b6711-8ab7-43f1-83a9-f0e4d7bb6ed7 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.215975 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b6711-8ab7-43f1-83a9-f0e4d7bb6ed7 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.222573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566a926-1846-4db1-992a-cce2fe2baed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.223232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a926-1846-4db1-992a-cce2fe2baed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.223500 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a926-1846-4db1-992a-cce2fe2baed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.223816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a926-1846-4db1-992a-cce2fe2baed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.224577 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566a926-1846-4db1-992a-cce2fe2baed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:52.228473 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566a926-1846-4db1-992a-cce2fe2baed5 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:52.239032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1312/2623] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:52.243260 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545f0bc-1056-4ab6-a32e-7f87683ebb2e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.253729 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545f0bc-1056-4ab6-a32e-7f87683ebb2e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.258727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e61df1-efe5-4208-b5f7-0fcc0c74795d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.259339 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e61df1-efe5-4208-b5f7-0fcc0c74795d admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.259672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e61df1-efe5-4208-b5f7-0fcc0c74795d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.259942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e61df1-efe5-4208-b5f7-0fcc0c74795d admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.260587 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e61df1-efe5-4208-b5f7-0fcc0c74795d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:52.262200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e61df1-efe5-4208-b5f7-0fcc0c74795d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:52.275465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1312/2624] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:52.280314 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566a926-1846-4db1-992a-cce2fe2baed5 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.291669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566a926-1846-4db1-992a-cce2fe2baed5 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.298974 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25682ecd-04a9-4adb-a876-e84e55860b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.298974 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25682ecd-04a9-4adb-a876-e84e55860b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.299400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25682ecd-04a9-4adb-a876-e84e55860b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.299922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25682ecd-04a9-4adb-a876-e84e55860b57 admin admin] PATH_INFO: `/v3/projects/d6a400e55f7d4c4e98beb5fa2c8a1aa0/users/2b8dab8f34584c47b167042b56adf186/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.317317 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25682ecd-04a9-4adb-a876-e84e55860b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a400e55f7d4c4e98beb5fa2c8a1aa0, user_id=2b8dab8f34584c47b167042b56adf186, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:52.320208 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25682ecd-04a9-4adb-a876-e84e55860b57 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:52.334762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1313/2625] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:52 2022] PUT /identity/v3/projects/d6a400e55f7d4c4e98beb5fa2c8a1aa0/users/2b8dab8f34584c47b167042b56adf186/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:52.345287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679b98-24ec-4e78-b203-46259cb68bdf None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.345632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679b98-24ec-4e78-b203-46259cb68bdf None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.345897 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679b98-24ec-4e78-b203-46259cb68bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.377860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-39679b98-24ec-4e78-b203-46259cb68bdf None None] MFA Rules not processed for user `2b8dab8f34584c47b167042b56adf186`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:52.379066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-39679b98-24ec-4e78-b203-46259cb68bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:52.383322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:52.474264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1313/2626] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:52.483824 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25682ecd-04a9-4adb-a876-e84e55860b57 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.550081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25682ecd-04a9-4adb-a876-e84e55860b57 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.563082 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ae376-0dfd-4f23-af32-94fa3dd9f0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.564120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ae376-0dfd-4f23-af32-94fa3dd9f0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.564399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ae376-0dfd-4f23-af32-94fa3dd9f0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.564670 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ae376-0dfd-4f23-af32-94fa3dd9f0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.565402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ae376-0dfd-4f23-af32-94fa3dd9f0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:52.567323 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ae376-0dfd-4f23-af32-94fa3dd9f0c7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:52.597508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1314/2627] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:52 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:25:52.601659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39679b98-24ec-4e78-b203-46259cb68bdf None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.612393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39679b98-24ec-4e78-b203-46259cb68bdf None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.671023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc429096-2673-42fe-b4da-d0c247233561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.671650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc429096-2673-42fe-b4da-d0c247233561 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.671929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc429096-2673-42fe-b4da-d0c247233561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.672195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc429096-2673-42fe-b4da-d0c247233561 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.672837 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc429096-2673-42fe-b4da-d0c247233561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:52.674960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc429096-2673-42fe-b4da-d0c247233561 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:52.700506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1314/2628] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:52 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:52.704805 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ae376-0dfd-4f23-af32-94fa3dd9f0c7 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.718754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ae376-0dfd-4f23-af32-94fa3dd9f0c7 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.723746 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb21d1-a782-4633-8244-18f998a4a322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.724359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb21d1-a782-4633-8244-18f998a4a322 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.724632 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb21d1-a782-4633-8244-18f998a4a322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.725041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb21d1-a782-4633-8244-18f998a4a322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.725843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb21d1-a782-4633-8244-18f998a4a322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:52.727443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb21d1-a782-4633-8244-18f998a4a322 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:52.743070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1315/2629] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:52.744094 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc429096-2673-42fe-b4da-d0c247233561 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.757491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc429096-2673-42fe-b4da-d0c247233561 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.761866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e215d9-a56d-4fff-9d98-a4456b9e8339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.762824 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e215d9-a56d-4fff-9d98-a4456b9e8339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.763015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e215d9-a56d-4fff-9d98-a4456b9e8339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.763382 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e215d9-a56d-4fff-9d98-a4456b9e8339 admin admin] PATH_INFO: `/v3/projects/3d9e273e991b4953998650d8288c3ba5/users/a3a9b4a270564d1dbaa2bc9b3f0a365c/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.781813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e215d9-a56d-4fff-9d98-a4456b9e8339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9e273e991b4953998650d8288c3ba5, user_id=a3a9b4a270564d1dbaa2bc9b3f0a365c, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:52.784429 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e215d9-a56d-4fff-9d98-a4456b9e8339 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:52.802577 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1315/2630] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:52 2022] PUT /identity/v3/projects/3d9e273e991b4953998650d8288c3ba5/users/a3a9b4a270564d1dbaa2bc9b3f0a365c/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:25:52.807085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb21d1-a782-4633-8244-18f998a4a322 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.820807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb21d1-a782-4633-8244-18f998a4a322 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.856508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:52.918581 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd2303-5151-4dd1-9f01-00c5bc2ef18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.919211 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd2303-5151-4dd1-9f01-00c5bc2ef18d admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.919490 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd2303-5151-4dd1-9f01-00c5bc2ef18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.919759 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd2303-5151-4dd1-9f01-00c5bc2ef18d admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.920530 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd2303-5151-4dd1-9f01-00c5bc2ef18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:52.933621 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd2303-5151-4dd1-9f01-00c5bc2ef18d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:52.945381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1316/2631] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:52.949049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e215d9-a56d-4fff-9d98-a4456b9e8339 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.961878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e215d9-a56d-4fff-9d98-a4456b9e8339 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.971199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb3611-4f2c-483b-9a0d-5e568f2c6e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.971892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb3611-4f2c-483b-9a0d-5e568f2c6e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.972168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb3611-4f2c-483b-9a0d-5e568f2c6e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.972440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb3611-4f2c-483b-9a0d-5e568f2c6e9c admin admin] PATH_INFO: `/v3/projects/3d9e273e991b4953998650d8288c3ba5/users/a3a9b4a270564d1dbaa2bc9b3f0a365c/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.975019 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb3611-4f2c-483b-9a0d-5e568f2c6e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9e273e991b4953998650d8288c3ba5, user_id=a3a9b4a270564d1dbaa2bc9b3f0a365c, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:52.977709 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb3611-4f2c-483b-9a0d-5e568f2c6e9c admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:52.996390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1316/2632] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:52 2022] PUT /identity/v3/projects/3d9e273e991b4953998650d8288c3ba5/users/a3a9b4a270564d1dbaa2bc9b3f0a365c/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:53.008559 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85d870-9d0c-49ff-8195-441adef12c4e None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:53.008851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85d870-9d0c-49ff-8195-441adef12c4e None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:53.009125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85d870-9d0c-49ff-8195-441adef12c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:53.041859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-df85d870-9d0c-49ff-8195-441adef12c4e None None] MFA Rules not processed for user `a3a9b4a270564d1dbaa2bc9b3f0a365c`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:53.043162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-df85d870-9d0c-49ff-8195-441adef12c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:53.139716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1317/2633] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:53.153144 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb3611-4f2c-483b-9a0d-5e568f2c6e9c admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:53.155298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-3afb3611-4f2c-483b-9a0d-5e568f2c6e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:53.215093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb3611-4f2c-483b-9a0d-5e568f2c6e9c admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:53.218884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bb78c-6c0e-40c3-b39b-7655c97d8c28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:53.219499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bb78c-6c0e-40c3-b39b-7655c97d8c28 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:53.219770 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bb78c-6c0e-40c3-b39b-7655c97d8c28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:53.220036 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bb78c-6c0e-40c3-b39b-7655c97d8c28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:53.230349 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bb78c-6c0e-40c3-b39b-7655c97d8c28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:53.231781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bb78c-6c0e-40c3-b39b-7655c97d8c28 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:53.236934 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:53.242661 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1317/2634] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:53.273472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85d870-9d0c-49ff-8195-441adef12c4e None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:53.344881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85d870-9d0c-49ff-8195-441adef12c4e None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:53.350269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:53.351221 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:53.351874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:53.351874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] PATH_INFO: `/v3/users/2b8dab8f34584c47b167042b56adf186` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:53.352915 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8dab8f34584c47b167042b56adf186)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:53.355021 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:53.412002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8dab8f34584c47b167042b56adf186'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:53.414475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:53.429523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8dab8f34584c47b167042b56adf186'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:53.430241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8dab8f34584c47b167042b56adf186'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:53.432110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8dab8f34584c47b167042b56adf186'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:53.441917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8dab8f34584c47b167042b56adf186'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:53.458625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1318/2635] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:25:53 2022] DELETE /identity/v3/users/2b8dab8f34584c47b167042b56adf186 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:53.463597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19048e-cb0b-47ea-843d-38e0d22d6ebf None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:53.463843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19048e-cb0b-47ea-843d-38e0d22d6ebf None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:53.464115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19048e-cb0b-47ea-843d-38e0d22d6ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:53.484319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-2d19048e-cb0b-47ea-843d-38e0d22d6ebf None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:53.485614 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2d19048e-cb0b-47ea-843d-38e0d22d6ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:53.589314 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1318/2636] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:53.604197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:53.606336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:53.688402 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e00613-09ca-4c1d-a7d2-e38e6f3e75ed admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:53.693177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74b1cf-002a-4c6c-bbd1-1ed0cd12f1ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:53.693875 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b1cf-002a-4c6c-bbd1-1ed0cd12f1ce service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:53.694236 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b1cf-002a-4c6c-bbd1-1ed0cd12f1ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:53.697628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b1cf-002a-4c6c-bbd1-1ed0cd12f1ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:53.708911 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74b1cf-002a-4c6c-bbd1-1ed0cd12f1ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:53.710550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74b1cf-002a-4c6c-bbd1-1ed0cd12f1ce service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:53.722707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1319/2637] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:54.142301 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19048e-cb0b-47ea-843d-38e0d22d6ebf None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:54.144396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2d19048e-cb0b-47ea-843d-38e0d22d6ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:54.157029 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19048e-cb0b-47ea-843d-38e0d22d6ebf None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:54.162006 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:54.162706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.163001 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.163308 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] PATH_INFO: `/v3/projects/d6a400e55f7d4c4e98beb5fa2c8a1aa0` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:54.164491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a400e55f7d4c4e98beb5fa2c8a1aa0)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:54.166902 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:54.222808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a400e55f7d4c4e98beb5fa2c8a1aa0', 'request_id': 'req-7456e054-1256-4a4c-93ff-4686c2462b75'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.232184 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a400e55f7d4c4e98beb5fa2c8a1aa0', 'request_id': 'req-7456e054-1256-4a4c-93ff-4686c2462b75'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.239145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a400e55f7d4c4e98beb5fa2c8a1aa0', 'request_id': 'req-7456e054-1256-4a4c-93ff-4686c2462b75'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.250020 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] The token cache is being invalidate because project d6a400e55f7d4c4e98beb5fa2c8a1aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:25:54.250308 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.250947 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.252823 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1319/2638] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:25:54 2022] DELETE /identity/v3/projects/d6a400e55f7d4c4e98beb5fa2c8a1aa0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:54.256705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74b1cf-002a-4c6c-bbd1-1ed0cd12f1ce service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:54.267045 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74b1cf-002a-4c6c-bbd1-1ed0cd12f1ce service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:54.325389 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3760e-a030-4343-9b18-6bd0834a960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:54.326133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3760e-a030-4343-9b18-6bd0834a960d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.326542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3760e-a030-4343-9b18-6bd0834a960d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.326814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3760e-a030-4343-9b18-6bd0834a960d admin admin] PATH_INFO: `/v3/users/a3a9b4a270564d1dbaa2bc9b3f0a365c` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:54.327972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3760e-a030-4343-9b18-6bd0834a960d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a9b4a270564d1dbaa2bc9b3f0a365c)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:54.329930 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3760e-a030-4343-9b18-6bd0834a960d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:54.382565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-edd3760e-a030-4343-9b18-6bd0834a960d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a9b4a270564d1dbaa2bc9b3f0a365c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.395783 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-edd3760e-a030-4343-9b18-6bd0834a960d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a9b4a270564d1dbaa2bc9b3f0a365c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.396521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-edd3760e-a030-4343-9b18-6bd0834a960d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a9b4a270564d1dbaa2bc9b3f0a365c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.397196 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-edd3760e-a030-4343-9b18-6bd0834a960d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a9b4a270564d1dbaa2bc9b3f0a365c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.406653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-edd3760e-a030-4343-9b18-6bd0834a960d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a9b4a270564d1dbaa2bc9b3f0a365c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.407695 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:54.421759 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1320/2639] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:25:54 2022] DELETE /identity/v3/users/a3a9b4a270564d1dbaa2bc9b3f0a365c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:25:54.801593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:54.803262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:54.818955 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456e054-1256-4a4c-93ff-4686c2462b75 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:54.889099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f45fd4-c5e1-4d7d-9457-9ad159694759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:54.889761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f45fd4-c5e1-4d7d-9457-9ad159694759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.890038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f45fd4-c5e1-4d7d-9457-9ad159694759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.890371 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f45fd4-c5e1-4d7d-9457-9ad159694759 admin admin] PATH_INFO: `/v3/projects/3d9e273e991b4953998650d8288c3ba5` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:54.891489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f45fd4-c5e1-4d7d-9457-9ad159694759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9e273e991b4953998650d8288c3ba5)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:54.893665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f45fd4-c5e1-4d7d-9457-9ad159694759 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:54.932379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:54.950441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-63f45fd4-c5e1-4d7d-9457-9ad159694759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9e273e991b4953998650d8288c3ba5', 'request_id': 'req-63f45fd4-c5e1-4d7d-9457-9ad159694759'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.959461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-63f45fd4-c5e1-4d7d-9457-9ad159694759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9e273e991b4953998650d8288c3ba5', 'request_id': 'req-63f45fd4-c5e1-4d7d-9457-9ad159694759'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.967276 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-63f45fd4-c5e1-4d7d-9457-9ad159694759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9e273e991b4953998650d8288c3ba5', 'request_id': 'req-63f45fd4-c5e1-4d7d-9457-9ad159694759'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.978060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-63f45fd4-c5e1-4d7d-9457-9ad159694759 admin admin] The token cache is being invalidate because project 3d9e273e991b4953998650d8288c3ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:25:54.978399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-63f45fd4-c5e1-4d7d-9457-9ad159694759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.979471 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-63f45fd4-c5e1-4d7d-9457-9ad159694759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.981334 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1320/2640] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:25:54 2022] DELETE /identity/v3/projects/3d9e273e991b4953998650d8288c3ba5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:25:54.986899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaa1dc-360a-4d8a-969c-afd09594d5c9 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.987552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaa1dc-360a-4d8a-969c-afd09594d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.987552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaa1dc-360a-4d8a-969c-afd09594d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.009952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-bfbaa1dc-360a-4d8a-969c-afd09594d5c9 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:55.011225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-bfbaa1dc-360a-4d8a-969c-afd09594d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:55.083690 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1321/2641] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:55.091807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac8782-701f-476c-a576-1937fddd28f0 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.092061 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac8782-701f-476c-a576-1937fddd28f0 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.092351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac8782-701f-476c-a576-1937fddd28f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.113073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-ecac8782-701f-476c-a576-1937fddd28f0 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:55.114304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ecac8782-701f-476c-a576-1937fddd28f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:55.122726 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1321/2642] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:55.127169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaa1dc-360a-4d8a-969c-afd09594d5c9 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:55.137819 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaa1dc-360a-4d8a-969c-afd09594d5c9 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:55.142376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60a8ae-d235-46e9-a23f-f5923a4980d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:55.143316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60a8ae-d235-46e9-a23f-f5923a4980d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.143592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60a8ae-d235-46e9-a23f-f5923a4980d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.143863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60a8ae-d235-46e9-a23f-f5923a4980d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.144515 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60a8ae-d235-46e9-a23f-f5923a4980d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:25:55.144813 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60a8ae-d235-46e9-a23f-f5923a4980d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:55.146444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60a8ae-d235-46e9-a23f-f5923a4980d6 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:55.158141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1322/2643] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:25:55.162628 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac8782-701f-476c-a576-1937fddd28f0 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:55.172326 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac8782-701f-476c-a576-1937fddd28f0 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:55.176990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c4368-2f58-45ce-945c-db2138ea2794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:55.177617 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c4368-2f58-45ce-945c-db2138ea2794 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.177890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c4368-2f58-45ce-945c-db2138ea2794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.178158 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c4368-2f58-45ce-945c-db2138ea2794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.178796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c4368-2f58-45ce-945c-db2138ea2794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:55.180686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c4368-2f58-45ce-945c-db2138ea2794 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:55.210903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1322/2644] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:55 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:55.215700 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60a8ae-d235-46e9-a23f-f5923a4980d6 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:55.226603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60a8ae-d235-46e9-a23f-f5923a4980d6 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:55.285921 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaeed5-7387-4ccd-a079-118514a3caca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:55.286528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaeed5-7387-4ccd-a079-118514a3caca admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.286793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaeed5-7387-4ccd-a079-118514a3caca admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.287058 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaeed5-7387-4ccd-a079-118514a3caca admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.287681 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaeed5-7387-4ccd-a079-118514a3caca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:55.289628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaeed5-7387-4ccd-a079-118514a3caca admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:55.314144 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1323/2645] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:55 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:55.318433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c4368-2f58-45ce-945c-db2138ea2794 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:55.329005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c4368-2f58-45ce-945c-db2138ea2794 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:55.334097 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dc589-2904-411f-b84c-7e608922c6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:55.334626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dc589-2904-411f-b84c-7e608922c6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.334900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dc589-2904-411f-b84c-7e608922c6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.335166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dc589-2904-411f-b84c-7e608922c6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.335811 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8dc589-2904-411f-b84c-7e608922c6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:55.337418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8dc589-2904-411f-b84c-7e608922c6ae admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:55.347726 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1323/2646] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:55.351924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaeed5-7387-4ccd-a079-118514a3caca admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:55.362978 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaeed5-7387-4ccd-a079-118514a3caca admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:55.368349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc84970-8c32-49b6-97b5-ea6e647511ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:55.368980 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc84970-8c32-49b6-97b5-ea6e647511ea admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.369240 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc84970-8c32-49b6-97b5-ea6e647511ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.369553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc84970-8c32-49b6-97b5-ea6e647511ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.370188 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc84970-8c32-49b6-97b5-ea6e647511ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:55.371816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc84970-8c32-49b6-97b5-ea6e647511ea admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:55.382911 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1324/2647] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:55.387561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dc589-2904-411f-b84c-7e608922c6ae admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:55.398393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dc589-2904-411f-b84c-7e608922c6ae admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:55.403600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474e392-f205-4aa3-9693-358c933f988e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:55.404282 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e392-f205-4aa3-9693-358c933f988e admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.404556 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e392-f205-4aa3-9693-358c933f988e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.404824 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e392-f205-4aa3-9693-358c933f988e admin admin] PATH_INFO: `/v3/projects/a0b503f99440440792a50c988e5f3bee/users/2d58c8941c5d40d88f2cc7dd928de044/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.421185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474e392-f205-4aa3-9693-358c933f988e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b503f99440440792a50c988e5f3bee, user_id=2d58c8941c5d40d88f2cc7dd928de044, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:55.424182 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474e392-f205-4aa3-9693-358c933f988e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:55.438672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1324/2648] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:55 2022] PUT /identity/v3/projects/a0b503f99440440792a50c988e5f3bee/users/2d58c8941c5d40d88f2cc7dd928de044/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:55.449134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d46554-0c12-4198-9873-24f4668b933d None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.449458 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d46554-0c12-4198-9873-24f4668b933d None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.449730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d46554-0c12-4198-9873-24f4668b933d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.478825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-12d46554-0c12-4198-9873-24f4668b933d None None] MFA Rules not processed for user `2d58c8941c5d40d88f2cc7dd928de044`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:55.480207 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-12d46554-0c12-4198-9873-24f4668b933d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:55.534071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:55.556072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1325/2649] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:55.560721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474e392-f205-4aa3-9693-358c933f988e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:55.622485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474e392-f205-4aa3-9693-358c933f988e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:55.627998 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f9240-e870-480a-b914-8362da2f778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:55.628600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f9240-e870-480a-b914-8362da2f778e admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.628874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f9240-e870-480a-b914-8362da2f778e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.629125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f9240-e870-480a-b914-8362da2f778e admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.629789 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f9240-e870-480a-b914-8362da2f778e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:55.631661 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f9240-e870-480a-b914-8362da2f778e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:55.661414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1325/2650] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:55 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:55.665461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d46554-0c12-4198-9873-24f4668b933d None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:55.676495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d46554-0c12-4198-9873-24f4668b933d None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:55.736154 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc151c94-04c5-461d-9810-dddccdc5199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:55.736954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc151c94-04c5-461d-9810-dddccdc5199e admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.737056 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc151c94-04c5-461d-9810-dddccdc5199e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.737319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc151c94-04c5-461d-9810-dddccdc5199e admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.738084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc151c94-04c5-461d-9810-dddccdc5199e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:55.740011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc151c94-04c5-461d-9810-dddccdc5199e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:55.764424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1326/2651] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:55 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:55.767141 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f9240-e870-480a-b914-8362da2f778e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:55.777942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f9240-e870-480a-b914-8362da2f778e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:55.782724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c04dd-5100-40eb-b7b4-86d607043a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:55.783334 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c04dd-5100-40eb-b7b4-86d607043a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.783597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c04dd-5100-40eb-b7b4-86d607043a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.783861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c04dd-5100-40eb-b7b4-86d607043a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.784490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c04dd-5100-40eb-b7b4-86d607043a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:55.786070 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c04dd-5100-40eb-b7b4-86d607043a24 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:55.797169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1326/2652] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:55.803494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc151c94-04c5-461d-9810-dddccdc5199e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:55.812676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc151c94-04c5-461d-9810-dddccdc5199e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:55.817656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea75b6-1823-423c-aaa5-20a3df3eab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:55.818364 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea75b6-1823-423c-aaa5-20a3df3eab8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.818634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea75b6-1823-423c-aaa5-20a3df3eab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.818927 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea75b6-1823-423c-aaa5-20a3df3eab8e admin admin] PATH_INFO: `/v3/projects/4015d90ee9c84cbf9fb52ca9ea7340de/users/76239dd55f5645c18e4628214372407e/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.835108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea75b6-1823-423c-aaa5-20a3df3eab8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4015d90ee9c84cbf9fb52ca9ea7340de, user_id=76239dd55f5645c18e4628214372407e, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:55.837846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea75b6-1823-423c-aaa5-20a3df3eab8e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:55.852696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1327/2653] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:55 2022] PUT /identity/v3/projects/4015d90ee9c84cbf9fb52ca9ea7340de/users/76239dd55f5645c18e4628214372407e/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:55.857195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c04dd-5100-40eb-b7b4-86d607043a24 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:55.868585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c04dd-5100-40eb-b7b4-86d607043a24 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:55.890337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:55.932434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b13271-a4d0-4ad4-b5e9-10ff49683ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:55.933037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b13271-a4d0-4ad4-b5e9-10ff49683ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.933341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b13271-a4d0-4ad4-b5e9-10ff49683ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.933604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b13271-a4d0-4ad4-b5e9-10ff49683ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.934231 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b13271-a4d0-4ad4-b5e9-10ff49683ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:55.935804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b13271-a4d0-4ad4-b5e9-10ff49683ebd admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:55.945498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1327/2654] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:55.949924 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea75b6-1823-423c-aaa5-20a3df3eab8e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:55.960729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea75b6-1823-423c-aaa5-20a3df3eab8e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:55.966157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debbb8b-7402-42a0-beb7-b7ff018fa967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:55.966822 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debbb8b-7402-42a0-beb7-b7ff018fa967 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.967138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debbb8b-7402-42a0-beb7-b7ff018fa967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.967393 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debbb8b-7402-42a0-beb7-b7ff018fa967 admin admin] PATH_INFO: `/v3/projects/4015d90ee9c84cbf9fb52ca9ea7340de/users/76239dd55f5645c18e4628214372407e/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.969644 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debbb8b-7402-42a0-beb7-b7ff018fa967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4015d90ee9c84cbf9fb52ca9ea7340de, user_id=76239dd55f5645c18e4628214372407e, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:55.972339 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debbb8b-7402-42a0-beb7-b7ff018fa967 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:55.984072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1328/2655] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:55 2022] PUT /identity/v3/projects/4015d90ee9c84cbf9fb52ca9ea7340de/users/76239dd55f5645c18e4628214372407e/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:55.995567 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0be2b-0b8e-4a8b-ba2f-1b1e9d23ab83 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.995849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0be2b-0b8e-4a8b-ba2f-1b1e9d23ab83 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.996117 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0be2b-0b8e-4a8b-ba2f-1b1e9d23ab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:56.029095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e4f0be2b-0b8e-4a8b-ba2f-1b1e9d23ab83 None None] MFA Rules not processed for user `76239dd55f5645c18e4628214372407e`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:56.030336 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e4f0be2b-0b8e-4a8b-ba2f-1b1e9d23ab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:56.148533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1328/2656] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:56.160754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debbb8b-7402-42a0-beb7-b7ff018fa967 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:56.162498 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-9debbb8b-7402-42a0-beb7-b7ff018fa967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:56.225716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debbb8b-7402-42a0-beb7-b7ff018fa967 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:56.229864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17737ee-b879-4e90-9322-09c38adc431d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:56.230482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17737ee-b879-4e90-9322-09c38adc431d service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:56.230752 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17737ee-b879-4e90-9322-09c38adc431d service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:56.231014 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17737ee-b879-4e90-9322-09c38adc431d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:56.240339 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17737ee-b879-4e90-9322-09c38adc431d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:56.246412 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17737ee-b879-4e90-9322-09c38adc431d service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:56.251646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1329/2657] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:56.317775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0be2b-0b8e-4a8b-ba2f-1b1e9d23ab83 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:56.392106 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0be2b-0b8e-4a8b-ba2f-1b1e9d23ab83 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:56.398160 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:56.398773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:56.399050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:56.399416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] PATH_INFO: `/v3/users/2d58c8941c5d40d88f2cc7dd928de044` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:56.401168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d58c8941c5d40d88f2cc7dd928de044)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:56.403123 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:56.460558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d58c8941c5d40d88f2cc7dd928de044'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:56.462406 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:56.471708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d58c8941c5d40d88f2cc7dd928de044'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:56.472861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d58c8941c5d40d88f2cc7dd928de044'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:56.479815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d58c8941c5d40d88f2cc7dd928de044'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:56.491463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d58c8941c5d40d88f2cc7dd928de044'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:56.497813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1329/2658] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:25:56 2022] DELETE /identity/v3/users/2d58c8941c5d40d88f2cc7dd928de044 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:56.502509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a0417-421e-435b-94f7-f1f3f47c98a6 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:56.502787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a0417-421e-435b-94f7-f1f3f47c98a6 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:56.503056 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a0417-421e-435b-94f7-f1f3f47c98a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:56.534264 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-688a0417-421e-435b-94f7-f1f3f47c98a6 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:56.535479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-688a0417-421e-435b-94f7-f1f3f47c98a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:56.572358 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:56.598715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1330/2659] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:56.609588 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:56.611231 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:56.672702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d22ad-993a-40be-9286-6e07b2c2dfc0 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:56.676211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9122649-675f-4f81-9bbc-8679b7b47867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:56.676830 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9122649-675f-4f81-9bbc-8679b7b47867 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:56.677347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9122649-675f-4f81-9bbc-8679b7b47867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:56.677347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9122649-675f-4f81-9bbc-8679b7b47867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:56.687809 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9122649-675f-4f81-9bbc-8679b7b47867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:56.689307 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9122649-675f-4f81-9bbc-8679b7b47867 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:56.699548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1330/2660] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:57.005773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a0417-421e-435b-94f7-f1f3f47c98a6 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:57.007368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-688a0417-421e-435b-94f7-f1f3f47c98a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:57.023122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a0417-421e-435b-94f7-f1f3f47c98a6 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:57.027929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:57.028653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:57.028923 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:57.029186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] PATH_INFO: `/v3/projects/a0b503f99440440792a50c988e5f3bee` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:57.029634 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9122649-675f-4f81-9bbc-8679b7b47867 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:57.030365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b503f99440440792a50c988e5f3bee)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:57.031011 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d9122649-675f-4f81-9bbc-8679b7b47867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:57.032369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:57.044381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9122649-675f-4f81-9bbc-8679b7b47867 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:57.048809 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1825d4-1092-4bfe-95c5-3be1f55c9c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:57.049454 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1825d4-1092-4bfe-95c5-3be1f55c9c45 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:57.049728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1825d4-1092-4bfe-95c5-3be1f55c9c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:57.049992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1825d4-1092-4bfe-95c5-3be1f55c9c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:57.051738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1d1825d4-1092-4bfe-95c5-3be1f55c9c45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:57.064158 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1825d4-1092-4bfe-95c5-3be1f55c9c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:57.065788 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1825d4-1092-4bfe-95c5-3be1f55c9c45 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:57.075646 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1331/2661] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:25:57.083791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b503f99440440792a50c988e5f3bee', 'request_id': 'req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.093786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b503f99440440792a50c988e5f3bee', 'request_id': 'req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.101448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b503f99440440792a50c988e5f3bee', 'request_id': 'req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.112970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] The token cache is being invalidate because project a0b503f99440440792a50c988e5f3bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:25:57.113304 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.113950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.115436 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1331/2662] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:25:57 2022] DELETE /identity/v3/projects/a0b503f99440440792a50c988e5f3bee => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:57.119837 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1825d4-1092-4bfe-95c5-3be1f55c9c45 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:57.132298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1825d4-1092-4bfe-95c5-3be1f55c9c45 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:57.189705 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33abad1-4d2b-42eb-9667-79a40ba7adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:57.190248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33abad1-4d2b-42eb-9667-79a40ba7adff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:57.190525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33abad1-4d2b-42eb-9667-79a40ba7adff admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:57.190796 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33abad1-4d2b-42eb-9667-79a40ba7adff admin admin] PATH_INFO: `/v3/users/76239dd55f5645c18e4628214372407e` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:57.191927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33abad1-4d2b-42eb-9667-79a40ba7adff admin admin] RBAC: Authorizing `identity:delete_user(user_id=76239dd55f5645c18e4628214372407e)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:57.193875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33abad1-4d2b-42eb-9667-79a40ba7adff admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:57.245356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e33abad1-4d2b-42eb-9667-79a40ba7adff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76239dd55f5645c18e4628214372407e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.257605 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e33abad1-4d2b-42eb-9667-79a40ba7adff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76239dd55f5645c18e4628214372407e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.258505 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e33abad1-4d2b-42eb-9667-79a40ba7adff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76239dd55f5645c18e4628214372407e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.261396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:57.268289 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e33abad1-4d2b-42eb-9667-79a40ba7adff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76239dd55f5645c18e4628214372407e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.287799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e33abad1-4d2b-42eb-9667-79a40ba7adff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76239dd55f5645c18e4628214372407e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.294781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1332/2663] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:25:57 2022] DELETE /identity/v3/users/76239dd55f5645c18e4628214372407e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:25:57.603161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:57.606250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:57.624455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b7f1-71ad-4492-b95a-85ee4f6c514f admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:57.727850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b7e9f-1577-4c60-8df2-a6ea988a746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:57.728785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b7e9f-1577-4c60-8df2-a6ea988a746a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:57.729229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b7e9f-1577-4c60-8df2-a6ea988a746a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:57.733607 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b7e9f-1577-4c60-8df2-a6ea988a746a admin admin] PATH_INFO: `/v3/projects/4015d90ee9c84cbf9fb52ca9ea7340de` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:57.734896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b7e9f-1577-4c60-8df2-a6ea988a746a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4015d90ee9c84cbf9fb52ca9ea7340de)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:57.737308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b7e9f-1577-4c60-8df2-a6ea988a746a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:57.803260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-022b7e9f-1577-4c60-8df2-a6ea988a746a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4015d90ee9c84cbf9fb52ca9ea7340de', 'request_id': 'req-022b7e9f-1577-4c60-8df2-a6ea988a746a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.818677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-022b7e9f-1577-4c60-8df2-a6ea988a746a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4015d90ee9c84cbf9fb52ca9ea7340de', 'request_id': 'req-022b7e9f-1577-4c60-8df2-a6ea988a746a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.825970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-022b7e9f-1577-4c60-8df2-a6ea988a746a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4015d90ee9c84cbf9fb52ca9ea7340de', 'request_id': 'req-022b7e9f-1577-4c60-8df2-a6ea988a746a'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.830094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:57.838194 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-022b7e9f-1577-4c60-8df2-a6ea988a746a admin admin] The token cache is being invalidate because project 4015d90ee9c84cbf9fb52ca9ea7340de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:25:57.839025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-022b7e9f-1577-4c60-8df2-a6ea988a746a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.839707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-022b7e9f-1577-4c60-8df2-a6ea988a746a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:57.841544 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1332/2664] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:25:57 2022] DELETE /identity/v3/projects/4015d90ee9c84cbf9fb52ca9ea7340de => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:57.846192 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662029ce-ac29-469d-b1c9-cca9fc262745 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:57.846685 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662029ce-ac29-469d-b1c9-cca9fc262745 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:57.846787 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662029ce-ac29-469d-b1c9-cca9fc262745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:57.865995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-662029ce-ac29-469d-b1c9-cca9fc262745 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:57.867180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-662029ce-ac29-469d-b1c9-cca9fc262745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:57.931994 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1333/2665] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:57.940197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a61377-8db2-4c81-9f10-0e34cb330622 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:57.940626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a61377-8db2-4c81-9f10-0e34cb330622 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:57.940794 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a61377-8db2-4c81-9f10-0e34cb330622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:57.961618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-43a61377-8db2-4c81-9f10-0e34cb330622 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:57.962987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-43a61377-8db2-4c81-9f10-0e34cb330622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:57.972041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1333/2666] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:57.976651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662029ce-ac29-469d-b1c9-cca9fc262745 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:57.986821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662029ce-ac29-469d-b1c9-cca9fc262745 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:57.991780 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778b9ac-e63c-4311-9b8d-4e71b0999660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:57.992394 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778b9ac-e63c-4311-9b8d-4e71b0999660 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:57.992672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778b9ac-e63c-4311-9b8d-4e71b0999660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:57.992941 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778b9ac-e63c-4311-9b8d-4e71b0999660 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:57.993697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778b9ac-e63c-4311-9b8d-4e71b0999660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:25:57.994203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778b9ac-e63c-4311-9b8d-4e71b0999660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:57.995923 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778b9ac-e63c-4311-9b8d-4e71b0999660 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:58.009165 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1334/2667] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:25:58.014013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a61377-8db2-4c81-9f10-0e34cb330622 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:58.024744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a61377-8db2-4c81-9f10-0e34cb330622 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:58.030135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f2754-14ac-49c3-813c-b0f03f92f1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:58.030893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f2754-14ac-49c3-813c-b0f03f92f1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.031233 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f2754-14ac-49c3-813c-b0f03f92f1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.031562 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f2754-14ac-49c3-813c-b0f03f92f1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.032492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f2754-14ac-49c3-813c-b0f03f92f1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:58.034464 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f2754-14ac-49c3-813c-b0f03f92f1c2 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:58.066958 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1334/2668] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:58 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:25:58.071125 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778b9ac-e63c-4311-9b8d-4e71b0999660 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:58.084395 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778b9ac-e63c-4311-9b8d-4e71b0999660 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:58.160969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b112542-2512-4da6-8503-41f53e2c66d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:58.160969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b112542-2512-4da6-8503-41f53e2c66d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.160969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b112542-2512-4da6-8503-41f53e2c66d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.160969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b112542-2512-4da6-8503-41f53e2c66d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.161720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b112542-2512-4da6-8503-41f53e2c66d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:58.163238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b112542-2512-4da6-8503-41f53e2c66d8 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:58.193248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1335/2669] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:58 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:58.194745 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f2754-14ac-49c3-813c-b0f03f92f1c2 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:58.206373 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f2754-14ac-49c3-813c-b0f03f92f1c2 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:58.213400 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed2a9c-8784-41bf-a9e2-0ab6c9012c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:58.213867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed2a9c-8784-41bf-a9e2-0ab6c9012c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.214138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed2a9c-8784-41bf-a9e2-0ab6c9012c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.214479 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed2a9c-8784-41bf-a9e2-0ab6c9012c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.215179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed2a9c-8784-41bf-a9e2-0ab6c9012c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:58.217013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed2a9c-8784-41bf-a9e2-0ab6c9012c16 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:58.229538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1335/2670] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:58.233492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b112542-2512-4da6-8503-41f53e2c66d8 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:58.246092 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b112542-2512-4da6-8503-41f53e2c66d8 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:58.251925 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a55037-f5cd-4582-9d4e-017a3e4d3db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:58.252366 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55037-f5cd-4582-9d4e-017a3e4d3db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.252741 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55037-f5cd-4582-9d4e-017a3e4d3db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.253076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55037-f5cd-4582-9d4e-017a3e4d3db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.253834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a55037-f5cd-4582-9d4e-017a3e4d3db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:58.255475 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a55037-f5cd-4582-9d4e-017a3e4d3db6 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:58.269935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1336/2671] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:58.274365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed2a9c-8784-41bf-a9e2-0ab6c9012c16 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:58.285467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed2a9c-8784-41bf-a9e2-0ab6c9012c16 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:58.290198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20015-602b-4a55-b362-e9918db80e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:58.290981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20015-602b-4a55-b362-e9918db80e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.291254 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20015-602b-4a55-b362-e9918db80e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.291701 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20015-602b-4a55-b362-e9918db80e57 admin admin] PATH_INFO: `/v3/projects/0e148599cfbf4e488bf3bec0cd44ffb4/users/d25bb60e6a564f679d08e8ef1dd9840f/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.306843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a20015-602b-4a55-b362-e9918db80e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e148599cfbf4e488bf3bec0cd44ffb4, user_id=d25bb60e6a564f679d08e8ef1dd9840f, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:58.309617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a20015-602b-4a55-b362-e9918db80e57 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:58.325090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1336/2672] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:58 2022] PUT /identity/v3/projects/0e148599cfbf4e488bf3bec0cd44ffb4/users/d25bb60e6a564f679d08e8ef1dd9840f/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:25:58.335440 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd607b3-a2ea-4728-a5e1-a19ade546088 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.335677 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd607b3-a2ea-4728-a5e1-a19ade546088 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.335942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd607b3-a2ea-4728-a5e1-a19ade546088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.363768 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-afd607b3-a2ea-4728-a5e1-a19ade546088 None None] MFA Rules not processed for user `d25bb60e6a564f679d08e8ef1dd9840f`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:58.364969 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-afd607b3-a2ea-4728-a5e1-a19ade546088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:58.394981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:58.436574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1337/2673] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:58.441353 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20015-602b-4a55-b362-e9918db80e57 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:58.511313 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20015-602b-4a55-b362-e9918db80e57 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:58.516823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec584b6a-7124-4ced-b617-67d337986103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:58.517488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec584b6a-7124-4ced-b617-67d337986103 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.517766 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec584b6a-7124-4ced-b617-67d337986103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.518369 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec584b6a-7124-4ced-b617-67d337986103 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.519012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec584b6a-7124-4ced-b617-67d337986103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:58.521184 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec584b6a-7124-4ced-b617-67d337986103 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:58.554370 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1337/2674] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:58 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:58.558835 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd607b3-a2ea-4728-a5e1-a19ade546088 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:58.570971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd607b3-a2ea-4728-a5e1-a19ade546088 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:58.636240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a8d58-7b72-4b5d-9adf-4a23e558d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:58.637041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a8d58-7b72-4b5d-9adf-4a23e558d9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.637446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a8d58-7b72-4b5d-9adf-4a23e558d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.637813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a8d58-7b72-4b5d-9adf-4a23e558d9d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.638549 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a8d58-7b72-4b5d-9adf-4a23e558d9d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:58.640565 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a8d58-7b72-4b5d-9adf-4a23e558d9d6 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:58.664142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1338/2675] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:58 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:58.668615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec584b6a-7124-4ced-b617-67d337986103 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:58.680230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec584b6a-7124-4ced-b617-67d337986103 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:58.686542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af6c23-a8e6-49c1-93af-e2002848fe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:58.687156 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af6c23-a8e6-49c1-93af-e2002848fe32 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.687423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af6c23-a8e6-49c1-93af-e2002848fe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.687692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af6c23-a8e6-49c1-93af-e2002848fe32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.688341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af6c23-a8e6-49c1-93af-e2002848fe32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:58.689995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af6c23-a8e6-49c1-93af-e2002848fe32 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:58.702338 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1338/2676] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:25:58.706434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a8d58-7b72-4b5d-9adf-4a23e558d9d6 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:58.717315 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a8d58-7b72-4b5d-9adf-4a23e558d9d6 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:58.722917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051183e9-7cb1-467b-8fd8-f3bf8f655920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:58.723665 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051183e9-7cb1-467b-8fd8-f3bf8f655920 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.723918 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051183e9-7cb1-467b-8fd8-f3bf8f655920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.724179 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051183e9-7cb1-467b-8fd8-f3bf8f655920 admin admin] PATH_INFO: `/v3/projects/d055c8be79904041a321ea95627359eb/users/86a6c880511a4b6c9d99a6a0908dbdfb/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.740942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051183e9-7cb1-467b-8fd8-f3bf8f655920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d055c8be79904041a321ea95627359eb, user_id=86a6c880511a4b6c9d99a6a0908dbdfb, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:58.743626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051183e9-7cb1-467b-8fd8-f3bf8f655920 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:58.758343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1339/2677] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:58 2022] PUT /identity/v3/projects/d055c8be79904041a321ea95627359eb/users/86a6c880511a4b6c9d99a6a0908dbdfb/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:58.763305 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af6c23-a8e6-49c1-93af-e2002848fe32 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:58.774637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af6c23-a8e6-49c1-93af-e2002848fe32 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:58.835052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe213c-282a-42a5-a4f6-8d2f74d7462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:58.835755 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe213c-282a-42a5-a4f6-8d2f74d7462e admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.836093 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe213c-282a-42a5-a4f6-8d2f74d7462e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.836426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe213c-282a-42a5-a4f6-8d2f74d7462e admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.837671 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe213c-282a-42a5-a4f6-8d2f74d7462e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:58.839383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe213c-282a-42a5-a4f6-8d2f74d7462e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:58.846431 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:58.852656 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1339/2678] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:25:58.857408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051183e9-7cb1-467b-8fd8-f3bf8f655920 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:58.874826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051183e9-7cb1-467b-8fd8-f3bf8f655920 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:58.879714 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00854b-e736-452b-8461-f43612b8ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:58.880396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00854b-e736-452b-8461-f43612b8ee39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.880692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00854b-e736-452b-8461-f43612b8ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.880938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00854b-e736-452b-8461-f43612b8ee39 admin admin] PATH_INFO: `/v3/projects/d055c8be79904041a321ea95627359eb/users/86a6c880511a4b6c9d99a6a0908dbdfb/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.882881 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00854b-e736-452b-8461-f43612b8ee39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d055c8be79904041a321ea95627359eb, user_id=86a6c880511a4b6c9d99a6a0908dbdfb, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:58.890038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00854b-e736-452b-8461-f43612b8ee39 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:58.908845 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1340/2679] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:58 2022] PUT /identity/v3/projects/d055c8be79904041a321ea95627359eb/users/86a6c880511a4b6c9d99a6a0908dbdfb/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:58.920961 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc9f53-497a-4ced-a3d7-c6fcf061c348 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.921443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc9f53-497a-4ced-a3d7-c6fcf061c348 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.921820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc9f53-497a-4ced-a3d7-c6fcf061c348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.961045 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-67cc9f53-497a-4ced-a3d7-c6fcf061c348 None None] MFA Rules not processed for user `86a6c880511a4b6c9d99a6a0908dbdfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:58.972292 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-67cc9f53-497a-4ced-a3d7-c6fcf061c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:59.063491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1340/2680] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:25:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:59.078280 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00854b-e736-452b-8461-f43612b8ee39 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:59.079480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1b00854b-e736-452b-8461-f43612b8ee39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:59.166666 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00854b-e736-452b-8461-f43612b8ee39 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:59.171589 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecf597-4d0d-4274-bf0e-0e6e9b33e93f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:59.183575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf597-4d0d-4274-bf0e-0e6e9b33e93f service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:59.183991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf597-4d0d-4274-bf0e-0e6e9b33e93f service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:59.184197 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf597-4d0d-4274-bf0e-0e6e9b33e93f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:59.199341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecf597-4d0d-4274-bf0e-0e6e9b33e93f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:59.200548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecf597-4d0d-4274-bf0e-0e6e9b33e93f service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:59.213011 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1341/2681] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:59.313718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc9f53-497a-4ced-a3d7-c6fcf061c348 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:59.324836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc9f53-497a-4ced-a3d7-c6fcf061c348 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:59.329814 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f611483-63fa-4d92-abeb-f0f994145c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:59.329979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f611483-63fa-4d92-abeb-f0f994145c7e service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:59.330286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f611483-63fa-4d92-abeb-f0f994145c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:59.330583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f611483-63fa-4d92-abeb-f0f994145c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:59.396777 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f611483-63fa-4d92-abeb-f0f994145c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:59.398314 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f611483-63fa-4d92-abeb-f0f994145c7e service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:59.409538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1341/2682] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:00.006496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecf597-4d0d-4274-bf0e-0e6e9b33e93f service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:00.008323 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-bdecf597-4d0d-4274-bf0e-0e6e9b33e93f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:00.042732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:00.098627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecf597-4d0d-4274-bf0e-0e6e9b33e93f service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:00.103708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:00.104373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:00.104650 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:00.104919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] PATH_INFO: `/v3/users/bb8a9601d47643919dbe9f17a4ea0e11` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:00.106106 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8a9601d47643919dbe9f17a4ea0e11)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:00.108017 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:00.158612 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8a9601d47643919dbe9f17a4ea0e11'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:00.170146 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8a9601d47643919dbe9f17a4ea0e11'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:00.170822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8a9601d47643919dbe9f17a4ea0e11'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:00.179066 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8a9601d47643919dbe9f17a4ea0e11'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:00.193124 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8a9601d47643919dbe9f17a4ea0e11'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:00.199991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1342/2683] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:00 2022] DELETE /identity/v3/users/bb8a9601d47643919dbe9f17a4ea0e11 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:00.204870 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72d128-6d41-4036-bb48-c002e627f588 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:00.205434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72d128-6d41-4036-bb48-c002e627f588 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:00.205572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72d128-6d41-4036-bb48-c002e627f588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:00.226248 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-3e72d128-6d41-4036-bb48-c002e627f588 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:00.227683 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3e72d128-6d41-4036-bb48-c002e627f588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:00.311094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1342/2684] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:00.322076 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:00.326122 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:00.406491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73b28b-37b0-4de7-9216-45e41fb1470d admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:00.410311 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c44502-1272-4fce-accd-ead621c8b392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:00.410983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c44502-1272-4fce-accd-ead621c8b392 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:00.411279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c44502-1272-4fce-accd-ead621c8b392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:00.411532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c44502-1272-4fce-accd-ead621c8b392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:00.425261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c44502-1272-4fce-accd-ead621c8b392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:00.427829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c44502-1272-4fce-accd-ead621c8b392 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:00.440147 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1343/2685] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:00.836916 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72d128-6d41-4036-bb48-c002e627f588 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:00.838736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-3e72d128-6d41-4036-bb48-c002e627f588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:00.861823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72d128-6d41-4036-bb48-c002e627f588 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:00.890508 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:00.891437 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:00.891816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:00.892179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] PATH_INFO: `/v3/projects/dcdc3372c24f4eb594be2e389931d467` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:00.893793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcdc3372c24f4eb594be2e389931d467)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:00.896141 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:00.924312 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:00.971367 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcdc3372c24f4eb594be2e389931d467', 'request_id': 'req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:00.982733 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcdc3372c24f4eb594be2e389931d467', 'request_id': 'req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:00.994324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcdc3372c24f4eb594be2e389931d467', 'request_id': 'req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:00.999672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c44502-1272-4fce-accd-ead621c8b392 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:01.001617 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-64c44502-1272-4fce-accd-ead621c8b392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:01.013640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] The token cache is being invalidate because project dcdc3372c24f4eb594be2e389931d467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:01.013962 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.014749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.016902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1343/2686] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:00 2022] DELETE /identity/v3/projects/dcdc3372c24f4eb594be2e389931d467 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:01.022629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c44502-1272-4fce-accd-ead621c8b392 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:01.023157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:01.025081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:01.078697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:01.098046 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:01.098196 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.098397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.098799 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] PATH_INFO: `/v3/users/30a43f66db08456fb272d7e13a1c9256` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.116271 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a43f66db08456fb272d7e13a1c9256)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:01.118816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df8fe2-8ce2-4ada-bfc1-776c69d8b53e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:01.118965 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:01.124537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:01.125349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.125769 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.126048 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] PATH_INFO: `/v3/users/f7d5114426074aea8efaaa2fbe7cb92f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.127226 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7d5114426074aea8efaaa2fbe7cb92f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:01.129182 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:01.211962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a43f66db08456fb272d7e13a1c9256'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.220871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7d5114426074aea8efaaa2fbe7cb92f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.224524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a43f66db08456fb272d7e13a1c9256'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.225123 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a43f66db08456fb272d7e13a1c9256'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.234900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a43f66db08456fb272d7e13a1c9256'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.239987 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7d5114426074aea8efaaa2fbe7cb92f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.242289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7d5114426074aea8efaaa2fbe7cb92f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.243384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7d5114426074aea8efaaa2fbe7cb92f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.251092 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a43f66db08456fb272d7e13a1c9256'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.255453 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7d5114426074aea8efaaa2fbe7cb92f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.259408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1344/2687] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:00 2022] DELETE /identity/v3/users/30a43f66db08456fb272d7e13a1c9256 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:01.271580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1344/2688] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:01 2022] DELETE /identity/v3/users/f7d5114426074aea8efaaa2fbe7cb92f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:01.462287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:01.463926 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:01.547142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623719da-c324-492d-a8b7-c1f4d94a10be admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:01.587005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:01.589079 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:01.632540 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:01.632762 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:01.633378 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.634286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.634286 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc admin admin] PATH_INFO: `/v3/projects/8a005352f6ff4639b4a651aedca77541` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.637991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:01.649472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a005352f6ff4639b4a651aedca77541)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:01.652866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:01.671290 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515762ad-50d6-4ceb-9c48-bdd7eee4fe1f admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:01.676002 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:01.676636 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.676905 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.677173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403 admin admin] PATH_INFO: `/v3/projects/f1da734c3514496bb4ecdfa2e3a3424a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.678373 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1da734c3514496bb4ecdfa2e3a3424a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:01.680301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:01.699627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a005352f6ff4639b4a651aedca77541', 'request_id': 'req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.708126 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a005352f6ff4639b4a651aedca77541', 'request_id': 'req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.715340 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a005352f6ff4639b4a651aedca77541', 'request_id': 'req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.726358 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc admin admin] The token cache is being invalidate because project 8a005352f6ff4639b4a651aedca77541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:01.726670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.727252 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e213c18e-8a55-49c5-aa7f-3f1fdff5e7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.728867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1345/2689] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:01 2022] DELETE /identity/v3/projects/8a005352f6ff4639b4a651aedca77541 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:01.730045 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1da734c3514496bb4ecdfa2e3a3424a', 'request_id': 'req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.733976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96c8ff-c578-4c2b-a405-a117e9e21bd8 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.734264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96c8ff-c578-4c2b-a405-a117e9e21bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.734537 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96c8ff-c578-4c2b-a405-a117e9e21bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.739907 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1da734c3514496bb4ecdfa2e3a3424a', 'request_id': 'req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.746885 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1da734c3514496bb4ecdfa2e3a3424a', 'request_id': 'req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.755488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7f96c8ff-c578-4c2b-a405-a117e9e21bd8 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:01.756860 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7f96c8ff-c578-4c2b-a405-a117e9e21bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:01.757641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403 admin admin] The token cache is being invalidate because project f1da734c3514496bb4ecdfa2e3a3424a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:01.757958 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.758666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-baf988b0-f3c0-4a0e-8807-b3f39b4fe403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.760357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1345/2690] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:01 2022] DELETE /identity/v3/projects/f1da734c3514496bb4ecdfa2e3a3424a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:01.765229 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34aa11f-20b0-4572-8df2-a07b23b3e112 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.765526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34aa11f-20b0-4572-8df2-a07b23b3e112 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.765793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34aa11f-20b0-4572-8df2-a07b23b3e112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.786139 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-c34aa11f-20b0-4572-8df2-a07b23b3e112 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:01.787331 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c34aa11f-20b0-4572-8df2-a07b23b3e112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:01.823266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1346/2691] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:01.834114 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599bde8-f546-4fa2-9da9-f01366e2c880 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.834393 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599bde8-f546-4fa2-9da9-f01366e2c880 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.834672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599bde8-f546-4fa2-9da9-f01366e2c880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.858507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1346/2692] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:01.858724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c599bde8-f546-4fa2-9da9-f01366e2c880 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:01.858724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c599bde8-f546-4fa2-9da9-f01366e2c880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:01.860207 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e437a6-4553-4035-b48e-a644e7674e82 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.860446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e437a6-4553-4035-b48e-a644e7674e82 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.861373 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e437a6-4553-4035-b48e-a644e7674e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.865049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1347/2693] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:01.869189 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599bde8-f546-4fa2-9da9-f01366e2c880 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:01.878396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599bde8-f546-4fa2-9da9-f01366e2c880 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:01.881615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-f0e437a6-4553-4035-b48e-a644e7674e82 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:01.882819 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f0e437a6-4553-4035-b48e-a644e7674e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:01.883011 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2e787-1e8c-426a-97d8-c785ef26f5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:01.883619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2e787-1e8c-426a-97d8-c785ef26f5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.883955 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2e787-1e8c-426a-97d8-c785ef26f5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.884351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2e787-1e8c-426a-97d8-c785ef26f5cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.885290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2e787-1e8c-426a-97d8-c785ef26f5cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:01.885654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2e787-1e8c-426a-97d8-c785ef26f5cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:01.887351 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2e787-1e8c-426a-97d8-c785ef26f5cf admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:01.891539 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1347/2694] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:01.896152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e437a6-4553-4035-b48e-a644e7674e82 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:01.901417 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1348/2695] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:01.905963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2e787-1e8c-426a-97d8-c785ef26f5cf admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:01.908274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e437a6-4553-4035-b48e-a644e7674e82 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:01.913017 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ebd22-9dce-46b4-9e49-8cf455eaea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:01.913646 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ebd22-9dce-46b4-9e49-8cf455eaea68 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.913920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ebd22-9dce-46b4-9e49-8cf455eaea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.914186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ebd22-9dce-46b4-9e49-8cf455eaea68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.914827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ebd22-9dce-46b4-9e49-8cf455eaea68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:01.915120 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ebd22-9dce-46b4-9e49-8cf455eaea68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:01.917021 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ebd22-9dce-46b4-9e49-8cf455eaea68 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:01.918952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2e787-1e8c-426a-97d8-c785ef26f5cf admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:01.924347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fa9ab-3ccc-4fdc-8021-6254899aa86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:01.924945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fa9ab-3ccc-4fdc-8021-6254899aa86b admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.925247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fa9ab-3ccc-4fdc-8021-6254899aa86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.925608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fa9ab-3ccc-4fdc-8021-6254899aa86b admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.926546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fa9ab-3ccc-4fdc-8021-6254899aa86b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:01.932732 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1348/2696] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:26:01.932884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fa9ab-3ccc-4fdc-8021-6254899aa86b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:01.933904 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ebd22-9dce-46b4-9e49-8cf455eaea68 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:01.944558 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ebd22-9dce-46b4-9e49-8cf455eaea68 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:01.949520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ed28a-9ea3-41da-96c8-8112193f45d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:01.950110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ed28a-9ea3-41da-96c8-8112193f45d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.950383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ed28a-9ea3-41da-96c8-8112193f45d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.950652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ed28a-9ea3-41da-96c8-8112193f45d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.951287 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ed28a-9ea3-41da-96c8-8112193f45d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:01.953316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ed28a-9ea3-41da-96c8-8112193f45d6 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:01.967497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1349/2697] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:01 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:01.968492 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fa9ab-3ccc-4fdc-8021-6254899aa86b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:01.986322 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1349/2698] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:01 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:01.987501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ed28a-9ea3-41da-96c8-8112193f45d6 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.005357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:02.019399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:02.038755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fa9ab-3ccc-4fdc-8021-6254899aa86b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.054828 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ed28a-9ea3-41da-96c8-8112193f45d6 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.059929 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ebcb4-3828-4657-b3fa-47d31b938efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.060573 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ebcb4-3828-4657-b3fa-47d31b938efc admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.060850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ebcb4-3828-4657-b3fa-47d31b938efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.061116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ebcb4-3828-4657-b3fa-47d31b938efc admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.061786 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ebcb4-3828-4657-b3fa-47d31b938efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.063756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ebcb4-3828-4657-b3fa-47d31b938efc admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.086248 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1350/2699] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:01 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:02.090493 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ebcb4-3828-4657-b3fa-47d31b938efc admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.102039 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0018d8-a300-4087-bb38-59132348dae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.102678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0018d8-a300-4087-bb38-59132348dae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.102938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0018d8-a300-4087-bb38-59132348dae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.103341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0018d8-a300-4087-bb38-59132348dae8 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.104206 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0018d8-a300-4087-bb38-59132348dae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.106045 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0018d8-a300-4087-bb38-59132348dae8 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.107131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ebcb4-3828-4657-b3fa-47d31b938efc admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.112350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ccba0-b320-4c34-8304-8bf45103c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.112955 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ccba0-b320-4c34-8304-8bf45103c87c admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.113255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ccba0-b320-4c34-8304-8bf45103c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.113525 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ccba0-b320-4c34-8304-8bf45103c87c admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.114170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ccba0-b320-4c34-8304-8bf45103c87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.115826 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ccba0-b320-4c34-8304-8bf45103c87c admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.131428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1351/2700] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:02.131612 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1350/2701] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:01 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:02.133643 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0018d8-a300-4087-bb38-59132348dae8 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.133779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ccba0-b320-4c34-8304-8bf45103c87c admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.143866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0018d8-a300-4087-bb38-59132348dae8 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.144720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ccba0-b320-4c34-8304-8bf45103c87c admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.148483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909a8e4-028f-4543-8855-44055b03523a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.149079 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909a8e4-028f-4543-8855-44055b03523a admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.149387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909a8e4-028f-4543-8855-44055b03523a admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.149659 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909a8e4-028f-4543-8855-44055b03523a admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.149902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbc6aa-2abf-44e7-af68-ac3ff0924f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.150522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909a8e4-028f-4543-8855-44055b03523a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.150864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbc6aa-2abf-44e7-af68-ac3ff0924f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.151201 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbc6aa-2abf-44e7-af68-ac3ff0924f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.151474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbc6aa-2abf-44e7-af68-ac3ff0924f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.152111 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbc6aa-2abf-44e7-af68-ac3ff0924f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.152208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909a8e4-028f-4543-8855-44055b03523a admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.153714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbc6aa-2abf-44e7-af68-ac3ff0924f67 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.162104 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1351/2702] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:02.165251 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1352/2703] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:02.168441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909a8e4-028f-4543-8855-44055b03523a admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.168588 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbc6aa-2abf-44e7-af68-ac3ff0924f67 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.178475 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909a8e4-028f-4543-8855-44055b03523a admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.178632 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbc6aa-2abf-44e7-af68-ac3ff0924f67 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.183388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254412a-ac14-4217-a2eb-7f64c47fea94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.184038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bf780-5982-4847-a473-96d942b5b85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.184175 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254412a-ac14-4217-a2eb-7f64c47fea94 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.184496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254412a-ac14-4217-a2eb-7f64c47fea94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.184696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bf780-5982-4847-a473-96d942b5b85f admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.184869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254412a-ac14-4217-a2eb-7f64c47fea94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.184968 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bf780-5982-4847-a473-96d942b5b85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.185242 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bf780-5982-4847-a473-96d942b5b85f admin admin] PATH_INFO: `/v3/projects/5dc7d75bfb5f465cb19fddfbb02dadb2/users/77e3e38aa49141ed86d56ff5cf946fcd/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.185649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254412a-ac14-4217-a2eb-7f64c47fea94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.187356 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254412a-ac14-4217-a2eb-7f64c47fea94 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.198995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1352/2704] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:02.202753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bf780-5982-4847-a473-96d942b5b85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc7d75bfb5f465cb19fddfbb02dadb2, user_id=77e3e38aa49141ed86d56ff5cf946fcd, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.203210 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254412a-ac14-4217-a2eb-7f64c47fea94 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.205462 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bf780-5982-4847-a473-96d942b5b85f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.214580 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254412a-ac14-4217-a2eb-7f64c47fea94 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.219784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387375a-bc5d-4a0c-af77-1f03ecf7377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.220446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387375a-bc5d-4a0c-af77-1f03ecf7377d admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.220717 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387375a-bc5d-4a0c-af77-1f03ecf7377d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.220990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387375a-bc5d-4a0c-af77-1f03ecf7377d admin admin] PATH_INFO: `/v3/projects/89044324f286422b876284305f605a6a/users/283514ae49b5405ca5535af223a052ba/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.223339 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1353/2705] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:02 2022] PUT /identity/v3/projects/5dc7d75bfb5f465cb19fddfbb02dadb2/users/77e3e38aa49141ed86d56ff5cf946fcd/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:02.235211 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c862-11f6-4e4e-97b0-b3316784919c None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.235866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c862-11f6-4e4e-97b0-b3316784919c None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.236643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c862-11f6-4e4e-97b0-b3316784919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.238262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387375a-bc5d-4a0c-af77-1f03ecf7377d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89044324f286422b876284305f605a6a, user_id=283514ae49b5405ca5535af223a052ba, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.240921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387375a-bc5d-4a0c-af77-1f03ecf7377d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.260815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1353/2706] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:02 2022] PUT /identity/v3/projects/89044324f286422b876284305f605a6a/users/283514ae49b5405ca5535af223a052ba/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:02.271699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62ac9c-d433-4afe-98d8-87f7cdc44938 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.271983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62ac9c-d433-4afe-98d8-87f7cdc44938 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.272416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62ac9c-d433-4afe-98d8-87f7cdc44938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.286350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-c640c862-11f6-4e4e-97b0-b3316784919c None None] MFA Rules not processed for user `77e3e38aa49141ed86d56ff5cf946fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:02.287569 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c640c862-11f6-4e4e-97b0-b3316784919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:02.304377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-4c62ac9c-d433-4afe-98d8-87f7cdc44938 None None] MFA Rules not processed for user `283514ae49b5405ca5535af223a052ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:02.305625 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-4c62ac9c-d433-4afe-98d8-87f7cdc44938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:02.377970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1354/2707] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:02.379749 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640c862-11f6-4e4e-97b0-b3316784919c None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.386930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1354/2708] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:02.404341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62ac9c-d433-4afe-98d8-87f7cdc44938 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.404341 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-4c62ac9c-d433-4afe-98d8-87f7cdc44938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:02.427673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:02.441757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:02.461874 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640c862-11f6-4e4e-97b0-b3316784919c None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.464057 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62ac9c-d433-4afe-98d8-87f7cdc44938 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.466943 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b175f8a-64ec-4549-8e81-7fdfc149fd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.467557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b175f8a-64ec-4549-8e81-7fdfc149fd84 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.467964 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b175f8a-64ec-4549-8e81-7fdfc149fd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.468084 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b507117-d08d-4c96-82e6-cd2f2dd6e084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.468280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b175f8a-64ec-4549-8e81-7fdfc149fd84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.468586 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b507117-d08d-4c96-82e6-cd2f2dd6e084 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.468857 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b507117-d08d-4c96-82e6-cd2f2dd6e084 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.468972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b175f8a-64ec-4549-8e81-7fdfc149fd84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.469137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b507117-d08d-4c96-82e6-cd2f2dd6e084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.470832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b175f8a-64ec-4549-8e81-7fdfc149fd84 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.477786 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b507117-d08d-4c96-82e6-cd2f2dd6e084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.479257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b507117-d08d-4c96-82e6-cd2f2dd6e084 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.488609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1355/2709] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:02.511916 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1355/2710] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:02 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:02.513042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b507117-d08d-4c96-82e6-cd2f2dd6e084 service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.526207 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b507117-d08d-4c96-82e6-cd2f2dd6e084 service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.609771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5688216-5cad-4fd9-9700-50d7ec72c061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.610455 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5688216-5cad-4fd9-9700-50d7ec72c061 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.610735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5688216-5cad-4fd9-9700-50d7ec72c061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.610992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5688216-5cad-4fd9-9700-50d7ec72c061 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.611631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5688216-5cad-4fd9-9700-50d7ec72c061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.613930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5688216-5cad-4fd9-9700-50d7ec72c061 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.638071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1356/2711] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:02 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:02.641956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b175f8a-64ec-4549-8e81-7fdfc149fd84 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.654423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b175f8a-64ec-4549-8e81-7fdfc149fd84 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.659649 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160b62f-99e5-4df7-bbfb-96cc6e153885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.660274 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160b62f-99e5-4df7-bbfb-96cc6e153885 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.660537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160b62f-99e5-4df7-bbfb-96cc6e153885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.660804 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160b62f-99e5-4df7-bbfb-96cc6e153885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.661482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160b62f-99e5-4df7-bbfb-96cc6e153885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.663328 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160b62f-99e5-4df7-bbfb-96cc6e153885 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.674889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1356/2712] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:02.679132 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5688216-5cad-4fd9-9700-50d7ec72c061 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.693781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5688216-5cad-4fd9-9700-50d7ec72c061 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.700220 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1259f-6bfe-499d-b8cf-313d51606686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.701139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1259f-6bfe-499d-b8cf-313d51606686 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.701513 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1259f-6bfe-499d-b8cf-313d51606686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.702133 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1259f-6bfe-499d-b8cf-313d51606686 admin admin] PATH_INFO: `/v3/projects/924cfdb3230043d29a11abfd9ee4a791/users/0c10a79291c040f681a8428b1bb55757/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.725836 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1259f-6bfe-499d-b8cf-313d51606686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924cfdb3230043d29a11abfd9ee4a791, user_id=0c10a79291c040f681a8428b1bb55757, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.728892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1259f-6bfe-499d-b8cf-313d51606686 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.749801 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1357/2713] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:02 2022] PUT /identity/v3/projects/924cfdb3230043d29a11abfd9ee4a791/users/0c10a79291c040f681a8428b1bb55757/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:02.754052 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160b62f-99e5-4df7-bbfb-96cc6e153885 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.766230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160b62f-99e5-4df7-bbfb-96cc6e153885 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.867190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74503f01-6a46-4056-a4c6-4a0cc11219cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.867894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74503f01-6a46-4056-a4c6-4a0cc11219cf admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.868268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74503f01-6a46-4056-a4c6-4a0cc11219cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.868568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74503f01-6a46-4056-a4c6-4a0cc11219cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.869280 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74503f01-6a46-4056-a4c6-4a0cc11219cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.871232 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74503f01-6a46-4056-a4c6-4a0cc11219cf admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.882514 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1357/2714] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:02.887553 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1259f-6bfe-499d-b8cf-313d51606686 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.901477 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1259f-6bfe-499d-b8cf-313d51606686 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.906479 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b9df-9fa3-4e88-8bff-bde0417421fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.907145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b9df-9fa3-4e88-8bff-bde0417421fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.907424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b9df-9fa3-4e88-8bff-bde0417421fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.907694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b9df-9fa3-4e88-8bff-bde0417421fe admin admin] PATH_INFO: `/v3/projects/924cfdb3230043d29a11abfd9ee4a791/users/0c10a79291c040f681a8428b1bb55757/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.909785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15b9df-9fa3-4e88-8bff-bde0417421fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=924cfdb3230043d29a11abfd9ee4a791, user_id=0c10a79291c040f681a8428b1bb55757, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.912596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15b9df-9fa3-4e88-8bff-bde0417421fe admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:02.925382 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1358/2715] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:02 2022] PUT /identity/v3/projects/924cfdb3230043d29a11abfd9ee4a791/users/0c10a79291c040f681a8428b1bb55757/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:02.935795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947a428-1280-4125-8123-2c3bc830218f None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.936079 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947a428-1280-4125-8123-2c3bc830218f None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.936348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947a428-1280-4125-8123-2c3bc830218f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.967468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-d947a428-1280-4125-8123-2c3bc830218f None None] MFA Rules not processed for user `0c10a79291c040f681a8428b1bb55757`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:02.968784 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d947a428-1280-4125-8123-2c3bc830218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:03.039884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1358/2716] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:03.052609 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b9df-9fa3-4e88-8bff-bde0417421fe admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:03.117110 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b9df-9fa3-4e88-8bff-bde0417421fe admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:03.120840 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c0349-5b21-4ce1-859c-5b532807c840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:03.121478 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c0349-5b21-4ce1-859c-5b532807c840 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:03.121912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c0349-5b21-4ce1-859c-5b532807c840 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:03.122177 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c0349-5b21-4ce1-859c-5b532807c840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:03.131240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c0349-5b21-4ce1-859c-5b532807c840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:03.132894 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c0349-5b21-4ce1-859c-5b532807c840 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:03.144266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1359/2717] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:03.246922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947a428-1280-4125-8123-2c3bc830218f None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:03.258689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947a428-1280-4125-8123-2c3bc830218f None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:03.262509 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877722a-e99a-4b24-8ce2-35d4189d165b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:03.263145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877722a-e99a-4b24-8ce2-35d4189d165b service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:03.263912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877722a-e99a-4b24-8ce2-35d4189d165b service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:03.263912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877722a-e99a-4b24-8ce2-35d4189d165b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:03.307084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:03.325264 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877722a-e99a-4b24-8ce2-35d4189d165b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:03.326764 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877722a-e99a-4b24-8ce2-35d4189d165b service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:03.336810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1359/2718] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:03.937578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c0349-5b21-4ce1-859c-5b532807c840 service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:03.939236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-458c0349-5b21-4ce1-859c-5b532807c840 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:03.951518 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c0349-5b21-4ce1-859c-5b532807c840 service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:03.956186 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98421081-9279-413a-ae73-1251e81559aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:03.956793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98421081-9279-413a-ae73-1251e81559aa service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:03.957067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98421081-9279-413a-ae73-1251e81559aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:03.957348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98421081-9279-413a-ae73-1251e81559aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:03.959338 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-98421081-9279-413a-ae73-1251e81559aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:03.978500 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:04.035324 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98421081-9279-413a-ae73-1251e81559aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:04.036763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98421081-9279-413a-ae73-1251e81559aa service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:04.048508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1360/2719] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:04.477607 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877722a-e99a-4b24-8ce2-35d4189d165b service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:04.480248 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6877722a-e99a-4b24-8ce2-35d4189d165b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:04.549733 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877722a-e99a-4b24-8ce2-35d4189d165b service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:04.554277 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:04.554897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:04.555168 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:04.555434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] PATH_INFO: `/v3/users/d25bb60e6a564f679d08e8ef1dd9840f` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:04.556537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d25bb60e6a564f679d08e8ef1dd9840f)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:04.558612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:04.612952 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd25bb60e6a564f679d08e8ef1dd9840f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:04.627575 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd25bb60e6a564f679d08e8ef1dd9840f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:04.628341 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd25bb60e6a564f679d08e8ef1dd9840f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:04.629056 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd25bb60e6a564f679d08e8ef1dd9840f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:04.639166 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd25bb60e6a564f679d08e8ef1dd9840f'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:04.655422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1360/2720] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:04 2022] DELETE /identity/v3/users/d25bb60e6a564f679d08e8ef1dd9840f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:04.661050 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6262ec6-e83c-4f56-8b55-7f7baea7e071 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:04.661626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6262ec6-e83c-4f56-8b55-7f7baea7e071 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:04.661728 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6262ec6-e83c-4f56-8b55-7f7baea7e071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:04.686041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e6262ec6-e83c-4f56-8b55-7f7baea7e071 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:04.687399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e6262ec6-e83c-4f56-8b55-7f7baea7e071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:04.750104 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1361/2721] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:04.760625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:04.762179 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:04.831247 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06f599-746c-4ae0-b066-176d73ba54ff admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:04.835290 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198e7b1-0f9f-4f40-802e-fdf93efbd7ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:04.835896 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198e7b1-0f9f-4f40-802e-fdf93efbd7ef service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:04.836160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198e7b1-0f9f-4f40-802e-fdf93efbd7ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:04.836418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198e7b1-0f9f-4f40-802e-fdf93efbd7ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:04.846361 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198e7b1-0f9f-4f40-802e-fdf93efbd7ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:04.847861 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198e7b1-0f9f-4f40-802e-fdf93efbd7ef service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:04.857772 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1361/2722] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:05.152992 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6262ec6-e83c-4f56-8b55-7f7baea7e071 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:05.154595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e6262ec6-e83c-4f56-8b55-7f7baea7e071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:05.168115 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6262ec6-e83c-4f56-8b55-7f7baea7e071 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:05.173600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:05.174280 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:05.174521 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:05.174771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] PATH_INFO: `/v3/projects/0e148599cfbf4e488bf3bec0cd44ffb4` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:05.175911 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e148599cfbf4e488bf3bec0cd44ffb4)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:05.177850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:05.225982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e148599cfbf4e488bf3bec0cd44ffb4', 'request_id': 'req-e42509b7-81ad-420c-9739-312d0efd153c'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.235693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e148599cfbf4e488bf3bec0cd44ffb4', 'request_id': 'req-e42509b7-81ad-420c-9739-312d0efd153c'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.242896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e148599cfbf4e488bf3bec0cd44ffb4', 'request_id': 'req-e42509b7-81ad-420c-9739-312d0efd153c'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.254541 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] The token cache is being invalidate because project 0e148599cfbf4e488bf3bec0cd44ffb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:05.254822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.255447 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.256991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1362/2723] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:05 2022] DELETE /identity/v3/projects/0e148599cfbf4e488bf3bec0cd44ffb4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:05.261662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198e7b1-0f9f-4f40-802e-fdf93efbd7ef service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:05.270601 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:05.274720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198e7b1-0f9f-4f40-802e-fdf93efbd7ef service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:05.339355 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:05.340077 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:05.340350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:05.340616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] PATH_INFO: `/v3/users/86a6c880511a4b6c9d99a6a0908dbdfb` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:05.341932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a6c880511a4b6c9d99a6a0908dbdfb)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:05.343906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:05.392643 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a6c880511a4b6c9d99a6a0908dbdfb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.405806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a6c880511a4b6c9d99a6a0908dbdfb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.406553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a6c880511a4b6c9d99a6a0908dbdfb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.407266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a6c880511a4b6c9d99a6a0908dbdfb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.416446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a6c880511a4b6c9d99a6a0908dbdfb'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.430319 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1362/2724] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:05 2022] DELETE /identity/v3/users/86a6c880511a4b6c9d99a6a0908dbdfb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:05.479257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:05.480781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:05.517226 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:05.548912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42509b7-81ad-420c-9739-312d0efd153c admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:05.602258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648cd94-a677-4d6d-8f63-49cbce23ae3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:05.602970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cd94-a677-4d6d-8f63-49cbce23ae3c service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:05.603345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cd94-a677-4d6d-8f63-49cbce23ae3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:05.603619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cd94-a677-4d6d-8f63-49cbce23ae3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:05.605436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c648cd94-a677-4d6d-8f63-49cbce23ae3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:05.677104 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648cd94-a677-4d6d-8f63-49cbce23ae3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:05.678566 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648cd94-a677-4d6d-8f63-49cbce23ae3c service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:05.689928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1363/2725] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:05.724765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:05.726265 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:05.800871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a439bbf-a08c-4a8b-a1be-07c8f80b6fd2 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:05.811447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:05.812272 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:05.812620 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:05.812984 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] PATH_INFO: `/v3/projects/d055c8be79904041a321ea95627359eb` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:05.814268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d055c8be79904041a321ea95627359eb)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:05.816418 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:05.853546 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:05.873290 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd055c8be79904041a321ea95627359eb', 'request_id': 'req-0478d547-d05e-4e0f-892b-55f5d8f7fe99'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.881578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd055c8be79904041a321ea95627359eb', 'request_id': 'req-0478d547-d05e-4e0f-892b-55f5d8f7fe99'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.889045 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd055c8be79904041a321ea95627359eb', 'request_id': 'req-0478d547-d05e-4e0f-892b-55f5d8f7fe99'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.900355 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] The token cache is being invalidate because project d055c8be79904041a321ea95627359eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:05.900736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.901465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.903220 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1363/2726] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:05 2022] DELETE /identity/v3/projects/d055c8be79904041a321ea95627359eb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:05.908178 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66944-8e07-4a05-9dab-96195b3a4c72 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:05.908512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66944-8e07-4a05-9dab-96195b3a4c72 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:05.908814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66944-8e07-4a05-9dab-96195b3a4c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:05.929984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-b1d66944-8e07-4a05-9dab-96195b3a4c72 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:05.931623 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b1d66944-8e07-4a05-9dab-96195b3a4c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:05.982028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:05.985378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:06.018936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1364/2727] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:06.022529 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963bb40-254f-41c9-ab74-180ce26e8828 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.022946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963bb40-254f-41c9-ab74-180ce26e8828 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.023292 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963bb40-254f-41c9-ab74-180ce26e8828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.062398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-0963bb40-254f-41c9-ab74-180ce26e8828 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:06.063634 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0963bb40-254f-41c9-ab74-180ce26e8828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:06.072153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1365/2728] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:06.074557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478d547-d05e-4e0f-892b-55f5d8f7fe99 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.076412 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963bb40-254f-41c9-ab74-180ce26e8828 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.080389 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66713167-593c-4bd4-b4a4-bca89ce9aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.081076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66713167-593c-4bd4-b4a4-bca89ce9aa91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.081448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66713167-593c-4bd4-b4a4-bca89ce9aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.081672 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66713167-593c-4bd4-b4a4-bca89ce9aa91 admin admin] PATH_INFO: `/v3/users/77e3e38aa49141ed86d56ff5cf946fcd` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.082958 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66713167-593c-4bd4-b4a4-bca89ce9aa91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e3e38aa49141ed86d56ff5cf946fcd)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.087624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66713167-593c-4bd4-b4a4-bca89ce9aa91 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.087773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963bb40-254f-41c9-ab74-180ce26e8828 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.093218 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e044d45-e599-474d-9ab0-a52fba8851fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.097024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044d45-e599-474d-9ab0-a52fba8851fd admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.097024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044d45-e599-474d-9ab0-a52fba8851fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.097024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044d45-e599-474d-9ab0-a52fba8851fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.097024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e044d45-e599-474d-9ab0-a52fba8851fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:06.097024 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e044d45-e599-474d-9ab0-a52fba8851fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.097578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e044d45-e599-474d-9ab0-a52fba8851fd admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.117433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1366/2729] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:06.118892 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e044d45-e599-474d-9ab0-a52fba8851fd admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.131525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e044d45-e599-474d-9ab0-a52fba8851fd admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.136673 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa3e7a-af00-4688-8de9-f9abc92195f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.137316 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3e7a-af00-4688-8de9-f9abc92195f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.137595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3e7a-af00-4688-8de9-f9abc92195f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.137866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3e7a-af00-4688-8de9-f9abc92195f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.138570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa3e7a-af00-4688-8de9-f9abc92195f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.140395 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa3e7a-af00-4688-8de9-f9abc92195f2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.142848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-66713167-593c-4bd4-b4a4-bca89ce9aa91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e3e38aa49141ed86d56ff5cf946fcd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.145518 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:06.155845 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-66713167-593c-4bd4-b4a4-bca89ce9aa91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e3e38aa49141ed86d56ff5cf946fcd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.156625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-66713167-593c-4bd4-b4a4-bca89ce9aa91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e3e38aa49141ed86d56ff5cf946fcd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.157276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-66713167-593c-4bd4-b4a4-bca89ce9aa91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e3e38aa49141ed86d56ff5cf946fcd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.166384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-66713167-593c-4bd4-b4a4-bca89ce9aa91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e3e38aa49141ed86d56ff5cf946fcd'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.172658 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1367/2730] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:06.176956 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa3e7a-af00-4688-8de9-f9abc92195f2 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.178680 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-08fa3e7a-af00-4688-8de9-f9abc92195f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:06.180625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1364/2731] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:05 2022] DELETE /identity/v3/users/77e3e38aa49141ed86d56ff5cf946fcd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:06.185223 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035acd24-2d08-4a6a-b3e4-df4a14df9307 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.185521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035acd24-2d08-4a6a-b3e4-df4a14df9307 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.185795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035acd24-2d08-4a6a-b3e4-df4a14df9307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.204818 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-035acd24-2d08-4a6a-b3e4-df4a14df9307 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:06.206054 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-035acd24-2d08-4a6a-b3e4-df4a14df9307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:06.235256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:06.244502 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa3e7a-af00-4688-8de9-f9abc92195f2 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.270945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1365/2732] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:06.281103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035acd24-2d08-4a6a-b3e4-df4a14df9307 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.283094 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-035acd24-2d08-4a6a-b3e4-df4a14df9307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:06.305791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8896dbb-5f27-45c6-ba37-1632cd25c51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.306715 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8896dbb-5f27-45c6-ba37-1632cd25c51a admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.307058 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8896dbb-5f27-45c6-ba37-1632cd25c51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.307327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8896dbb-5f27-45c6-ba37-1632cd25c51a admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.307972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8896dbb-5f27-45c6-ba37-1632cd25c51a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.311169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8896dbb-5f27-45c6-ba37-1632cd25c51a admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.341602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1368/2733] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:06.346912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8896dbb-5f27-45c6-ba37-1632cd25c51a admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.349678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035acd24-2d08-4a6a-b3e4-df4a14df9307 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.353680 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd90448-7bbe-4ac1-8352-55496661eb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.355756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd90448-7bbe-4ac1-8352-55496661eb4d service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.356064 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd90448-7bbe-4ac1-8352-55496661eb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.356336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd90448-7bbe-4ac1-8352-55496661eb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.359388 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8896dbb-5f27-45c6-ba37-1632cd25c51a admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.366548 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68324-0a20-4d1e-a2b7-caa18d6e7227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.366741 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd90448-7bbe-4ac1-8352-55496661eb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.367570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68324-0a20-4d1e-a2b7-caa18d6e7227 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.367930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68324-0a20-4d1e-a2b7-caa18d6e7227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.368204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd90448-7bbe-4ac1-8352-55496661eb4d service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.368320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68324-0a20-4d1e-a2b7-caa18d6e7227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.369158 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d68324-0a20-4d1e-a2b7-caa18d6e7227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.370898 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d68324-0a20-4d1e-a2b7-caa18d6e7227 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.379040 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1366/2734] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:06.385279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1369/2735] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:06.387300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd90448-7bbe-4ac1-8352-55496661eb4d service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.405053 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd90448-7bbe-4ac1-8352-55496661eb4d service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.411081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9fb54-9133-40ca-87d4-473ae11ba5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.411839 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9fb54-9133-40ca-87d4-473ae11ba5cb admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.412181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9fb54-9133-40ca-87d4-473ae11ba5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.412520 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9fb54-9133-40ca-87d4-473ae11ba5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.413262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9fb54-9133-40ca-87d4-473ae11ba5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.415477 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9fb54-9133-40ca-87d4-473ae11ba5cb admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.429565 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1367/2736] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:06.433155 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68324-0a20-4d1e-a2b7-caa18d6e7227 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.443683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68324-0a20-4d1e-a2b7-caa18d6e7227 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.450783 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5980f73-1300-4f37-a142-ea2947f6bae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.452299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5980f73-1300-4f37-a142-ea2947f6bae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.452985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5980f73-1300-4f37-a142-ea2947f6bae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.452985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5980f73-1300-4f37-a142-ea2947f6bae6 admin admin] PATH_INFO: `/v3/projects/96f512ffd5cd4fb4bfc62e1c4cd1053c/users/7fa58d449aaf41d69066d726bdca874d/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.472304 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5980f73-1300-4f37-a142-ea2947f6bae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f512ffd5cd4fb4bfc62e1c4cd1053c, user_id=7fa58d449aaf41d69066d726bdca874d, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.475099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5980f73-1300-4f37-a142-ea2947f6bae6 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.491111 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1370/2737] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:06 2022] PUT /identity/v3/projects/96f512ffd5cd4fb4bfc62e1c4cd1053c/users/7fa58d449aaf41d69066d726bdca874d/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:06.567200 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b979e-d2fb-4868-923b-5e83d1a36ead None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.567569 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b979e-d2fb-4868-923b-5e83d1a36ead None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.567767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b979e-d2fb-4868-923b-5e83d1a36ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.602868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-ca6b979e-d2fb-4868-923b-5e83d1a36ead None None] MFA Rules not processed for user `7fa58d449aaf41d69066d726bdca874d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:06.604220 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ca6b979e-d2fb-4868-923b-5e83d1a36ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:06.691702 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1368/2738] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:06.696405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5980f73-1300-4f37-a142-ea2947f6bae6 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.699552 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b979e-d2fb-4868-923b-5e83d1a36ead None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.705773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ca6b979e-d2fb-4868-923b-5e83d1a36ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:06.767727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:06.773174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:06.781365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b979e-d2fb-4868-923b-5e83d1a36ead None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.784787 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5980f73-1300-4f37-a142-ea2947f6bae6 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.786173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.786813 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.787087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.787356 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] PATH_INFO: `/v3/projects/5dc7d75bfb5f465cb19fddfbb02dadb2` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.788476 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc7d75bfb5f465cb19fddfbb02dadb2)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.790027 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ac49b-a6cb-4fc3-adc9-637079c496ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.790427 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.790852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac49b-a6cb-4fc3-adc9-637079c496ba admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.791130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac49b-a6cb-4fc3-adc9-637079c496ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.791396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac49b-a6cb-4fc3-adc9-637079c496ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.792060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ac49b-a6cb-4fc3-adc9-637079c496ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.794108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ac49b-a6cb-4fc3-adc9-637079c496ba admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.825839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1371/2739] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:06.826866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ac49b-a6cb-4fc3-adc9-637079c496ba admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.842660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc7d75bfb5f465cb19fddfbb02dadb2', 'request_id': 'req-c8a1dae6-6b02-46a4-8865-70e9cc84c808'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.852009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc7d75bfb5f465cb19fddfbb02dadb2', 'request_id': 'req-c8a1dae6-6b02-46a4-8865-70e9cc84c808'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.859161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc7d75bfb5f465cb19fddfbb02dadb2', 'request_id': 'req-c8a1dae6-6b02-46a4-8865-70e9cc84c808'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.870876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] The token cache is being invalidate because project 5dc7d75bfb5f465cb19fddfbb02dadb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:06.871162 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.871841 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.873704 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1369/2740] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:06 2022] DELETE /identity/v3/projects/5dc7d75bfb5f465cb19fddfbb02dadb2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:06.877399 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.878807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:06.889354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ac49b-a6cb-4fc3-adc9-637079c496ba admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.944996 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1dae6-6b02-46a4-8865-70e9cc84c808 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.948503 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a65a3-3ccb-43b6-a68a-ba7b635bc7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.949120 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a65a3-3ccb-43b6-a68a-ba7b635bc7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.949425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a65a3-3ccb-43b6-a68a-ba7b635bc7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.949689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a65a3-3ccb-43b6-a68a-ba7b635bc7c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.950322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a65a3-3ccb-43b6-a68a-ba7b635bc7c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.951189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.951876 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.952158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.952316 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a65a3-3ccb-43b6-a68a-ba7b635bc7c1 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.952426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] PATH_INFO: `/v3/users/0c10a79291c040f681a8428b1bb55757` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.953600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c10a79291c040f681a8428b1bb55757)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.955583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.978465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1372/2741] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:06.979870 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a65a3-3ccb-43b6-a68a-ba7b635bc7c1 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.981722 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-292a65a3-3ccb-43b6-a68a-ba7b635bc7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:06.994363 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a65a3-3ccb-43b6-a68a-ba7b635bc7c1 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.999091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df24901-5ed5-4882-aeef-ac66116f24f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.999704 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df24901-5ed5-4882-aeef-ac66116f24f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.999980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df24901-5ed5-4882-aeef-ac66116f24f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.000248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df24901-5ed5-4882-aeef-ac66116f24f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.000884 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df24901-5ed5-4882-aeef-ac66116f24f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.002512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df24901-5ed5-4882-aeef-ac66116f24f5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.004912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c10a79291c040f681a8428b1bb55757'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:07.012437 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1373/2742] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:07.016657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df24901-5ed5-4882-aeef-ac66116f24f5 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.018067 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c10a79291c040f681a8428b1bb55757'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:07.019048 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c10a79291c040f681a8428b1bb55757'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:07.019660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c10a79291c040f681a8428b1bb55757'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:07.028204 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df24901-5ed5-4882-aeef-ac66116f24f5 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.030705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c10a79291c040f681a8428b1bb55757'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:07.033971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad703bf-04ba-4ac8-9d08-df95a5fe4fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.034649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad703bf-04ba-4ac8-9d08-df95a5fe4fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.034911 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad703bf-04ba-4ac8-9d08-df95a5fe4fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.035211 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad703bf-04ba-4ac8-9d08-df95a5fe4fe9 admin admin] PATH_INFO: `/v3/projects/01d2b692b37f46c98eba7f30138a85d5/users/6edcf40cd9814ac78c13a5b4a4a72658/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.044670 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1370/2743] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:06 2022] DELETE /identity/v3/users/0c10a79291c040f681a8428b1bb55757 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:07.054721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad703bf-04ba-4ac8-9d08-df95a5fe4fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d2b692b37f46c98eba7f30138a85d5, user_id=6edcf40cd9814ac78c13a5b4a4a72658, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.058237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad703bf-04ba-4ac8-9d08-df95a5fe4fe9 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.077268 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1374/2744] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:07 2022] PUT /identity/v3/projects/01d2b692b37f46c98eba7f30138a85d5/users/6edcf40cd9814ac78c13a5b4a4a72658/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:07.078528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.080197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:07.088169 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:07.185756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fccfd-af97-4bf6-acaa-6b8c901b9556 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.255705 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43d9f8-bd52-4955-9e20-77ce9b80eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.256375 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43d9f8-bd52-4955-9e20-77ce9b80eed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.256641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43d9f8-bd52-4955-9e20-77ce9b80eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.256926 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43d9f8-bd52-4955-9e20-77ce9b80eed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.257592 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43d9f8-bd52-4955-9e20-77ce9b80eed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.259206 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43d9f8-bd52-4955-9e20-77ce9b80eed4 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.270457 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1371/2745] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:07.274398 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad703bf-04ba-4ac8-9d08-df95a5fe4fe9 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.285031 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad703bf-04ba-4ac8-9d08-df95a5fe4fe9 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.291536 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d22ca-977c-485f-9754-831263b31ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.292204 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d22ca-977c-485f-9754-831263b31ace admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.292861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d22ca-977c-485f-9754-831263b31ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.292861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d22ca-977c-485f-9754-831263b31ace admin admin] PATH_INFO: `/v3/projects/01d2b692b37f46c98eba7f30138a85d5/users/6edcf40cd9814ac78c13a5b4a4a72658/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.294678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d22ca-977c-485f-9754-831263b31ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d2b692b37f46c98eba7f30138a85d5, user_id=6edcf40cd9814ac78c13a5b4a4a72658, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.297499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d22ca-977c-485f-9754-831263b31ace admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.313950 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1375/2746] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:07 2022] PUT /identity/v3/projects/01d2b692b37f46c98eba7f30138a85d5/users/6edcf40cd9814ac78c13a5b4a4a72658/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:07.325015 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d04b-ca38-4074-a987-87d0d5a1a716 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.325315 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d04b-ca38-4074-a987-87d0d5a1a716 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.325600 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d04b-ca38-4074-a987-87d0d5a1a716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.366475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a6c9d04b-ca38-4074-a987-87d0d5a1a716 None None] MFA Rules not processed for user `6edcf40cd9814ac78c13a5b4a4a72658`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:07.366475 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a6c9d04b-ca38-4074-a987-87d0d5a1a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:07.368093 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d22ca-977c-485f-9754-831263b31ace admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.369813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-869d22ca-977c-485f-9754-831263b31ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:07.407062 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:07.465778 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1372/2747] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:07.466978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d22ca-977c-485f-9754-831263b31ace admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.471619 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709db0-90c9-412c-a22e-36ab3865788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.472466 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709db0-90c9-412c-a22e-36ab3865788d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.472810 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709db0-90c9-412c-a22e-36ab3865788d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.473081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709db0-90c9-412c-a22e-36ab3865788d admin admin] PATH_INFO: `/v3/projects/924cfdb3230043d29a11abfd9ee4a791` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.473722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9d04b-ca38-4074-a987-87d0d5a1a716 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.474275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709db0-90c9-412c-a22e-36ab3865788d admin admin] RBAC: Authorizing `identity:delete_project(project_id=924cfdb3230043d29a11abfd9ee4a791)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.475406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a6c9d04b-ca38-4074-a987-87d0d5a1a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:07.476354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709db0-90c9-412c-a22e-36ab3865788d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.514886 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:07.533924 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-92709db0-90c9-412c-a22e-36ab3865788d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924cfdb3230043d29a11abfd9ee4a791', 'request_id': 'req-92709db0-90c9-412c-a22e-36ab3865788d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:07.543550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-92709db0-90c9-412c-a22e-36ab3865788d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924cfdb3230043d29a11abfd9ee4a791', 'request_id': 'req-92709db0-90c9-412c-a22e-36ab3865788d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:07.544801 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9d04b-ca38-4074-a987-87d0d5a1a716 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.551234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-92709db0-90c9-412c-a22e-36ab3865788d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924cfdb3230043d29a11abfd9ee4a791', 'request_id': 'req-92709db0-90c9-412c-a22e-36ab3865788d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:07.566298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-92709db0-90c9-412c-a22e-36ab3865788d admin admin] The token cache is being invalidate because project 924cfdb3230043d29a11abfd9ee4a791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:07.566589 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-92709db0-90c9-412c-a22e-36ab3865788d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:07.567593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-92709db0-90c9-412c-a22e-36ab3865788d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:07.569253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1376/2748] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:07 2022] DELETE /identity/v3/projects/924cfdb3230043d29a11abfd9ee4a791 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:07.575505 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85fc79-4057-4985-8a4e-01619e27a668 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.575802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85fc79-4057-4985-8a4e-01619e27a668 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.576059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85fc79-4057-4985-8a4e-01619e27a668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.598273 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-1e85fc79-4057-4985-8a4e-01619e27a668 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:07.599805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-1e85fc79-4057-4985-8a4e-01619e27a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:07.604721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7ea4d-b941-4804-8af4-51503f3457f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.605737 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7ea4d-b941-4804-8af4-51503f3457f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.606072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7ea4d-b941-4804-8af4-51503f3457f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.606411 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7ea4d-b941-4804-8af4-51503f3457f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.608384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e4a7ea4d-b941-4804-8af4-51503f3457f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:07.671359 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1377/2749] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:07.679511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32537c38-bb19-495a-bad4-ec6e917ab08d None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.679792 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32537c38-bb19-495a-bad4-ec6e917ab08d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.680062 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32537c38-bb19-495a-bad4-ec6e917ab08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.681942 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7ea4d-b941-4804-8af4-51503f3457f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.683757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7ea4d-b941-4804-8af4-51503f3457f3 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.695098 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1373/2750] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:07.700119 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-32537c38-bb19-495a-bad4-ec6e917ab08d None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:07.701491 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-32537c38-bb19-495a-bad4-ec6e917ab08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:07.710949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1378/2751] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:07.715847 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7ea4d-b941-4804-8af4-51503f3457f3 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.727834 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7ea4d-b941-4804-8af4-51503f3457f3 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.732608 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801c8e-c3ad-4f63-8b54-94ed747e4d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.733380 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801c8e-c3ad-4f63-8b54-94ed747e4d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.733654 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801c8e-c3ad-4f63-8b54-94ed747e4d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.733918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801c8e-c3ad-4f63-8b54-94ed747e4d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.734594 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46801c8e-c3ad-4f63-8b54-94ed747e4d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:07.734995 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46801c8e-c3ad-4f63-8b54-94ed747e4d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.736505 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46801c8e-c3ad-4f63-8b54-94ed747e4d46 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.768615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1374/2752] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:07.773424 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32537c38-bb19-495a-bad4-ec6e917ab08d None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.783247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32537c38-bb19-495a-bad4-ec6e917ab08d None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.788562 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a62fe-8ad2-4aed-bf2f-175e295f5e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.789169 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a62fe-8ad2-4aed-bf2f-175e295f5e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.789463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a62fe-8ad2-4aed-bf2f-175e295f5e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.789726 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a62fe-8ad2-4aed-bf2f-175e295f5e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.790354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a62fe-8ad2-4aed-bf2f-175e295f5e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.792288 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a62fe-8ad2-4aed-bf2f-175e295f5e77 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.795563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801c8e-c3ad-4f63-8b54-94ed747e4d46 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.797337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-46801c8e-c3ad-4f63-8b54-94ed747e4d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:07.812866 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801c8e-c3ad-4f63-8b54-94ed747e4d46 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.817392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06257c-f8bf-42d1-9280-cbeb0769080d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.818001 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06257c-f8bf-42d1-9280-cbeb0769080d service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.818279 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06257c-f8bf-42d1-9280-cbeb0769080d service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.818551 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06257c-f8bf-42d1-9280-cbeb0769080d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.820368 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-9e06257c-f8bf-42d1-9280-cbeb0769080d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:07.827045 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1379/2753] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:07 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:07.831948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a62fe-8ad2-4aed-bf2f-175e295f5e77 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.859347 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:07.899802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06257c-f8bf-42d1-9280-cbeb0769080d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.900721 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a62fe-8ad2-4aed-bf2f-175e295f5e77 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.902054 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06257c-f8bf-42d1-9280-cbeb0769080d service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.905534 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c825a-caed-4731-b567-61a54abefcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.906151 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c825a-caed-4731-b567-61a54abefcb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.906430 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c825a-caed-4731-b567-61a54abefcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.906706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c825a-caed-4731-b567-61a54abefcb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.907320 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c825a-caed-4731-b567-61a54abefcb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.909279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c825a-caed-4731-b567-61a54abefcb9 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.913318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1375/2754] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:07.944425 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1380/2755] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:07 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:07.944590 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06257c-f8bf-42d1-9280-cbeb0769080d service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.960031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06257c-f8bf-42d1-9280-cbeb0769080d service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.964867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3cf57-7cff-4b45-87d3-c3e3c5020524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.965709 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3cf57-7cff-4b45-87d3-c3e3c5020524 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.966175 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3cf57-7cff-4b45-87d3-c3e3c5020524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.966511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3cf57-7cff-4b45-87d3-c3e3c5020524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.967245 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3cf57-7cff-4b45-87d3-c3e3c5020524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.969030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3cf57-7cff-4b45-87d3-c3e3c5020524 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.981432 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1376/2756] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:07.984928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c825a-caed-4731-b567-61a54abefcb9 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:08.001573 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c825a-caed-4731-b567-61a54abefcb9 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:08.006824 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298fdb9-bcf9-403a-99c5-c956eb925cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:08.007499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298fdb9-bcf9-403a-99c5-c956eb925cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:08.007887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298fdb9-bcf9-403a-99c5-c956eb925cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:08.008249 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298fdb9-bcf9-403a-99c5-c956eb925cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:08.008963 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298fdb9-bcf9-403a-99c5-c956eb925cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:08.011279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298fdb9-bcf9-403a-99c5-c956eb925cf4 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:08.025246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1381/2757] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:08.027811 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3cf57-7cff-4b45-87d3-c3e3c5020524 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:08.040856 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3cf57-7cff-4b45-87d3-c3e3c5020524 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:08.050967 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132574e-19bc-4336-9037-fb9b43213580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:08.052300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132574e-19bc-4336-9037-fb9b43213580 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:08.052917 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132574e-19bc-4336-9037-fb9b43213580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:08.053365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132574e-19bc-4336-9037-fb9b43213580 admin admin] PATH_INFO: `/v3/projects/3b36fe54edb241f58cd1b46dc5dd6a8f/users/0e7c7fe134e14f629fcd0b4d6919a21d/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:08.072304 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:08.078674 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132574e-19bc-4336-9037-fb9b43213580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b36fe54edb241f58cd1b46dc5dd6a8f, user_id=0e7c7fe134e14f629fcd0b4d6919a21d, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:08.081458 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132574e-19bc-4336-9037-fb9b43213580 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:08.109827 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1377/2758] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:08 2022] PUT /identity/v3/projects/3b36fe54edb241f58cd1b46dc5dd6a8f/users/0e7c7fe134e14f629fcd0b4d6919a21d/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:08.122131 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefe7d7-c0cd-4d75-9cd8-34631f802f41 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:08.122422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefe7d7-c0cd-4d75-9cd8-34631f802f41 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:08.122715 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefe7d7-c0cd-4d75-9cd8-34631f802f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:08.155361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7eefe7d7-c0cd-4d75-9cd8-34631f802f41 None None] MFA Rules not processed for user `0e7c7fe134e14f629fcd0b4d6919a21d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:08.156585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7eefe7d7-c0cd-4d75-9cd8-34631f802f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:08.230260 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132574e-19bc-4336-9037-fb9b43213580 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:08.232080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-7132574e-19bc-4336-9037-fb9b43213580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:08.240555 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1382/2759] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:08.252266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefe7d7-c0cd-4d75-9cd8-34631f802f41 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:08.253686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7eefe7d7-c0cd-4d75-9cd8-34631f802f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:08.311486 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132574e-19bc-4336-9037-fb9b43213580 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:08.317297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:08.318117 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:08.318544 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:08.318941 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] PATH_INFO: `/v3/users/7fa58d449aaf41d69066d726bdca874d` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:08.320692 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa58d449aaf41d69066d726bdca874d)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:08.322696 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:08.329900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefe7d7-c0cd-4d75-9cd8-34631f802f41 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:08.334244 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157e060-5ac3-4cad-884d-313fb768802a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd967a3fa32ef48b68c9e3a174f0c9a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:08.335267 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157e060-5ac3-4cad-884d-313fb768802a service glance] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:08.335595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157e060-5ac3-4cad-884d-313fb768802a service glance] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:08.335862 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157e060-5ac3-4cad-884d-313fb768802a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:08.345804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157e060-5ac3-4cad-884d-313fb768802a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:08.347240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157e060-5ac3-4cad-884d-313fb768802a service glance] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:08.358069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1383/2760] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:08.376010 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa58d449aaf41d69066d726bdca874d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:08.388958 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa58d449aaf41d69066d726bdca874d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:08.389754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa58d449aaf41d69066d726bdca874d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:08.390452 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa58d449aaf41d69066d726bdca874d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:08.404130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa58d449aaf41d69066d726bdca874d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:08.418207 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1378/2761] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:08 2022] DELETE /identity/v3/users/7fa58d449aaf41d69066d726bdca874d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:08.422692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2e976-af8d-41d1-a880-19d9805f3e78 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:08.422982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2e976-af8d-41d1-a880-19d9805f3e78 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:08.423247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2e976-af8d-41d1-a880-19d9805f3e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:08.444018 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-73a2e976-af8d-41d1-a880-19d9805f3e78 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:08.445257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-73a2e976-af8d-41d1-a880-19d9805f3e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:08.475185 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:08.507882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1384/2762] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:08.518677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:08.520220 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:08.580871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61514c-7fc2-4c2f-9f92-5c24d9948d75 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:08.584547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7989f-d952-44e9-a5d8-f6487f9edbaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:08.585492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7989f-d952-44e9-a5d8-f6487f9edbaa service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:08.585779 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7989f-d952-44e9-a5d8-f6487f9edbaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:08.586333 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7989f-d952-44e9-a5d8-f6487f9edbaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:08.596848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7989f-d952-44e9-a5d8-f6487f9edbaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:08.598389 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7989f-d952-44e9-a5d8-f6487f9edbaa service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:08.608353 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1379/2763] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:08.916980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2e976-af8d-41d1-a880-19d9805f3e78 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:08.918563 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-73a2e976-af8d-41d1-a880-19d9805f3e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:08.930930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2e976-af8d-41d1-a880-19d9805f3e78 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:08.936667 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:08.937422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:08.937711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:08.937978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] PATH_INFO: `/v3/projects/96f512ffd5cd4fb4bfc62e1c4cd1053c` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:08.939162 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f512ffd5cd4fb4bfc62e1c4cd1053c)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:08.941073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:08.992058 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f512ffd5cd4fb4bfc62e1c4cd1053c', 'request_id': 'req-ce476395-d079-4b7f-a3a6-842de8d39c8d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.003546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f512ffd5cd4fb4bfc62e1c4cd1053c', 'request_id': 'req-ce476395-d079-4b7f-a3a6-842de8d39c8d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.012926 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f512ffd5cd4fb4bfc62e1c4cd1053c', 'request_id': 'req-ce476395-d079-4b7f-a3a6-842de8d39c8d'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.025711 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] The token cache is being invalidate because project 96f512ffd5cd4fb4bfc62e1c4cd1053c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:09.025976 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.027152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.028863 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1385/2764] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:08 2022] DELETE /identity/v3/projects/96f512ffd5cd4fb4bfc62e1c4cd1053c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:09.032963 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7989f-d952-44e9-a5d8-f6487f9edbaa service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:09.044249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7989f-d952-44e9-a5d8-f6487f9edbaa service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:09.052658 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:09.112217 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c8813-5c24-40af-91bb-33c5673b5584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:09.112881 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c8813-5c24-40af-91bb-33c5673b5584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:09.113151 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c8813-5c24-40af-91bb-33c5673b5584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:09.113447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c8813-5c24-40af-91bb-33c5673b5584 admin admin] PATH_INFO: `/v3/users/6edcf40cd9814ac78c13a5b4a4a72658` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:09.114542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c8813-5c24-40af-91bb-33c5673b5584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6edcf40cd9814ac78c13a5b4a4a72658)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:09.116444 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c8813-5c24-40af-91bb-33c5673b5584 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:09.170401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d95c8813-5c24-40af-91bb-33c5673b5584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6edcf40cd9814ac78c13a5b4a4a72658'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.191731 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d95c8813-5c24-40af-91bb-33c5673b5584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6edcf40cd9814ac78c13a5b4a4a72658'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.192517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d95c8813-5c24-40af-91bb-33c5673b5584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6edcf40cd9814ac78c13a5b4a4a72658'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.193134 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d95c8813-5c24-40af-91bb-33c5673b5584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6edcf40cd9814ac78c13a5b4a4a72658'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.207215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d95c8813-5c24-40af-91bb-33c5673b5584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6edcf40cd9814ac78c13a5b4a4a72658'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.224339 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1380/2765] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:09 2022] DELETE /identity/v3/users/6edcf40cd9814ac78c13a5b4a4a72658 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:09.558932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:09.560408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:09.574900 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce476395-d079-4b7f-a3a6-842de8d39c8d admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:09.641098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8938a-cd11-4f85-a065-4f6bb974a930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:09.641098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8938a-cd11-4f85-a065-4f6bb974a930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:09.641098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8938a-cd11-4f85-a065-4f6bb974a930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:09.641098 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8938a-cd11-4f85-a065-4f6bb974a930 admin admin] PATH_INFO: `/v3/projects/01d2b692b37f46c98eba7f30138a85d5` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:09.642514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8938a-cd11-4f85-a065-4f6bb974a930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d2b692b37f46c98eba7f30138a85d5)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:09.644879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8938a-cd11-4f85-a065-4f6bb974a930 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:09.701309 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-82f8938a-cd11-4f85-a065-4f6bb974a930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d2b692b37f46c98eba7f30138a85d5', 'request_id': 'req-82f8938a-cd11-4f85-a065-4f6bb974a930'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.712391 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-82f8938a-cd11-4f85-a065-4f6bb974a930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d2b692b37f46c98eba7f30138a85d5', 'request_id': 'req-82f8938a-cd11-4f85-a065-4f6bb974a930'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.714488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:09.720566 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-82f8938a-cd11-4f85-a065-4f6bb974a930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d2b692b37f46c98eba7f30138a85d5', 'request_id': 'req-82f8938a-cd11-4f85-a065-4f6bb974a930'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.733737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-82f8938a-cd11-4f85-a065-4f6bb974a930 admin admin] The token cache is being invalidate because project 01d2b692b37f46c98eba7f30138a85d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:09.734016 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-82f8938a-cd11-4f85-a065-4f6bb974a930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.734760 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-82f8938a-cd11-4f85-a065-4f6bb974a930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:09.736453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1386/2766] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:09 2022] DELETE /identity/v3/projects/01d2b692b37f46c98eba7f30138a85d5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:09.742345 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f5a26-a9ce-4443-aa69-d6a5f0592383 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:09.742619 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f5a26-a9ce-4443-aa69-d6a5f0592383 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:09.742897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f5a26-a9ce-4443-aa69-d6a5f0592383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:09.766148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-722f5a26-a9ce-4443-aa69-d6a5f0592383 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:09.767384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-722f5a26-a9ce-4443-aa69-d6a5f0592383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:09.833660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1381/2767] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:09.842216 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eb8e6-b3a1-4f38-b4b3-65b446bd56bd None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:09.842531 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eb8e6-b3a1-4f38-b4b3-65b446bd56bd None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:09.842759 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eb8e6-b3a1-4f38-b4b3-65b446bd56bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:09.865544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-680eb8e6-b3a1-4f38-b4b3-65b446bd56bd None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:09.866785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-680eb8e6-b3a1-4f38-b4b3-65b446bd56bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:09.876408 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1387/2768] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:09.880777 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f5a26-a9ce-4443-aa69-d6a5f0592383 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:09.891578 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f5a26-a9ce-4443-aa69-d6a5f0592383 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:09.896484 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a145e84-02b8-494b-8609-2eb0d02248cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:09.897126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145e84-02b8-494b-8609-2eb0d02248cb admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:09.897430 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145e84-02b8-494b-8609-2eb0d02248cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:09.897695 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145e84-02b8-494b-8609-2eb0d02248cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:09.898347 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a145e84-02b8-494b-8609-2eb0d02248cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:09.898660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a145e84-02b8-494b-8609-2eb0d02248cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:09.900518 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a145e84-02b8-494b-8609-2eb0d02248cb admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:09.912699 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1382/2769] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:09.917807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eb8e6-b3a1-4f38-b4b3-65b446bd56bd None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:09.927212 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eb8e6-b3a1-4f38-b4b3-65b446bd56bd None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:09.932413 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f22d-0860-4a38-b5cd-248394c1a2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:09.933099 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f22d-0860-4a38-b5cd-248394c1a2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:09.933532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f22d-0860-4a38-b5cd-248394c1a2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:09.933804 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f22d-0860-4a38-b5cd-248394c1a2e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:09.934438 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f22d-0860-4a38-b5cd-248394c1a2e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:09.936563 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f22d-0860-4a38-b5cd-248394c1a2e0 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:09.967495 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1388/2770] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:09 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:09.972524 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a145e84-02b8-494b-8609-2eb0d02248cb admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:09.987114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a145e84-02b8-494b-8609-2eb0d02248cb admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:10.003180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:10.053582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e057ea-c6e4-4a3e-bed5-7ce285570e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:10.054367 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e057ea-c6e4-4a3e-bed5-7ce285570e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:10.054485 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e057ea-c6e4-4a3e-bed5-7ce285570e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:10.054800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e057ea-c6e4-4a3e-bed5-7ce285570e47 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:10.055466 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e057ea-c6e4-4a3e-bed5-7ce285570e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:10.057863 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e057ea-c6e4-4a3e-bed5-7ce285570e47 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:10.083697 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1383/2771] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:09 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:10.087856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f22d-0860-4a38-b5cd-248394c1a2e0 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:10.104791 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f22d-0860-4a38-b5cd-248394c1a2e0 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:10.109798 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea779cc8-4170-4856-a7c8-70af8d97c453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:10.110415 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea779cc8-4170-4856-a7c8-70af8d97c453 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:10.110687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea779cc8-4170-4856-a7c8-70af8d97c453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:10.110980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea779cc8-4170-4856-a7c8-70af8d97c453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:10.111632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea779cc8-4170-4856-a7c8-70af8d97c453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:10.113233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea779cc8-4170-4856-a7c8-70af8d97c453 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:10.124883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1389/2772] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:10.129110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e057ea-c6e4-4a3e-bed5-7ce285570e47 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:10.139672 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e057ea-c6e4-4a3e-bed5-7ce285570e47 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:10.145078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff068c-b1d1-4718-b152-598085e8c455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:10.145662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff068c-b1d1-4718-b152-598085e8c455 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:10.145935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff068c-b1d1-4718-b152-598085e8c455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:10.146204 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff068c-b1d1-4718-b152-598085e8c455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:10.146855 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff068c-b1d1-4718-b152-598085e8c455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:10.148461 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff068c-b1d1-4718-b152-598085e8c455 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:10.159835 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1384/2773] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:10.164421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea779cc8-4170-4856-a7c8-70af8d97c453 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:10.174882 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea779cc8-4170-4856-a7c8-70af8d97c453 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:10.185348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d4e49-b405-4e77-a867-5b148f77bfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:10.185999 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d4e49-b405-4e77-a867-5b148f77bfc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:10.186290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d4e49-b405-4e77-a867-5b148f77bfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:10.186561 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d4e49-b405-4e77-a867-5b148f77bfc7 admin admin] PATH_INFO: `/v3/projects/80e85bb6766f42c2ad97893179695dcd/users/8168d064dd604f38b7aa3eff66d28a83/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:10.206757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d4e49-b405-4e77-a867-5b148f77bfc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e85bb6766f42c2ad97893179695dcd, user_id=8168d064dd604f38b7aa3eff66d28a83, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:10.209497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d4e49-b405-4e77-a867-5b148f77bfc7 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:10.225497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1390/2774] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:10 2022] PUT /identity/v3/projects/80e85bb6766f42c2ad97893179695dcd/users/8168d064dd604f38b7aa3eff66d28a83/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:10.238209 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e2e2d-2023-4e5c-9ab5-d8c0fad32486 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:10.238571 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e2e2d-2023-4e5c-9ab5-d8c0fad32486 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:10.238912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e2e2d-2023-4e5c-9ab5-d8c0fad32486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:10.267711 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-4d7e2e2d-2023-4e5c-9ab5-d8c0fad32486 None None] MFA Rules not processed for user `8168d064dd604f38b7aa3eff66d28a83`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:10.269357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4d7e2e2d-2023-4e5c-9ab5-d8c0fad32486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:10.341282 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1385/2775] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:10.354233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d4e49-b405-4e77-a867-5b148f77bfc7 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:10.356773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-855d4e49-b405-4e77-a867-5b148f77bfc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:10.428577 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d4e49-b405-4e77-a867-5b148f77bfc7 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:10.432441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f3eb7-c469-4728-8402-d694d91461c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:10.433489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f3eb7-c469-4728-8402-d694d91461c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:10.433814 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f3eb7-c469-4728-8402-d694d91461c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:10.434077 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f3eb7-c469-4728-8402-d694d91461c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:10.444091 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f3eb7-c469-4728-8402-d694d91461c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:10.445677 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f3eb7-c469-4728-8402-d694d91461c9 service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:10.455676 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1391/2776] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:11.503971 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e2e2d-2023-4e5c-9ab5-d8c0fad32486 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:11.505653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-4d7e2e2d-2023-4e5c-9ab5-d8c0fad32486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:11.575467 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e2e2d-2023-4e5c-9ab5-d8c0fad32486 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:11.580238 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:11.580878 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:11.581146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:11.581442 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] PATH_INFO: `/v3/users/283514ae49b5405ca5535af223a052ba` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:11.582583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=283514ae49b5405ca5535af223a052ba)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:11.584519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:11.619843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:11.640111 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283514ae49b5405ca5535af223a052ba'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:11.652882 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283514ae49b5405ca5535af223a052ba'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:11.653650 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283514ae49b5405ca5535af223a052ba'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:11.654301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283514ae49b5405ca5535af223a052ba'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:11.664103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283514ae49b5405ca5535af223a052ba'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:11.678627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1386/2777] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:11 2022] DELETE /identity/v3/users/283514ae49b5405ca5535af223a052ba => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:11.683287 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff31c-1771-490b-88fc-76418ac3059b None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:11.683939 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff31c-1771-490b-88fc-76418ac3059b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:11.684047 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff31c-1771-490b-88fc-76418ac3059b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:11.704689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c85ff31c-1771-490b-88fc-76418ac3059b None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:11.705995 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c85ff31c-1771-490b-88fc-76418ac3059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:11.768253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1392/2778] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:11.779300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:11.780868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:11.990640 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621db78f-71eb-4518-8338-ab1e97e7d3f6 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:11.994538 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19332288-49bf-4ce8-93bb-ebf45e81bb7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:11.995158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19332288-49bf-4ce8-93bb-ebf45e81bb7a service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:11.995433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19332288-49bf-4ce8-93bb-ebf45e81bb7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:11.995729 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19332288-49bf-4ce8-93bb-ebf45e81bb7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.005832 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19332288-49bf-4ce8-93bb-ebf45e81bb7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.011494 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19332288-49bf-4ce8-93bb-ebf45e81bb7a service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.019197 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1387/2779] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:12.333783 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ff31c-1771-490b-88fc-76418ac3059b None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:12.335648 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c85ff31c-1771-490b-88fc-76418ac3059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:12.349223 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ff31c-1771-490b-88fc-76418ac3059b None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:12.354230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1970e-14e6-4c03-8801-b231e97d3721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:12.355104 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1970e-14e6-4c03-8801-b231e97d3721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.355557 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1970e-14e6-4c03-8801-b231e97d3721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.355840 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1970e-14e6-4c03-8801-b231e97d3721 admin admin] PATH_INFO: `/v3/projects/89044324f286422b876284305f605a6a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.357049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1970e-14e6-4c03-8801-b231e97d3721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89044324f286422b876284305f605a6a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.360008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1970e-14e6-4c03-8801-b231e97d3721 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.385750 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:12.420975 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8f1970e-14e6-4c03-8801-b231e97d3721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89044324f286422b876284305f605a6a', 'request_id': 'req-b8f1970e-14e6-4c03-8801-b231e97d3721'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:12.430909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8f1970e-14e6-4c03-8801-b231e97d3721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89044324f286422b876284305f605a6a', 'request_id': 'req-b8f1970e-14e6-4c03-8801-b231e97d3721'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:12.437801 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8f1970e-14e6-4c03-8801-b231e97d3721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89044324f286422b876284305f605a6a', 'request_id': 'req-b8f1970e-14e6-4c03-8801-b231e97d3721'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:12.452807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8f1970e-14e6-4c03-8801-b231e97d3721 admin admin] The token cache is being invalidate because project 89044324f286422b876284305f605a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:12.453095 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8f1970e-14e6-4c03-8801-b231e97d3721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:12.453979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-b8f1970e-14e6-4c03-8801-b231e97d3721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:12.455462 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1393/2780] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:12 2022] DELETE /identity/v3/projects/89044324f286422b876284305f605a6a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:12.460489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a23e57-9404-4ca7-88c9-8fc3f7b5621e None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.460767 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a23e57-9404-4ca7-88c9-8fc3f7b5621e None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.461059 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a23e57-9404-4ca7-88c9-8fc3f7b5621e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.489703 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-64a23e57-9404-4ca7-88c9-8fc3f7b5621e None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:12.490919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-64a23e57-9404-4ca7-88c9-8fc3f7b5621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:12.565085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1388/2781] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:12.566753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74a7f9-4c92-443d-9eee-1a6d4c9bae28 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.567092 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74a7f9-4c92-443d-9eee-1a6d4c9bae28 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.567550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74a7f9-4c92-443d-9eee-1a6d4c9bae28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.599552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-fe74a7f9-4c92-443d-9eee-1a6d4c9bae28 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:12.601297 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-fe74a7f9-4c92-443d-9eee-1a6d4c9bae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:12.609712 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1394/2782] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:12.615335 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a23e57-9404-4ca7-88c9-8fc3f7b5621e None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:12.625110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a23e57-9404-4ca7-88c9-8fc3f7b5621e None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:12.629899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31116d06-3d52-4674-8cc4-0223d8d00642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:12.630495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31116d06-3d52-4674-8cc4-0223d8d00642 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.630770 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31116d06-3d52-4674-8cc4-0223d8d00642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.631065 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31116d06-3d52-4674-8cc4-0223d8d00642 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.631714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31116d06-3d52-4674-8cc4-0223d8d00642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:12.632013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31116d06-3d52-4674-8cc4-0223d8d00642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.633645 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31116d06-3d52-4674-8cc4-0223d8d00642 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.646567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1389/2783] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:12.651113 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74a7f9-4c92-443d-9eee-1a6d4c9bae28 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:12.661109 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74a7f9-4c92-443d-9eee-1a6d4c9bae28 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:12.666443 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fc573-2a35-486e-aff7-1fad153ce26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:12.667042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fc573-2a35-486e-aff7-1fad153ce26e admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.667361 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fc573-2a35-486e-aff7-1fad153ce26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.667701 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fc573-2a35-486e-aff7-1fad153ce26e admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.668535 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fc573-2a35-486e-aff7-1fad153ce26e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.670453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fc573-2a35-486e-aff7-1fad153ce26e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.703550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1395/2784] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:12 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:12.708276 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31116d06-3d52-4674-8cc4-0223d8d00642 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:12.719367 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31116d06-3d52-4674-8cc4-0223d8d00642 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:12.754066 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:12.782616 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef3400-de3b-4cfc-9659-0779e3759120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:12.783300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3400-de3b-4cfc-9659-0779e3759120 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.783459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3400-de3b-4cfc-9659-0779e3759120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.783750 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3400-de3b-4cfc-9659-0779e3759120 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.784391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef3400-de3b-4cfc-9659-0779e3759120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.786350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef3400-de3b-4cfc-9659-0779e3759120 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.810712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1390/2785] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:12 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:12.815145 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fc573-2a35-486e-aff7-1fad153ce26e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:12.840954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fc573-2a35-486e-aff7-1fad153ce26e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:12.846399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92794bd6-a3b2-46b1-a5a6-aaf19a1c0b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:12.847137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92794bd6-a3b2-46b1-a5a6-aaf19a1c0b52 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.847454 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92794bd6-a3b2-46b1-a5a6-aaf19a1c0b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.847756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92794bd6-a3b2-46b1-a5a6-aaf19a1c0b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.848527 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92794bd6-a3b2-46b1-a5a6-aaf19a1c0b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.850454 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92794bd6-a3b2-46b1-a5a6-aaf19a1c0b52 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.862826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1396/2786] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:12.867365 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef3400-de3b-4cfc-9659-0779e3759120 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:12.878694 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef3400-de3b-4cfc-9659-0779e3759120 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:12.884146 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a792eb-5b55-49d1-8575-ed3aa8b64b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:12.884742 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a792eb-5b55-49d1-8575-ed3aa8b64b83 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.885008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a792eb-5b55-49d1-8575-ed3aa8b64b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.885310 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a792eb-5b55-49d1-8575-ed3aa8b64b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.886011 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a792eb-5b55-49d1-8575-ed3aa8b64b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.888977 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a792eb-5b55-49d1-8575-ed3aa8b64b83 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.901231 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1391/2787] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:12.905890 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92794bd6-a3b2-46b1-a5a6-aaf19a1c0b52 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:12.917528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92794bd6-a3b2-46b1-a5a6-aaf19a1c0b52 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:12.922489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344de87-187d-4905-ae17-e16301af5282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:12.923148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344de87-187d-4905-ae17-e16301af5282 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.923422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344de87-187d-4905-ae17-e16301af5282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.923691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344de87-187d-4905-ae17-e16301af5282 admin admin] PATH_INFO: `/v3/projects/7b91fdab76664a79a95a6b37ac134896/users/9b1dea04f31a4f2eb91741cbf0a00d32/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.940702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344de87-187d-4905-ae17-e16301af5282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b91fdab76664a79a95a6b37ac134896, user_id=9b1dea04f31a4f2eb91741cbf0a00d32, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.943399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344de87-187d-4905-ae17-e16301af5282 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.960493 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1397/2788] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:12 2022] PUT /identity/v3/projects/7b91fdab76664a79a95a6b37ac134896/users/9b1dea04f31a4f2eb91741cbf0a00d32/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:12.972176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65ff4-3443-40a3-b129-da00fef8faae None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.972664 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65ff4-3443-40a3-b129-da00fef8faae None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.972992 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65ff4-3443-40a3-b129-da00fef8faae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:13.011351 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-fee65ff4-3443-40a3-b129-da00fef8faae None None] MFA Rules not processed for user `9b1dea04f31a4f2eb91741cbf0a00d32`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:13.012584 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-fee65ff4-3443-40a3-b129-da00fef8faae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:13.092188 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1392/2789] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:13.096947 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344de87-187d-4905-ae17-e16301af5282 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:13.171774 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344de87-187d-4905-ae17-e16301af5282 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:13.178248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b2186-0972-46a5-bb03-d60b97a0c88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:13.179164 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b2186-0972-46a5-bb03-d60b97a0c88d admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:13.179524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b2186-0972-46a5-bb03-d60b97a0c88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:13.179840 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b2186-0972-46a5-bb03-d60b97a0c88d admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:13.180708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b2186-0972-46a5-bb03-d60b97a0c88d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:13.183302 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b2186-0972-46a5-bb03-d60b97a0c88d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:13.229533 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1398/2790] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:13 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:13.233856 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee65ff4-3443-40a3-b129-da00fef8faae None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:13.246563 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee65ff4-3443-40a3-b129-da00fef8faae None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:13.332542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21b3de-08ff-42e1-8ce1-2fadbb4b06af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:13.333459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21b3de-08ff-42e1-8ce1-2fadbb4b06af admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:13.335033 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21b3de-08ff-42e1-8ce1-2fadbb4b06af admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:13.335307 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21b3de-08ff-42e1-8ce1-2fadbb4b06af admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:13.335953 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21b3de-08ff-42e1-8ce1-2fadbb4b06af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:13.337898 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21b3de-08ff-42e1-8ce1-2fadbb4b06af admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:13.369938 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1393/2791] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:13 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:13.374096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b2186-0972-46a5-bb03-d60b97a0c88d admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:13.392316 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b2186-0972-46a5-bb03-d60b97a0c88d admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:13.399523 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2765ea3-3476-43df-9216-bd144d6a87f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:13.400158 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2765ea3-3476-43df-9216-bd144d6a87f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:13.400391 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2765ea3-3476-43df-9216-bd144d6a87f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:13.400693 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2765ea3-3476-43df-9216-bd144d6a87f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:13.401373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2765ea3-3476-43df-9216-bd144d6a87f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:13.403377 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2765ea3-3476-43df-9216-bd144d6a87f1 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:13.418028 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1399/2792] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:13.424008 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21b3de-08ff-42e1-8ce1-2fadbb4b06af admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:13.435628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21b3de-08ff-42e1-8ce1-2fadbb4b06af admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:13.441354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8717378-bb1d-4c13-b3fe-8f03d4bf713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:13.442040 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8717378-bb1d-4c13-b3fe-8f03d4bf713c admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:13.442309 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8717378-bb1d-4c13-b3fe-8f03d4bf713c admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:13.442580 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8717378-bb1d-4c13-b3fe-8f03d4bf713c admin admin] PATH_INFO: `/v3/projects/d29f61bb484b4b3b83af1dc1f502f0cb/users/63edc5f415d147eca0c13184f25a8d50/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:13.459858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8717378-bb1d-4c13-b3fe-8f03d4bf713c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29f61bb484b4b3b83af1dc1f502f0cb, user_id=63edc5f415d147eca0c13184f25a8d50, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:13.462556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8717378-bb1d-4c13-b3fe-8f03d4bf713c admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:13.480944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1394/2793] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:13 2022] PUT /identity/v3/projects/d29f61bb484b4b3b83af1dc1f502f0cb/users/63edc5f415d147eca0c13184f25a8d50/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:13.485707 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2765ea3-3476-43df-9216-bd144d6a87f1 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:13.497623 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2765ea3-3476-43df-9216-bd144d6a87f1 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:13.517777 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:13.581789 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8220e0-a98f-4e72-bd04-92c43132269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:13.587528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8220e0-a98f-4e72-bd04-92c43132269f admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:13.587781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8220e0-a98f-4e72-bd04-92c43132269f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:13.588038 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8220e0-a98f-4e72-bd04-92c43132269f admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:13.588708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8220e0-a98f-4e72-bd04-92c43132269f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:13.590595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8220e0-a98f-4e72-bd04-92c43132269f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:13.602268 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1400/2794] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:13.608324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8717378-bb1d-4c13-b3fe-8f03d4bf713c admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:13.621063 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8220e0-a98f-4e72-bd04-92c43132269f admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:13.623532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-be8220e0-a98f-4e72-bd04-92c43132269f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:13.626877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8717378-bb1d-4c13-b3fe-8f03d4bf713c admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:13.631854 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce8369-3646-401a-a808-8e2991094de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:13.632686 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce8369-3646-401a-a808-8e2991094de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:13.633021 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce8369-3646-401a-a808-8e2991094de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:13.633372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce8369-3646-401a-a808-8e2991094de9 admin admin] PATH_INFO: `/v3/projects/d29f61bb484b4b3b83af1dc1f502f0cb/users/63edc5f415d147eca0c13184f25a8d50/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:13.635353 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce8369-3646-401a-a808-8e2991094de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29f61bb484b4b3b83af1dc1f502f0cb, user_id=63edc5f415d147eca0c13184f25a8d50, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:13.637461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8220e0-a98f-4e72-bd04-92c43132269f admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:13.638027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce8369-3646-401a-a808-8e2991094de9 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:13.642127 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:13.642962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914263c-7ba2-456c-b321-9e52d7815c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:13.644227 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914263c-7ba2-456c-b321-9e52d7815c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:13.644531 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914263c-7ba2-456c-b321-9e52d7815c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:13.644852 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914263c-7ba2-456c-b321-9e52d7815c2a admin admin] PATH_INFO: `/v3/users/8168d064dd604f38b7aa3eff66d28a83` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:13.646403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914263c-7ba2-456c-b321-9e52d7815c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8168d064dd604f38b7aa3eff66d28a83)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:13.648528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914263c-7ba2-456c-b321-9e52d7815c2a admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:13.654215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1395/2795] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:13 2022] PUT /identity/v3/projects/d29f61bb484b4b3b83af1dc1f502f0cb/users/63edc5f415d147eca0c13184f25a8d50/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:13.666423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78753516-7794-41e8-9ff8-68f3831558b7 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:13.666892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78753516-7794-41e8-9ff8-68f3831558b7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:13.667181 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78753516-7794-41e8-9ff8-68f3831558b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:13.707360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-78753516-7794-41e8-9ff8-68f3831558b7 None None] MFA Rules not processed for user `63edc5f415d147eca0c13184f25a8d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:13.710671 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-78753516-7794-41e8-9ff8-68f3831558b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:13.722457 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9914263c-7ba2-456c-b321-9e52d7815c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8168d064dd604f38b7aa3eff66d28a83'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:13.732469 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9914263c-7ba2-456c-b321-9e52d7815c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8168d064dd604f38b7aa3eff66d28a83'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:13.733268 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9914263c-7ba2-456c-b321-9e52d7815c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8168d064dd604f38b7aa3eff66d28a83'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:13.747498 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9914263c-7ba2-456c-b321-9e52d7815c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8168d064dd604f38b7aa3eff66d28a83'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:13.762122 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9914263c-7ba2-456c-b321-9e52d7815c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8168d064dd604f38b7aa3eff66d28a83'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:13.768921 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1401/2796] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:13 2022] DELETE /identity/v3/users/8168d064dd604f38b7aa3eff66d28a83 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:13.773616 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375e4d8-4a9c-4caa-984d-04ef795f9bb7 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:13.773874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375e4d8-4a9c-4caa-984d-04ef795f9bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:13.774152 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375e4d8-4a9c-4caa-984d-04ef795f9bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:13.793112 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1396/2797] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:13.798801 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c375e4d8-4a9c-4caa-984d-04ef795f9bb7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:13.799993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c375e4d8-4a9c-4caa-984d-04ef795f9bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:13.804932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78753516-7794-41e8-9ff8-68f3831558b7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:13.807069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-78753516-7794-41e8-9ff8-68f3831558b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:13.871369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1402/2798] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:13.876641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78753516-7794-41e8-9ff8-68f3831558b7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:13.882979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375e4d8-4a9c-4caa-984d-04ef795f9bb7 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:13.884856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c375e4d8-4a9c-4caa-984d-04ef795f9bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:13.922074 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:13.950075 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b4922-eb48-42d6-8a05-772295aba2c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:13.950715 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b4922-eb48-42d6-8a05-772295aba2c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:13.950988 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b4922-eb48-42d6-8a05-772295aba2c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:13.952225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b4922-eb48-42d6-8a05-772295aba2c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:13.955639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375e4d8-4a9c-4caa-984d-04ef795f9bb7 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:13.960195 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773f7aa-c4bf-40e7-806a-642608a4b976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:13.960813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773f7aa-c4bf-40e7-806a-642608a4b976 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:13.961086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773f7aa-c4bf-40e7-806a-642608a4b976 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:13.961383 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773f7aa-c4bf-40e7-806a-642608a4b976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:13.973232 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773f7aa-c4bf-40e7-806a-642608a4b976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:13.974817 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773f7aa-c4bf-40e7-806a-642608a4b976 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:13.986238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1403/2799] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:14.015172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:14.030142 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b4922-eb48-42d6-8a05-772295aba2c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:14.031367 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b4922-eb48-42d6-8a05-772295aba2c6 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:14.044465 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1397/2800] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:14.333880 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773f7aa-c4bf-40e7-806a-642608a4b976 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:14.335414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a773f7aa-c4bf-40e7-806a-642608a4b976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:14.351919 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773f7aa-c4bf-40e7-806a-642608a4b976 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:14.357558 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9914c7-c27d-4102-92de-66284daee732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:14.358737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9914c7-c27d-4102-92de-66284daee732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:14.358737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9914c7-c27d-4102-92de-66284daee732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:14.358737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9914c7-c27d-4102-92de-66284daee732 admin admin] PATH_INFO: `/v3/projects/80e85bb6766f42c2ad97893179695dcd` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:14.360086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9914c7-c27d-4102-92de-66284daee732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e85bb6766f42c2ad97893179695dcd)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:14.362335 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9914c7-c27d-4102-92de-66284daee732 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:14.422850 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2d9914c7-c27d-4102-92de-66284daee732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e85bb6766f42c2ad97893179695dcd', 'request_id': 'req-2d9914c7-c27d-4102-92de-66284daee732'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.434064 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2d9914c7-c27d-4102-92de-66284daee732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e85bb6766f42c2ad97893179695dcd', 'request_id': 'req-2d9914c7-c27d-4102-92de-66284daee732'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.442042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2d9914c7-c27d-4102-92de-66284daee732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e85bb6766f42c2ad97893179695dcd', 'request_id': 'req-2d9914c7-c27d-4102-92de-66284daee732'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.457056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2d9914c7-c27d-4102-92de-66284daee732 admin admin] The token cache is being invalidate because project 80e85bb6766f42c2ad97893179695dcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:14.457410 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2d9914c7-c27d-4102-92de-66284daee732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.458150 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-2d9914c7-c27d-4102-92de-66284daee732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.459737 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1404/2801] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:14 2022] DELETE /identity/v3/projects/80e85bb6766f42c2ad97893179695dcd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:14.554013 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b4922-eb48-42d6-8a05-772295aba2c6 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:14.554730 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-9f9b4922-eb48-42d6-8a05-772295aba2c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:14.571301 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b4922-eb48-42d6-8a05-772295aba2c6 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:14.649798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:14.650503 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:14.650662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:14.650942 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] PATH_INFO: `/v3/users/9b1dea04f31a4f2eb91741cbf0a00d32` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:14.652250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1dea04f31a4f2eb91741cbf0a00d32)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:14.654585 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:14.721778 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1dea04f31a4f2eb91741cbf0a00d32'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.737773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1dea04f31a4f2eb91741cbf0a00d32'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.738554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1dea04f31a4f2eb91741cbf0a00d32'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.739201 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1dea04f31a4f2eb91741cbf0a00d32'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.748893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1dea04f31a4f2eb91741cbf0a00d32'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.766349 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1398/2802] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:14 2022] DELETE /identity/v3/users/9b1dea04f31a4f2eb91741cbf0a00d32 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:14.771801 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70872351-8197-4b46-aed0-9813a481aaa1 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:14.772353 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70872351-8197-4b46-aed0-9813a481aaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:14.772674 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70872351-8197-4b46-aed0-9813a481aaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:14.794875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-70872351-8197-4b46-aed0-9813a481aaa1 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:14.796231 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-70872351-8197-4b46-aed0-9813a481aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:14.860071 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1405/2803] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:14.870258 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:14.871850 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:14.940355 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cb95c-12f6-4f1a-829c-37403710fd74 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:14.944507 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90888d8-0974-4965-9760-3fd4a68c37a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:14.945119 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90888d8-0974-4965-9760-3fd4a68c37a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:14.945424 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90888d8-0974-4965-9760-3fd4a68c37a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:14.945660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90888d8-0974-4965-9760-3fd4a68c37a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:14.958128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90888d8-0974-4965-9760-3fd4a68c37a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:14.959992 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90888d8-0974-4965-9760-3fd4a68c37a0 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:14.971110 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1399/2804] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:15.300122 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70872351-8197-4b46-aed0-9813a481aaa1 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:15.301761 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-70872351-8197-4b46-aed0-9813a481aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:15.314608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70872351-8197-4b46-aed0-9813a481aaa1 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:15.324839 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:15.325546 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:15.325815 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:15.326060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] PATH_INFO: `/v3/projects/7b91fdab76664a79a95a6b37ac134896` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:15.327311 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b91fdab76664a79a95a6b37ac134896)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:15.329234 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:15.384236 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b91fdab76664a79a95a6b37ac134896', 'request_id': 'req-9ec483e1-bfd3-463c-85fc-b076568d1d31'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.386174 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:15.397052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b91fdab76664a79a95a6b37ac134896', 'request_id': 'req-9ec483e1-bfd3-463c-85fc-b076568d1d31'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.406706 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b91fdab76664a79a95a6b37ac134896', 'request_id': 'req-9ec483e1-bfd3-463c-85fc-b076568d1d31'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.420973 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] The token cache is being invalidate because project 7b91fdab76664a79a95a6b37ac134896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:15.421253 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.422008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.423689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1406/2805] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:15 2022] DELETE /identity/v3/projects/7b91fdab76664a79a95a6b37ac134896 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:15.429879 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90888d8-0974-4965-9760-3fd4a68c37a0 service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:15.440502 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90888d8-0974-4965-9760-3fd4a68c37a0 service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:15.445822 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:15.512135 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c21c8e-3172-46cb-b334-6f2d932a2409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:15.512758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c21c8e-3172-46cb-b334-6f2d932a2409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:15.513032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c21c8e-3172-46cb-b334-6f2d932a2409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:15.513353 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c21c8e-3172-46cb-b334-6f2d932a2409 admin admin] PATH_INFO: `/v3/users/63edc5f415d147eca0c13184f25a8d50` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:15.514569 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c21c8e-3172-46cb-b334-6f2d932a2409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63edc5f415d147eca0c13184f25a8d50)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:15.516513 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c21c8e-3172-46cb-b334-6f2d932a2409 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:15.573055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-14c21c8e-3172-46cb-b334-6f2d932a2409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63edc5f415d147eca0c13184f25a8d50'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.587071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-14c21c8e-3172-46cb-b334-6f2d932a2409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63edc5f415d147eca0c13184f25a8d50'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.587897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-14c21c8e-3172-46cb-b334-6f2d932a2409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63edc5f415d147eca0c13184f25a8d50'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.588531 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-14c21c8e-3172-46cb-b334-6f2d932a2409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63edc5f415d147eca0c13184f25a8d50'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.598191 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-14c21c8e-3172-46cb-b334-6f2d932a2409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63edc5f415d147eca0c13184f25a8d50'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.611511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1400/2806] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:15 2022] DELETE /identity/v3/users/63edc5f415d147eca0c13184f25a8d50 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:15.915975 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:15.917433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:15.936379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec483e1-bfd3-463c-85fc-b076568d1d31 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:15.995403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0169d-f806-4a92-a106-ff2419ff5ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:15.996480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0169d-f806-4a92-a106-ff2419ff5ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:15.996866 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0169d-f806-4a92-a106-ff2419ff5ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:15.997143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0169d-f806-4a92-a106-ff2419ff5ebd admin admin] PATH_INFO: `/v3/projects/d29f61bb484b4b3b83af1dc1f502f0cb` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:15.998442 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0169d-f806-4a92-a106-ff2419ff5ebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29f61bb484b4b3b83af1dc1f502f0cb)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.000369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0169d-f806-4a92-a106-ff2419ff5ebd admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.059974 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6ef0169d-f806-4a92-a106-ff2419ff5ebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29f61bb484b4b3b83af1dc1f502f0cb', 'request_id': 'req-6ef0169d-f806-4a92-a106-ff2419ff5ebd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:16.072187 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6ef0169d-f806-4a92-a106-ff2419ff5ebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29f61bb484b4b3b83af1dc1f502f0cb', 'request_id': 'req-6ef0169d-f806-4a92-a106-ff2419ff5ebd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:16.079490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6ef0169d-f806-4a92-a106-ff2419ff5ebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29f61bb484b4b3b83af1dc1f502f0cb', 'request_id': 'req-6ef0169d-f806-4a92-a106-ff2419ff5ebd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:16.091472 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6ef0169d-f806-4a92-a106-ff2419ff5ebd admin admin] The token cache is being invalidate because project d29f61bb484b4b3b83af1dc1f502f0cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:16.091926 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6ef0169d-f806-4a92-a106-ff2419ff5ebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:16.092991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-6ef0169d-f806-4a92-a106-ff2419ff5ebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:16.094632 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1407/2807] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:15 2022] DELETE /identity/v3/projects/d29f61bb484b4b3b83af1dc1f502f0cb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:16.099761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94096e-d0fe-49e7-a04b-fbd43e9f7f81 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.100244 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94096e-d0fe-49e7-a04b-fbd43e9f7f81 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.100350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94096e-d0fe-49e7-a04b-fbd43e9f7f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.126126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-8a94096e-d0fe-49e7-a04b-fbd43e9f7f81 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:16.127406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8a94096e-d0fe-49e7-a04b-fbd43e9f7f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:16.193372 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1401/2808] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:16.201248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5f089-6f48-4849-8724-2f303c54d501 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.201636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5f089-6f48-4849-8724-2f303c54d501 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.202002 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5f089-6f48-4849-8724-2f303c54d501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.224414 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-caf5f089-6f48-4849-8724-2f303c54d501 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:16.225675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-caf5f089-6f48-4849-8724-2f303c54d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:16.242078 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1408/2809] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:16.247050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94096e-d0fe-49e7-a04b-fbd43e9f7f81 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.257228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94096e-d0fe-49e7-a04b-fbd43e9f7f81 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.263140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d2342-ce0b-4bbc-bd5a-c3e5d7b94ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.263745 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2342-ce0b-4bbc-bd5a-c3e5d7b94ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.264018 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2342-ce0b-4bbc-bd5a-c3e5d7b94ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.264286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2342-ce0b-4bbc-bd5a-c3e5d7b94ba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.264944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d2342-ce0b-4bbc-bd5a-c3e5d7b94ba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:16.265282 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d2342-ce0b-4bbc-bd5a-c3e5d7b94ba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.266893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d2342-ce0b-4bbc-bd5a-c3e5d7b94ba1 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.279495 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1402/2810] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:16.284678 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5f089-6f48-4849-8724-2f303c54d501 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.294705 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5f089-6f48-4849-8724-2f303c54d501 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.299953 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58884169-266c-4cae-9888-99bc03f43b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.300652 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58884169-266c-4cae-9888-99bc03f43b62 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.301096 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58884169-266c-4cae-9888-99bc03f43b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.301594 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58884169-266c-4cae-9888-99bc03f43b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.302649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58884169-266c-4cae-9888-99bc03f43b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.305968 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58884169-266c-4cae-9888-99bc03f43b62 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.346052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1409/2811] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:16.350708 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d2342-ce0b-4bbc-bd5a-c3e5d7b94ba1 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.363887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d2342-ce0b-4bbc-bd5a-c3e5d7b94ba1 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.378189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:16.428867 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fc6bd-0e1a-4c44-a06f-8968e511c42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.429550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fc6bd-0e1a-4c44-a06f-8968e511c42f admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.429823 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fc6bd-0e1a-4c44-a06f-8968e511c42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.430097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fc6bd-0e1a-4c44-a06f-8968e511c42f admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.430751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fc6bd-0e1a-4c44-a06f-8968e511c42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.432744 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fc6bd-0e1a-4c44-a06f-8968e511c42f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.456541 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1403/2812] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:16.460863 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58884169-266c-4cae-9888-99bc03f43b62 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.472308 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58884169-266c-4cae-9888-99bc03f43b62 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.477144 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca55e9-e9a5-4742-9635-921b7427d08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.477790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca55e9-e9a5-4742-9635-921b7427d08e admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.478063 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca55e9-e9a5-4742-9635-921b7427d08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.478328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca55e9-e9a5-4742-9635-921b7427d08e admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.478980 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca55e9-e9a5-4742-9635-921b7427d08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.480672 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca55e9-e9a5-4742-9635-921b7427d08e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.491130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1410/2813] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:16.495343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fc6bd-0e1a-4c44-a06f-8968e511c42f admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.506375 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fc6bd-0e1a-4c44-a06f-8968e511c42f admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.512184 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29de66-c711-44d6-9110-a5a45aaebd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.512808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29de66-c711-44d6-9110-a5a45aaebd6b admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.513075 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29de66-c711-44d6-9110-a5a45aaebd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.513374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29de66-c711-44d6-9110-a5a45aaebd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.514019 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29de66-c711-44d6-9110-a5a45aaebd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.515596 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29de66-c711-44d6-9110-a5a45aaebd6b admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.527184 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1404/2814] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:16.531719 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca55e9-e9a5-4742-9635-921b7427d08e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.543208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca55e9-e9a5-4742-9635-921b7427d08e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.548277 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c3874-81f2-412f-9eb6-a8dda6e89a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.548937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c3874-81f2-412f-9eb6-a8dda6e89a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.549238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c3874-81f2-412f-9eb6-a8dda6e89a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.549499 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c3874-81f2-412f-9eb6-a8dda6e89a1c admin admin] PATH_INFO: `/v3/projects/e7441f5560e6433c93810f021252635b/users/980e10e5a722479f8b9be610b6f54e47/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.565981 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c3874-81f2-412f-9eb6-a8dda6e89a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7441f5560e6433c93810f021252635b, user_id=980e10e5a722479f8b9be610b6f54e47, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.568647 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c3874-81f2-412f-9eb6-a8dda6e89a1c admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.585433 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1411/2815] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:16 2022] PUT /identity/v3/projects/e7441f5560e6433c93810f021252635b/users/980e10e5a722479f8b9be610b6f54e47/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:16.600482 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab6bd-b09a-42dd-862e-45fb78f8b2cb None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.600817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab6bd-b09a-42dd-862e-45fb78f8b2cb None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.601093 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab6bd-b09a-42dd-862e-45fb78f8b2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.632378 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-caaab6bd-b09a-42dd-862e-45fb78f8b2cb None None] MFA Rules not processed for user `980e10e5a722479f8b9be610b6f54e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:16.633630 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-caaab6bd-b09a-42dd-862e-45fb78f8b2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:16.715474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1405/2816] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:16.720230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c3874-81f2-412f-9eb6-a8dda6e89a1c admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.726468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:16.808954 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c3874-81f2-412f-9eb6-a8dda6e89a1c admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.814194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bda7c-9812-43e5-b143-5ac354af3f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.814805 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bda7c-9812-43e5-b143-5ac354af3f69 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.815081 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bda7c-9812-43e5-b143-5ac354af3f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.815345 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bda7c-9812-43e5-b143-5ac354af3f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.815978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bda7c-9812-43e5-b143-5ac354af3f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.818008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bda7c-9812-43e5-b143-5ac354af3f69 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.853639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1412/2817] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:16.857116 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaab6bd-b09a-42dd-862e-45fb78f8b2cb None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.868517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaab6bd-b09a-42dd-862e-45fb78f8b2cb None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.929864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cb9c5-f64d-418a-80b5-203a68176d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.930468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cb9c5-f64d-418a-80b5-203a68176d92 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.930719 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cb9c5-f64d-418a-80b5-203a68176d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.930998 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cb9c5-f64d-418a-80b5-203a68176d92 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.931632 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cb9c5-f64d-418a-80b5-203a68176d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.933970 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cb9c5-f64d-418a-80b5-203a68176d92 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.960887 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1406/2818] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:16.962208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bda7c-9812-43e5-b143-5ac354af3f69 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.975708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bda7c-9812-43e5-b143-5ac354af3f69 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.982979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881f77c-2e5d-4ace-a3a8-7af6c67fd21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.983601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881f77c-2e5d-4ace-a3a8-7af6c67fd21e admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.983875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881f77c-2e5d-4ace-a3a8-7af6c67fd21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.984142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881f77c-2e5d-4ace-a3a8-7af6c67fd21e admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.984789 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881f77c-2e5d-4ace-a3a8-7af6c67fd21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.986434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881f77c-2e5d-4ace-a3a8-7af6c67fd21e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.998102 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1413/2819] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:17.002556 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cb9c5-f64d-418a-80b5-203a68176d92 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:17.012825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cb9c5-f64d-418a-80b5-203a68176d92 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:17.018184 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0736cb9-04a8-4804-acef-9ed8533e578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:17.019115 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0736cb9-04a8-4804-acef-9ed8533e578e admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.019383 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0736cb9-04a8-4804-acef-9ed8533e578e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.019673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0736cb9-04a8-4804-acef-9ed8533e578e admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.020406 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0736cb9-04a8-4804-acef-9ed8533e578e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:17.021936 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0736cb9-04a8-4804-acef-9ed8533e578e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:17.032979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1407/2820] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:17.038128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881f77c-2e5d-4ace-a3a8-7af6c67fd21e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:17.050134 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881f77c-2e5d-4ace-a3a8-7af6c67fd21e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:17.055037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b01d8f-c6e7-4008-ae88-7c1c033f5bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:17.055686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b01d8f-c6e7-4008-ae88-7c1c033f5bad admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.055960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b01d8f-c6e7-4008-ae88-7c1c033f5bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.056224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b01d8f-c6e7-4008-ae88-7c1c033f5bad admin admin] PATH_INFO: `/v3/projects/150bbe26a138461998d83912a014912b/users/9489acead0f74dc69b27666cee56976a/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.074528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b01d8f-c6e7-4008-ae88-7c1c033f5bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=150bbe26a138461998d83912a014912b, user_id=9489acead0f74dc69b27666cee56976a, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:17.077225 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b01d8f-c6e7-4008-ae88-7c1c033f5bad admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:17.093955 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1414/2821] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:17 2022] PUT /identity/v3/projects/150bbe26a138461998d83912a014912b/users/9489acead0f74dc69b27666cee56976a/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:17.106125 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77f429-db99-4c78-af7b-4565a7d96d82 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.106634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77f429-db99-4c78-af7b-4565a7d96d82 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.106634 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77f429-db99-4c78-af7b-4565a7d96d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.114235 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:17.139480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-2f77f429-db99-4c78-af7b-4565a7d96d82 None None] MFA Rules not processed for user `9489acead0f74dc69b27666cee56976a`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:17.140511 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2f77f429-db99-4c78-af7b-4565a7d96d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:17.211422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1408/2822] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:17.216687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b01d8f-c6e7-4008-ae88-7c1c033f5bad admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:17.281727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b01d8f-c6e7-4008-ae88-7c1c033f5bad admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:17.286462 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375ad42-5edf-49d0-8b3c-09cc447c945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:17.287111 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375ad42-5edf-49d0-8b3c-09cc447c945e admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.287461 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375ad42-5edf-49d0-8b3c-09cc447c945e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.287740 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375ad42-5edf-49d0-8b3c-09cc447c945e admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.288383 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375ad42-5edf-49d0-8b3c-09cc447c945e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:17.290364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375ad42-5edf-49d0-8b3c-09cc447c945e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:17.324229 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1415/2823] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:17 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:17.329501 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77f429-db99-4c78-af7b-4565a7d96d82 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:17.341388 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77f429-db99-4c78-af7b-4565a7d96d82 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:17.403521 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d88852-ccb7-4b90-aca7-e13ca556dfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:17.403897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88852-ccb7-4b90-aca7-e13ca556dfd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.404171 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88852-ccb7-4b90-aca7-e13ca556dfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.404440 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88852-ccb7-4b90-aca7-e13ca556dfd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.405087 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d88852-ccb7-4b90-aca7-e13ca556dfd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:17.407078 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d88852-ccb7-4b90-aca7-e13ca556dfd9 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:17.430682 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1409/2824] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:17 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:17.435085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375ad42-5edf-49d0-8b3c-09cc447c945e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:17.445692 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375ad42-5edf-49d0-8b3c-09cc447c945e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:17.450501 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0118f-8a21-4006-8b6c-7313dbd24abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:17.451100 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0118f-8a21-4006-8b6c-7313dbd24abe admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.451369 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0118f-8a21-4006-8b6c-7313dbd24abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.451631 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0118f-8a21-4006-8b6c-7313dbd24abe admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.452295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0118f-8a21-4006-8b6c-7313dbd24abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:17.453922 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0118f-8a21-4006-8b6c-7313dbd24abe admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:17.464957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1416/2825] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:17.469753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d88852-ccb7-4b90-aca7-e13ca556dfd9 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:17.481109 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d88852-ccb7-4b90-aca7-e13ca556dfd9 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:17.487422 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20949298-0044-429a-a4e6-f1ff5045130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:17.488085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20949298-0044-429a-a4e6-f1ff5045130a admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.488377 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20949298-0044-429a-a4e6-f1ff5045130a admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.488629 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20949298-0044-429a-a4e6-f1ff5045130a admin admin] PATH_INFO: `/v3/projects/13fb04713b67450c813ac09832e9a3a8/users/9a8563ec28824ab487c3e007b68df5bd/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.505623 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20949298-0044-429a-a4e6-f1ff5045130a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fb04713b67450c813ac09832e9a3a8, user_id=9a8563ec28824ab487c3e007b68df5bd, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:17.508263 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20949298-0044-429a-a4e6-f1ff5045130a admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:17.524857 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1410/2826] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:17 2022] PUT /identity/v3/projects/13fb04713b67450c813ac09832e9a3a8/users/9a8563ec28824ab487c3e007b68df5bd/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:17.529128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0118f-8a21-4006-8b6c-7313dbd24abe admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:17.539411 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0118f-8a21-4006-8b6c-7313dbd24abe admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:17.567987 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:17.608681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293b1dd-cbfe-4769-8d5f-d9adc136be44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:17.609574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293b1dd-cbfe-4769-8d5f-d9adc136be44 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.609938 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293b1dd-cbfe-4769-8d5f-d9adc136be44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.610299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293b1dd-cbfe-4769-8d5f-d9adc136be44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.611148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293b1dd-cbfe-4769-8d5f-d9adc136be44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:17.613262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293b1dd-cbfe-4769-8d5f-d9adc136be44 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:17.626510 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1417/2827] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:17.630871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20949298-0044-429a-a4e6-f1ff5045130a admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:17.641392 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20949298-0044-429a-a4e6-f1ff5045130a admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:17.646676 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa62de5-5715-4ba5-bf9c-db00748d7249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:17.647480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa62de5-5715-4ba5-bf9c-db00748d7249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.647758 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa62de5-5715-4ba5-bf9c-db00748d7249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.648105 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa62de5-5715-4ba5-bf9c-db00748d7249 admin admin] PATH_INFO: `/v3/projects/13fb04713b67450c813ac09832e9a3a8/users/9a8563ec28824ab487c3e007b68df5bd/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.651123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa62de5-5715-4ba5-bf9c-db00748d7249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fb04713b67450c813ac09832e9a3a8, user_id=9a8563ec28824ab487c3e007b68df5bd, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:17.654009 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa62de5-5715-4ba5-bf9c-db00748d7249 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:17.664599 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1411/2828] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:17 2022] PUT /identity/v3/projects/13fb04713b67450c813ac09832e9a3a8/users/9a8563ec28824ab487c3e007b68df5bd/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:17.676077 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477fec2-e1ff-4dfc-a21e-546d36bbf15b None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.676354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477fec2-e1ff-4dfc-a21e-546d36bbf15b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.676627 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477fec2-e1ff-4dfc-a21e-546d36bbf15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.706944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-e477fec2-e1ff-4dfc-a21e-546d36bbf15b None None] MFA Rules not processed for user `9a8563ec28824ab487c3e007b68df5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:17.708366 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e477fec2-e1ff-4dfc-a21e-546d36bbf15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:17.798877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1418/2829] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:17.812132 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa62de5-5715-4ba5-bf9c-db00748d7249 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:17.813945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2fa62de5-5715-4ba5-bf9c-db00748d7249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:17.864367 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:17.878869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa62de5-5715-4ba5-bf9c-db00748d7249 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:17.883178 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfeb88-48bb-4def-bc86-2f3fc0fd6ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:17.883833 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfeb88-48bb-4def-bc86-2f3fc0fd6ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.884161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfeb88-48bb-4def-bc86-2f3fc0fd6ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.884448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfeb88-48bb-4def-bc86-2f3fc0fd6ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.895037 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfeb88-48bb-4def-bc86-2f3fc0fd6ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:17.896480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfeb88-48bb-4def-bc86-2f3fc0fd6ec2 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:17.906778 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1412/2830] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:18.452930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477fec2-e1ff-4dfc-a21e-546d36bbf15b None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:18.476639 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477fec2-e1ff-4dfc-a21e-546d36bbf15b None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:18.481463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9457de-622f-4f04-a235-547bcd61751b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:18.482687 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9457de-622f-4f04-a235-547bcd61751b service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:18.482960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9457de-622f-4f04-a235-547bcd61751b service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:18.483224 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9457de-622f-4f04-a235-547bcd61751b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:18.554008 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9457de-622f-4f04-a235-547bcd61751b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:18.555357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9457de-622f-4f04-a235-547bcd61751b service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:18.564645 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1419/2831] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:22.663831 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfeb88-48bb-4def-bc86-2f3fc0fd6ec2 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:22.672817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfeb88-48bb-4def-bc86-2f3fc0fd6ec2 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:22.676593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aabcd-49fa-4a5b-b582-e6b1c56c9a28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:22.677164 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aabcd-49fa-4a5b-b582-e6b1c56c9a28 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:22.677474 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aabcd-49fa-4a5b-b582-e6b1c56c9a28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:22.677739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aabcd-49fa-4a5b-b582-e6b1c56c9a28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:22.733944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6aabcd-49fa-4a5b-b582-e6b1c56c9a28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:22.735289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6aabcd-49fa-4a5b-b582-e6b1c56c9a28 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:22.744713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1413/2832] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:24.971480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9457de-622f-4f04-a235-547bcd61751b service cinder] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:25.031611 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=100 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:25.047030 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9457de-622f-4f04-a235-547bcd61751b service cinder] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:25.052405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:25.053043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:25.053357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:25.053629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] PATH_INFO: `/v3/users/980e10e5a722479f8b9be610b6f54e47` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:25.054742 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=980e10e5a722479f8b9be610b6f54e47)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:25.056732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:25.114570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '980e10e5a722479f8b9be610b6f54e47'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.122296 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '980e10e5a722479f8b9be610b6f54e47'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.122985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '980e10e5a722479f8b9be610b6f54e47'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.130916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '980e10e5a722479f8b9be610b6f54e47'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.143467 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '980e10e5a722479f8b9be610b6f54e47'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.150871 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1420/2833] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:24 2022] DELETE /identity/v3/users/980e10e5a722479f8b9be610b6f54e47 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:25.155932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e078de4-4a93-4c10-9848-f94cd6edaa30 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:25.156432 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e078de4-4a93-4c10-9848-f94cd6edaa30 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:25.156542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e078de4-4a93-4c10-9848-f94cd6edaa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:25.177426 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-5e078de4-4a93-4c10-9848-f94cd6edaa30 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:25.178638 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-5e078de4-4a93-4c10-9848-f94cd6edaa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:25.247785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1414/2834] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:25.261957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:25.264161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:25.335165 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407db59c-7064-4c39-88c3-8112d6120b6e admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:25.339405 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b0d52-24a9-4761-b11f-635bf8b2da94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:25.340019 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b0d52-24a9-4761-b11f-635bf8b2da94 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:25.340291 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b0d52-24a9-4761-b11f-635bf8b2da94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:25.340553 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b0d52-24a9-4761-b11f-635bf8b2da94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:25.349827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b0d52-24a9-4761-b11f-635bf8b2da94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:25.351252 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b0d52-24a9-4761-b11f-635bf8b2da94 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:25.360879 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1421/2835] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:25.653893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e078de4-4a93-4c10-9848-f94cd6edaa30 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:25.656036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-5e078de4-4a93-4c10-9848-f94cd6edaa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:25.669269 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e078de4-4a93-4c10-9848-f94cd6edaa30 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:25.674612 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:25.675264 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:25.675537 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:25.675808 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] PATH_INFO: `/v3/projects/e7441f5560e6433c93810f021252635b` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:25.676972 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7441f5560e6433c93810f021252635b)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:25.678916 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:25.731423 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7441f5560e6433c93810f021252635b', 'request_id': 'req-e7f60322-f74c-4955-89dc-7564090f4405'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.743062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7441f5560e6433c93810f021252635b', 'request_id': 'req-e7f60322-f74c-4955-89dc-7564090f4405'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.749739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7441f5560e6433c93810f021252635b', 'request_id': 'req-e7f60322-f74c-4955-89dc-7564090f4405'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.761385 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] The token cache is being invalidate because project e7441f5560e6433c93810f021252635b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:25.761670 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.762417 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.764097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1415/2836] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:25 2022] DELETE /identity/v3/projects/e7441f5560e6433c93810f021252635b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:25.774048 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b0d52-24a9-4761-b11f-635bf8b2da94 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:25.787552 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b0d52-24a9-4761-b11f-635bf8b2da94 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:25.845156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:25.845829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:25.846180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:25.846354 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] PATH_INFO: `/v3/users/9489acead0f74dc69b27666cee56976a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:25.847483 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9489acead0f74dc69b27666cee56976a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:25.849634 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:25.863889 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:25.902261 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9489acead0f74dc69b27666cee56976a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.911489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9489acead0f74dc69b27666cee56976a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.912299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9489acead0f74dc69b27666cee56976a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.919858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9489acead0f74dc69b27666cee56976a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.934241 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9489acead0f74dc69b27666cee56976a'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:25.941060 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1422/2837] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:25 2022] DELETE /identity/v3/users/9489acead0f74dc69b27666cee56976a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:26.242190 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:26.243754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:26.263948 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f60322-f74c-4955-89dc-7564090f4405 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:26.270673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:26.328351 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:26.329215 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:26.329487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:26.329756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] PATH_INFO: `/v3/projects/150bbe26a138461998d83912a014912b` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:26.330875 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=150bbe26a138461998d83912a014912b)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:26.332787 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:26.387227 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '150bbe26a138461998d83912a014912b', 'request_id': 'req-ba932d77-d3e9-479b-b643-f6b97164cb28'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:26.396986 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '150bbe26a138461998d83912a014912b', 'request_id': 'req-ba932d77-d3e9-479b-b643-f6b97164cb28'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:26.403685 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '150bbe26a138461998d83912a014912b', 'request_id': 'req-ba932d77-d3e9-479b-b643-f6b97164cb28'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:26.415471 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] The token cache is being invalidate because project 150bbe26a138461998d83912a014912b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:26.415652 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:26.416433 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:26.418297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1416/2838] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:26 2022] DELETE /identity/v3/projects/150bbe26a138461998d83912a014912b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:26.422596 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:26.424180 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:26.442051 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208f3a2-c2c2-4de6-bc3f-3045e8866975 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:26.500215 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20c7e4-f10d-4811-8aaa-c09bb0356920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:26.500911 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20c7e4-f10d-4811-8aaa-c09bb0356920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:26.501183 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20c7e4-f10d-4811-8aaa-c09bb0356920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:26.501476 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20c7e4-f10d-4811-8aaa-c09bb0356920 admin admin] PATH_INFO: `/v3/users/9a8563ec28824ab487c3e007b68df5bd` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:26.502597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20c7e4-f10d-4811-8aaa-c09bb0356920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8563ec28824ab487c3e007b68df5bd)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:26.504508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20c7e4-f10d-4811-8aaa-c09bb0356920 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:26.553937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ca20c7e4-f10d-4811-8aaa-c09bb0356920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8563ec28824ab487c3e007b68df5bd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:26.564240 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ca20c7e4-f10d-4811-8aaa-c09bb0356920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8563ec28824ab487c3e007b68df5bd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:26.564912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ca20c7e4-f10d-4811-8aaa-c09bb0356920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8563ec28824ab487c3e007b68df5bd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:26.572365 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ca20c7e4-f10d-4811-8aaa-c09bb0356920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8563ec28824ab487c3e007b68df5bd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:26.584392 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ca20c7e4-f10d-4811-8aaa-c09bb0356920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8563ec28824ab487c3e007b68df5bd'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:26.590837 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1423/2839] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:26 2022] DELETE /identity/v3/users/9a8563ec28824ab487c3e007b68df5bd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:26.887363 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:26.888812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:26.903851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba932d77-d3e9-479b-b643-f6b97164cb28 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:26.963934 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:26.964488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:26.964757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:26.965249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] PATH_INFO: `/v3/projects/13fb04713b67450c813ac09832e9a3a8` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:26.966736 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13fb04713b67450c813ac09832e9a3a8)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:26.968624 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.018469 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:27.028689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13fb04713b67450c813ac09832e9a3a8', 'request_id': 'req-6fc42507-dc20-426e-a04c-69c181bba551'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.039302 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13fb04713b67450c813ac09832e9a3a8', 'request_id': 'req-6fc42507-dc20-426e-a04c-69c181bba551'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.046237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13fb04713b67450c813ac09832e9a3a8', 'request_id': 'req-6fc42507-dc20-426e-a04c-69c181bba551'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.057336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] The token cache is being invalidate because project 13fb04713b67450c813ac09832e9a3a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:27.057615 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.058241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.059716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1417/2840] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:26 2022] DELETE /identity/v3/projects/13fb04713b67450c813ac09832e9a3a8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:27.066156 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f29c6b-10c9-4026-88ef-ee0a97e1ae1b None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.066441 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f29c6b-10c9-4026-88ef-ee0a97e1ae1b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.066713 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f29c6b-10c9-4026-88ef-ee0a97e1ae1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.088272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-f2f29c6b-10c9-4026-88ef-ee0a97e1ae1b None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:27.089579 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f2f29c6b-10c9-4026-88ef-ee0a97e1ae1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:27.094116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:27.154695 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1424/2841] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:27.161912 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.163626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:27.164700 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1da64-be59-4c27-a7a3-c46ff19e56c7 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.164982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1da64-be59-4c27-a7a3-c46ff19e56c7 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.165279 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1da64-be59-4c27-a7a3-c46ff19e56c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.177012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc42507-dc20-426e-a04c-69c181bba551 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.182160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd141c0-2b3d-4f4b-b88b-e3d288f23484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.182795 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd141c0-2b3d-4f4b-b88b-e3d288f23484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.183072 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd141c0-2b3d-4f4b-b88b-e3d288f23484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.183382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd141c0-2b3d-4f4b-b88b-e3d288f23484 admin admin] PATH_INFO: `/v3/users/0e7c7fe134e14f629fcd0b4d6919a21d` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.184610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd141c0-2b3d-4f4b-b88b-e3d288f23484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e7c7fe134e14f629fcd0b4d6919a21d)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.185173 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-c1a1da64-be59-4c27-a7a3-c46ff19e56c7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:27.186383 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c1a1da64-be59-4c27-a7a3-c46ff19e56c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:27.186587 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd141c0-2b3d-4f4b-b88b-e3d288f23484 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.194422 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1425/2842] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:27.198606 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1da64-be59-4c27-a7a3-c46ff19e56c7 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.207465 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1da64-be59-4c27-a7a3-c46ff19e56c7 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.212237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb5da4-7123-4c10-bd36-700e88fbd3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.212822 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb5da4-7123-4c10-bd36-700e88fbd3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.213116 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb5da4-7123-4c10-bd36-700e88fbd3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.213477 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb5da4-7123-4c10-bd36-700e88fbd3e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.214210 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb5da4-7123-4c10-bd36-700e88fbd3e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:27.214436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb5da4-7123-4c10-bd36-700e88fbd3e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.216009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb5da4-7123-4c10-bd36-700e88fbd3e8 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.227944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1426/2843] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:27.232199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb5da4-7123-4c10-bd36-700e88fbd3e8 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.235958 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dfd141c0-2b3d-4f4b-b88b-e3d288f23484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e7c7fe134e14f629fcd0b4d6919a21d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.241894 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb5da4-7123-4c10-bd36-700e88fbd3e8 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.246930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036f5fd-1e2b-4eb0-9cab-3fdf41722519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.247522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036f5fd-1e2b-4eb0-9cab-3fdf41722519 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.247803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036f5fd-1e2b-4eb0-9cab-3fdf41722519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.247925 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dfd141c0-2b3d-4f4b-b88b-e3d288f23484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e7c7fe134e14f629fcd0b4d6919a21d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.248381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036f5fd-1e2b-4eb0-9cab-3fdf41722519 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.248575 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dfd141c0-2b3d-4f4b-b88b-e3d288f23484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e7c7fe134e14f629fcd0b4d6919a21d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.248707 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036f5fd-1e2b-4eb0-9cab-3fdf41722519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.249172 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dfd141c0-2b3d-4f4b-b88b-e3d288f23484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e7c7fe134e14f629fcd0b4d6919a21d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.250765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036f5fd-1e2b-4eb0-9cab-3fdf41722519 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.259271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dfd141c0-2b3d-4f4b-b88b-e3d288f23484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e7c7fe134e14f629fcd0b4d6919a21d'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.273419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1418/2844] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:27 2022] DELETE /identity/v3/users/0e7c7fe134e14f629fcd0b4d6919a21d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:27.277981 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baeae2-6110-4fbb-ab65-e314513e04da None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.278255 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baeae2-6110-4fbb-ab65-e314513e04da None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.278519 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baeae2-6110-4fbb-ab65-e314513e04da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.281463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1427/2845] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:27 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:27.285793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036f5fd-1e2b-4eb0-9cab-3fdf41722519 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.287753 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e036f5fd-1e2b-4eb0-9cab-3fdf41722519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:27.298419 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-a9baeae2-6110-4fbb-ab65-e314513e04da None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:27.299694 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a9baeae2-6110-4fbb-ab65-e314513e04da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:27.368819 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036f5fd-1e2b-4eb0-9cab-3fdf41722519 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.373494 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703c512-9370-4003-8221-5a052f76e50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.374105 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703c512-9370-4003-8221-5a052f76e50f admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.374379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703c512-9370-4003-8221-5a052f76e50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.374492 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1419/2846] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:27.374671 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703c512-9370-4003-8221-5a052f76e50f admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.378617 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703c512-9370-4003-8221-5a052f76e50f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.380540 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703c512-9370-4003-8221-5a052f76e50f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.385017 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9baeae2-6110-4fbb-ab65-e314513e04da None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.386669 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a9baeae2-6110-4fbb-ab65-e314513e04da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:27.403250 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1428/2847] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:27 2022] POST /identity/v3/users => generated 303 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:27.407453 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703c512-9370-4003-8221-5a052f76e50f admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.417397 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703c512-9370-4003-8221-5a052f76e50f admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.423245 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26424c2-fff3-4c60-863d-756a663f1601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.423896 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26424c2-fff3-4c60-863d-756a663f1601 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.424120 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26424c2-fff3-4c60-863d-756a663f1601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.424389 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26424c2-fff3-4c60-863d-756a663f1601 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.425070 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26424c2-fff3-4c60-863d-756a663f1601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.426741 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26424c2-fff3-4c60-863d-756a663f1601 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.437052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1429/2848] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:27.439864 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:27.441381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26424c2-fff3-4c60-863d-756a663f1601 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.452637 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26424c2-fff3-4c60-863d-756a663f1601 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.452944 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9baeae2-6110-4fbb-ab65-e314513e04da None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.457535 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ba5df-e9e6-4362-8b3c-1195ed66d2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.457708 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad52bf-b451-4a47-adb8-f2ec66d90f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.458130 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ba5df-e9e6-4362-8b3c-1195ed66d2dd admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.458316 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad52bf-b451-4a47-adb8-f2ec66d90f9b service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.458428 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ba5df-e9e6-4362-8b3c-1195ed66d2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.458526 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad52bf-b451-4a47-adb8-f2ec66d90f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.458701 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ba5df-e9e6-4362-8b3c-1195ed66d2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.458809 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad52bf-b451-4a47-adb8-f2ec66d90f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.459322 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ba5df-e9e6-4362-8b3c-1195ed66d2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.460849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ba5df-e9e6-4362-8b3c-1195ed66d2dd admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.469379 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad52bf-b451-4a47-adb8-f2ec66d90f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.470806 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad52bf-b451-4a47-adb8-f2ec66d90f9b service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.471867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1430/2849] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:27.476272 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ba5df-e9e6-4362-8b3c-1195ed66d2dd admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.481455 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1420/2850] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:27.486033 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ba5df-e9e6-4362-8b3c-1195ed66d2dd admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.490652 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce839df7-3c9e-40ce-939d-1deb8e2cbc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.491312 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce839df7-3c9e-40ce-939d-1deb8e2cbc5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.491588 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce839df7-3c9e-40ce-939d-1deb8e2cbc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.491856 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce839df7-3c9e-40ce-939d-1deb8e2cbc5a admin admin] PATH_INFO: `/v3/projects/8a2c70dfe7c54102913fddf4b81807b8/users/c5e5714efcca48fcb2e06c8a77d6a1a7/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.508384 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce839df7-3c9e-40ce-939d-1deb8e2cbc5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2c70dfe7c54102913fddf4b81807b8, user_id=c5e5714efcca48fcb2e06c8a77d6a1a7, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.511148 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce839df7-3c9e-40ce-939d-1deb8e2cbc5a admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.525626 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1431/2851] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:27 2022] PUT /identity/v3/projects/8a2c70dfe7c54102913fddf4b81807b8/users/c5e5714efcca48fcb2e06c8a77d6a1a7/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:27.537668 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c5fad-0ee1-4085-a42e-2cf4bec6d1fc None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.537894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c5fad-0ee1-4085-a42e-2cf4bec6d1fc None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.538195 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c5fad-0ee1-4085-a42e-2cf4bec6d1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.568391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-c31c5fad-0ee1-4085-a42e-2cf4bec6d1fc None None] MFA Rules not processed for user `c5e5714efcca48fcb2e06c8a77d6a1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:27.569818 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-c31c5fad-0ee1-4085-a42e-2cf4bec6d1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:27.642040 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1421/2852] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:27.646825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce839df7-3c9e-40ce-939d-1deb8e2cbc5a admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.660489 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:27.713121 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce839df7-3c9e-40ce-939d-1deb8e2cbc5a admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.717903 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14d0dd-3ccc-4a74-be0d-bfb5e1712572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.718508 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d0dd-3ccc-4a74-be0d-bfb5e1712572 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.718776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d0dd-3ccc-4a74-be0d-bfb5e1712572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.719037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d0dd-3ccc-4a74-be0d-bfb5e1712572 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.719807 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14d0dd-3ccc-4a74-be0d-bfb5e1712572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.721771 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14d0dd-3ccc-4a74-be0d-bfb5e1712572 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.754528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1432/2853] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:27 2022] POST /identity/v3/projects => generated 407 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:27.756180 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c5fad-0ee1-4085-a42e-2cf4bec6d1fc None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.765978 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14d0dd-3ccc-4a74-be0d-bfb5e1712572 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.767883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ac14d0dd-3ccc-4a74-be0d-bfb5e1712572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:27.769405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c5fad-0ee1-4085-a42e-2cf4bec6d1fc None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.836163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c426f-5bdb-4fa1-9b6b-f685e512e34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.836776 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c426f-5bdb-4fa1-9b6b-f685e512e34e admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.837049 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c426f-5bdb-4fa1-9b6b-f685e512e34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.837357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c426f-5bdb-4fa1-9b6b-f685e512e34e admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.837994 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c426f-5bdb-4fa1-9b6b-f685e512e34e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.839937 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c426f-5bdb-4fa1-9b6b-f685e512e34e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.841348 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14d0dd-3ccc-4a74-be0d-bfb5e1712572 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.846072 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99250f0-8eb2-42f1-8358-77d4782b6571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.846703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99250f0-8eb2-42f1-8358-77d4782b6571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.846979 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99250f0-8eb2-42f1-8358-77d4782b6571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.847246 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99250f0-8eb2-42f1-8358-77d4782b6571 admin admin] PATH_INFO: `/v3/projects/3b36fe54edb241f58cd1b46dc5dd6a8f` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.848403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99250f0-8eb2-42f1-8358-77d4782b6571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b36fe54edb241f58cd1b46dc5dd6a8f)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.850295 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99250f0-8eb2-42f1-8358-77d4782b6571 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.863757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1422/2854] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:27 2022] POST /identity/v3/users => generated 310 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:27.867751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c426f-5bdb-4fa1-9b6b-f685e512e34e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.877434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c426f-5bdb-4fa1-9b6b-f685e512e34e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.882032 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8acd8-a6e5-4b60-9b97-c8bef1210595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.882608 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8acd8-a6e5-4b60-9b97-c8bef1210595 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.882877 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8acd8-a6e5-4b60-9b97-c8bef1210595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.883129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8acd8-a6e5-4b60-9b97-c8bef1210595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.883766 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8acd8-a6e5-4b60-9b97-c8bef1210595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.885439 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8acd8-a6e5-4b60-9b97-c8bef1210595 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.896163 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1423/2855] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:27.900325 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8acd8-a6e5-4b60-9b97-c8bef1210595 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.903724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e99250f0-8eb2-42f1-8358-77d4782b6571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b36fe54edb241f58cd1b46dc5dd6a8f', 'request_id': 'req-e99250f0-8eb2-42f1-8358-77d4782b6571'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.910721 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8acd8-a6e5-4b60-9b97-c8bef1210595 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.913199 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e99250f0-8eb2-42f1-8358-77d4782b6571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b36fe54edb241f58cd1b46dc5dd6a8f', 'request_id': 'req-e99250f0-8eb2-42f1-8358-77d4782b6571'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.919944 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e99250f0-8eb2-42f1-8358-77d4782b6571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b36fe54edb241f58cd1b46dc5dd6a8f', 'request_id': 'req-e99250f0-8eb2-42f1-8358-77d4782b6571'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.931037 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e99250f0-8eb2-42f1-8358-77d4782b6571 admin admin] The token cache is being invalidate because project 3b36fe54edb241f58cd1b46dc5dd6a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:27.931312 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e99250f0-8eb2-42f1-8358-77d4782b6571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.931972 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e99250f0-8eb2-42f1-8358-77d4782b6571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.933524 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1433/2856] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:27 2022] DELETE /identity/v3/projects/3b36fe54edb241f58cd1b46dc5dd6a8f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:27.938464 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7470ac-2f06-4fde-b5e3-3c853c64dc88 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.938795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7470ac-2f06-4fde-b5e3-3c853c64dc88 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.939067 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7470ac-2f06-4fde-b5e3-3c853c64dc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.958559 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-3e7470ac-2f06-4fde-b5e3-3c853c64dc88 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:27.959763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-3e7470ac-2f06-4fde-b5e3-3c853c64dc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:27.961523 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:27.972487 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055c3b1-811b-4564-a890-fe169b872496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.973081 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055c3b1-811b-4564-a890-fe169b872496 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.973389 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055c3b1-811b-4564-a890-fe169b872496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.973655 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055c3b1-811b-4564-a890-fe169b872496 admin admin] PATH_INFO: `/v3/projects/ee803d96097044a6a72f3ca5c304ff7c/users/f1e9018fd3f9411588b016b334514029/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.980419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:27.989908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055c3b1-811b-4564-a890-fe169b872496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee803d96097044a6a72f3ca5c304ff7c, user_id=f1e9018fd3f9411588b016b334514029, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.992673 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055c3b1-811b-4564-a890-fe169b872496 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.006895 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1424/2857] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:27 2022] PUT /identity/v3/projects/ee803d96097044a6a72f3ca5c304ff7c/users/f1e9018fd3f9411588b016b334514029/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:28.010785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055c3b1-811b-4564-a890-fe169b872496 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.012660 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-e055c3b1-811b-4564-a890-fe169b872496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:28.022623 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1434/2858] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:28.030319 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddccbd8-ca8a-43c6-8905-d8ee522b9403 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.030604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddccbd8-ca8a-43c6-8905-d8ee522b9403 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.031217 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddccbd8-ca8a-43c6-8905-d8ee522b9403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.051325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-2ddccbd8-ca8a-43c6-8905-d8ee522b9403 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:28.052569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2ddccbd8-ca8a-43c6-8905-d8ee522b9403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:28.078038 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055c3b1-811b-4564-a890-fe169b872496 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.083488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c48630-6248-4508-8b35-e0945aca568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.084099 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c48630-6248-4508-8b35-e0945aca568c admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.084375 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c48630-6248-4508-8b35-e0945aca568c admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.084647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c48630-6248-4508-8b35-e0945aca568c admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.085318 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c48630-6248-4508-8b35-e0945aca568c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.086922 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c48630-6248-4508-8b35-e0945aca568c admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.099754 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1425/2859] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:28.103856 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c48630-6248-4508-8b35-e0945aca568c admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.114131 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c48630-6248-4508-8b35-e0945aca568c admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.119114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0ef5-5091-4775-ad90-d0c1e5982f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.119899 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0ef5-5091-4775-ad90-d0c1e5982f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.120177 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0ef5-5091-4775-ad90-d0c1e5982f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.120459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0ef5-5091-4775-ad90-d0c1e5982f21 admin admin] PATH_INFO: `/v3/projects/ee803d96097044a6a72f3ca5c304ff7c/users/f1e9018fd3f9411588b016b334514029/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.122390 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d0ef5-5091-4775-ad90-d0c1e5982f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee803d96097044a6a72f3ca5c304ff7c, user_id=f1e9018fd3f9411588b016b334514029, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.124962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1435/2860] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:28.125106 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d0ef5-5091-4775-ad90-d0c1e5982f21 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.129452 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddccbd8-ca8a-43c6-8905-d8ee522b9403 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.136770 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1426/2861] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:28 2022] PUT /identity/v3/projects/ee803d96097044a6a72f3ca5c304ff7c/users/f1e9018fd3f9411588b016b334514029/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:28.138535 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddccbd8-ca8a-43c6-8905-d8ee522b9403 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.147610 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a0fbb-b941-4a66-ad0e-e5a3ea73681b None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.147891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a0fbb-b941-4a66-ad0e-e5a3ea73681b None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.148160 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a0fbb-b941-4a66-ad0e-e5a3ea73681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.179041 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-bd6a0fbb-b941-4a66-ad0e-e5a3ea73681b None None] MFA Rules not processed for user `f1e9018fd3f9411588b016b334514029`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:28.180249 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-bd6a0fbb-b941-4a66-ad0e-e5a3ea73681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:28.196749 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7d387-6adc-4325-862f-4acb868018bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.197418 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7d387-6adc-4325-862f-4acb868018bb admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.197690 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7d387-6adc-4325-862f-4acb868018bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.197960 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7d387-6adc-4325-862f-4acb868018bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.198602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7d387-6adc-4325-862f-4acb868018bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:28.198914 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7d387-6adc-4325-862f-4acb868018bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.200521 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7d387-6adc-4325-862f-4acb868018bb admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.212350 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1436/2862] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:26:28.216691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7d387-6adc-4325-862f-4acb868018bb admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.226773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7d387-6adc-4325-862f-4acb868018bb admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.232015 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e7741-f2be-4f27-bb14-6f92c5bf35f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.232600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e7741-f2be-4f27-bb14-6f92c5bf35f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.232869 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e7741-f2be-4f27-bb14-6f92c5bf35f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.233137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e7741-f2be-4f27-bb14-6f92c5bf35f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.233830 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e7741-f2be-4f27-bb14-6f92c5bf35f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.235952 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e7741-f2be-4f27-bb14-6f92c5bf35f6 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.250528 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1427/2863] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:28 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:28.262157 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a0fbb-b941-4a66-ad0e-e5a3ea73681b None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.263650 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-bd6a0fbb-b941-4a66-ad0e-e5a3ea73681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:28.265432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1437/2864] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:28 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:28.269813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e7741-f2be-4f27-bb14-6f92c5bf35f6 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.314299 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:28.316257 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:28.328352 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a0fbb-b941-4a66-ad0e-e5a3ea73681b None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.336740 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e7741-f2be-4f27-bb14-6f92c5bf35f6 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.341641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da356b5f-3a52-4e6b-b5a2-d67049ed38f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.342255 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da356b5f-3a52-4e6b-b5a2-d67049ed38f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.342532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da356b5f-3a52-4e6b-b5a2-d67049ed38f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.342801 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da356b5f-3a52-4e6b-b5a2-d67049ed38f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.343434 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da356b5f-3a52-4e6b-b5a2-d67049ed38f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.345569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da356b5f-3a52-4e6b-b5a2-d67049ed38f5 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.369009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1438/2865] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:28 2022] POST /identity/v3/users => generated 281 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:28.373525 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da356b5f-3a52-4e6b-b5a2-d67049ed38f5 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.382593 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc5fd1-5088-476f-a1e2-a5d07a582e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.383336 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc5fd1-5088-476f-a1e2-a5d07a582e32 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.383684 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc5fd1-5088-476f-a1e2-a5d07a582e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.383954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc5fd1-5088-476f-a1e2-a5d07a582e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.384790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da356b5f-3a52-4e6b-b5a2-d67049ed38f5 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.389630 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542dbee-97ae-4dc6-9106-10d575780495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.390233 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542dbee-97ae-4dc6-9106-10d575780495 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.390509 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542dbee-97ae-4dc6-9106-10d575780495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.390812 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542dbee-97ae-4dc6-9106-10d575780495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.391669 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542dbee-97ae-4dc6-9106-10d575780495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.393309 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542dbee-97ae-4dc6-9106-10d575780495 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.403991 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1439/2866] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:28.408255 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542dbee-97ae-4dc6-9106-10d575780495 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.418655 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542dbee-97ae-4dc6-9106-10d575780495 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.423529 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4635b7-c93a-427c-baee-b0beff23ad55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.424166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4635b7-c93a-427c-baee-b0beff23ad55 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.424446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4635b7-c93a-427c-baee-b0beff23ad55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.424720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4635b7-c93a-427c-baee-b0beff23ad55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.425417 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4635b7-c93a-427c-baee-b0beff23ad55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.426998 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4635b7-c93a-427c-baee-b0beff23ad55 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.437894 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1440/2867] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:28.445403 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4635b7-c93a-427c-baee-b0beff23ad55 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.447871 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc5fd1-5088-476f-a1e2-a5d07a582e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.449394 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc5fd1-5088-476f-a1e2-a5d07a582e32 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.455825 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4635b7-c93a-427c-baee-b0beff23ad55 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.459241 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1428/2868] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:28 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:28.462309 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb59550-5252-42a6-ac83-02273c35d6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.462971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb59550-5252-42a6-ac83-02273c35d6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.463243 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb59550-5252-42a6-ac83-02273c35d6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.463506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb59550-5252-42a6-ac83-02273c35d6e2 admin admin] PATH_INFO: `/v3/projects/daa7c3ad387a4fd5b31a0e38d003f216/users/687d2610c5634112bfe6fef109b8bba2/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.480086 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb59550-5252-42a6-ac83-02273c35d6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa7c3ad387a4fd5b31a0e38d003f216, user_id=687d2610c5634112bfe6fef109b8bba2, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.482755 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb59550-5252-42a6-ac83-02273c35d6e2 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.496829 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1441/2869] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:28 2022] PUT /identity/v3/projects/daa7c3ad387a4fd5b31a0e38d003f216/users/687d2610c5634112bfe6fef109b8bba2/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:28.511527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945494a-b8e5-453e-9034-df110d67da35 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.511813 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945494a-b8e5-453e-9034-df110d67da35 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.512090 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945494a-b8e5-453e-9034-df110d67da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.541382 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-b945494a-b8e5-453e-9034-df110d67da35 None None] MFA Rules not processed for user `687d2610c5634112bfe6fef109b8bba2`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:28.542591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b945494a-b8e5-453e-9034-df110d67da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:28.615713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1429/2870] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:28.623703 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb59550-5252-42a6-ac83-02273c35d6e2 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.646130 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945494a-b8e5-453e-9034-df110d67da35 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.647628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-b945494a-b8e5-453e-9034-df110d67da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:28.683908 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb59550-5252-42a6-ac83-02273c35d6e2 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.688505 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb615814-162a-4329-9e9d-3f9741e67ffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.689200 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb615814-162a-4329-9e9d-3f9741e67ffa service cinder] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.689532 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb615814-162a-4329-9e9d-3f9741e67ffa service cinder] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.689802 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb615814-162a-4329-9e9d-3f9741e67ffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.691570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-fb615814-162a-4329-9e9d-3f9741e67ffa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:28.692689 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=100 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:28.708138 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945494a-b8e5-453e-9034-df110d67da35 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.711800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40722cb-e100-484a-ba74-3a80e18bd738 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.712403 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40722cb-e100-484a-ba74-3a80e18bd738 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.712672 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40722cb-e100-484a-ba74-3a80e18bd738 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.712935 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40722cb-e100-484a-ba74-3a80e18bd738 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.721454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40722cb-e100-484a-ba74-3a80e18bd738 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.722891 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40722cb-e100-484a-ba74-3a80e18bd738 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.732025 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1430/2871] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:28.747289 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40722cb-e100-484a-ba74-3a80e18bd738 service cinder] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.753871 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb615814-162a-4329-9e9d-3f9741e67ffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.755426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb615814-162a-4329-9e9d-3f9741e67ffa service cinder] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.764691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1442/2872] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:28 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:28.813738 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40722cb-e100-484a-ba74-3a80e18bd738 service cinder] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.818919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.819550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.819820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.820075 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] PATH_INFO: `/v3/users/687d2610c5634112bfe6fef109b8bba2` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.821230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=687d2610c5634112bfe6fef109b8bba2)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.823140 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.873710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687d2610c5634112bfe6fef109b8bba2'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.889820 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687d2610c5634112bfe6fef109b8bba2'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.890607 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687d2610c5634112bfe6fef109b8bba2'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.891391 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687d2610c5634112bfe6fef109b8bba2'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.900084 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687d2610c5634112bfe6fef109b8bba2'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.914186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1431/2873] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:28 2022] DELETE /identity/v3/users/687d2610c5634112bfe6fef109b8bba2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:28.919139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baddf0-dbf5-41bf-b2c4-901d98fcf49d None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.919421 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baddf0-dbf5-41bf-b2c4-901d98fcf49d None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.919689 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baddf0-dbf5-41bf-b2c4-901d98fcf49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.940907 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-66baddf0-dbf5-41bf-b2c4-901d98fcf49d None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:28.942168 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-66baddf0-dbf5-41bf-b2c4-901d98fcf49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:28.977329 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:29.012831 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1443/2874] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:29.033317 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:29.035005 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:29.107355 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff988d-7489-4704-9268-d351740a8d2f admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:29.111596 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8b157-a6dc-4df8-8668-c75efacaf045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:29.112284 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8b157-a6dc-4df8-8668-c75efacaf045 service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.112553 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8b157-a6dc-4df8-8668-c75efacaf045 service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.112816 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8b157-a6dc-4df8-8668-c75efacaf045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.123446 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8b157-a6dc-4df8-8668-c75efacaf045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:29.125256 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8b157-a6dc-4df8-8668-c75efacaf045 service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:29.134625 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1432/2875] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:29.427962 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66baddf0-dbf5-41bf-b2c4-901d98fcf49d None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:29.429506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-66baddf0-dbf5-41bf-b2c4-901d98fcf49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:29.442512 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66baddf0-dbf5-41bf-b2c4-901d98fcf49d None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:29.447732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0e34c-f43a-482c-99f7-e2e682a70ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:29.448946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e34c-f43a-482c-99f7-e2e682a70ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.448946 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e34c-f43a-482c-99f7-e2e682a70ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.449178 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e34c-f43a-482c-99f7-e2e682a70ae6 admin admin] PATH_INFO: `/v3/projects/daa7c3ad387a4fd5b31a0e38d003f216` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.450237 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0e34c-f43a-482c-99f7-e2e682a70ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa7c3ad387a4fd5b31a0e38d003f216)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:29.452143 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0e34c-f43a-482c-99f7-e2e682a70ae6 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:29.510298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-71f0e34c-f43a-482c-99f7-e2e682a70ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa7c3ad387a4fd5b31a0e38d003f216', 'request_id': 'req-71f0e34c-f43a-482c-99f7-e2e682a70ae6'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:29.520977 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-71f0e34c-f43a-482c-99f7-e2e682a70ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa7c3ad387a4fd5b31a0e38d003f216', 'request_id': 'req-71f0e34c-f43a-482c-99f7-e2e682a70ae6'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:29.529239 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-71f0e34c-f43a-482c-99f7-e2e682a70ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa7c3ad387a4fd5b31a0e38d003f216', 'request_id': 'req-71f0e34c-f43a-482c-99f7-e2e682a70ae6'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:29.542638 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-71f0e34c-f43a-482c-99f7-e2e682a70ae6 admin admin] The token cache is being invalidate because project daa7c3ad387a4fd5b31a0e38d003f216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:29.542894 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-71f0e34c-f43a-482c-99f7-e2e682a70ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:29.543654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-71f0e34c-f43a-482c-99f7-e2e682a70ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:29.545528 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1444/2876] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:29 2022] DELETE /identity/v3/projects/daa7c3ad387a4fd5b31a0e38d003f216 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:29.551022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0e777-2203-412c-95f7-41efaaa91cd7 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.551602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0e777-2203-412c-95f7-41efaaa91cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.551602 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0e777-2203-412c-95f7-41efaaa91cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.560810 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:29.576044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-acb0e777-2203-412c-95f7-41efaaa91cd7 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:29.578158 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-acb0e777-2203-412c-95f7-41efaaa91cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:29.647752 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1433/2877] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:29.656826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbca26-ce10-446e-9a5b-6e05f49f26c5 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.657357 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbca26-ce10-446e-9a5b-6e05f49f26c5 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.657865 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbca26-ce10-446e-9a5b-6e05f49f26c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.679131 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-b6fbca26-ce10-446e-9a5b-6e05f49f26c5 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:29.680545 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b6fbca26-ce10-446e-9a5b-6e05f49f26c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:29.689583 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1445/2878] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:29.694630 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0e777-2203-412c-95f7-41efaaa91cd7 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:29.708491 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0e777-2203-412c-95f7-41efaaa91cd7 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:29.714662 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09919cd-8ad1-4bdd-8fc8-1a17fdfa0584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:29.715271 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09919cd-8ad1-4bdd-8fc8-1a17fdfa0584 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.715542 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09919cd-8ad1-4bdd-8fc8-1a17fdfa0584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.715807 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09919cd-8ad1-4bdd-8fc8-1a17fdfa0584 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.716456 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09919cd-8ad1-4bdd-8fc8-1a17fdfa0584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:29.716756 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09919cd-8ad1-4bdd-8fc8-1a17fdfa0584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:29.718394 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09919cd-8ad1-4bdd-8fc8-1a17fdfa0584 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:29.730791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1434/2879] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:29.736983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbca26-ce10-446e-9a5b-6e05f49f26c5 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:29.747144 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbca26-ce10-446e-9a5b-6e05f49f26c5 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:29.753662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a573b-5af9-444f-aeb0-839b2ecbab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:29.754266 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a573b-5af9-444f-aeb0-839b2ecbab6d admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.754538 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a573b-5af9-444f-aeb0-839b2ecbab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.754833 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a573b-5af9-444f-aeb0-839b2ecbab6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.755463 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a573b-5af9-444f-aeb0-839b2ecbab6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:29.757399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a573b-5af9-444f-aeb0-839b2ecbab6d admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:29.790308 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1446/2880] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:29 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:29.794813 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09919cd-8ad1-4bdd-8fc8-1a17fdfa0584 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:29.805582 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09919cd-8ad1-4bdd-8fc8-1a17fdfa0584 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:29.863031 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620678ce-18e2-4a05-b17e-3bc5644a016e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:29.863637 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620678ce-18e2-4a05-b17e-3bc5644a016e admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.863909 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620678ce-18e2-4a05-b17e-3bc5644a016e admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.864174 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620678ce-18e2-4a05-b17e-3bc5644a016e admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.864812 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620678ce-18e2-4a05-b17e-3bc5644a016e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:29.866751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620678ce-18e2-4a05-b17e-3bc5644a016e admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:29.889159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1435/2881] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:29 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:29.893522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a573b-5af9-444f-aeb0-839b2ecbab6d admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:29.904406 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a573b-5af9-444f-aeb0-839b2ecbab6d admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:29.909827 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c68fa-4862-4277-8ab1-5b44f0f2beea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:29.910426 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c68fa-4862-4277-8ab1-5b44f0f2beea admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.910702 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c68fa-4862-4277-8ab1-5b44f0f2beea admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.910971 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c68fa-4862-4277-8ab1-5b44f0f2beea admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.911608 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c68fa-4862-4277-8ab1-5b44f0f2beea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:29.913198 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c68fa-4862-4277-8ab1-5b44f0f2beea admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:29.923338 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1447/2882] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:29.927298 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620678ce-18e2-4a05-b17e-3bc5644a016e admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:29.938129 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620678ce-18e2-4a05-b17e-3bc5644a016e admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:29.943454 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f090e-34a6-47b1-8058-fc989ffea5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:29.944043 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f090e-34a6-47b1-8058-fc989ffea5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.944312 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f090e-34a6-47b1-8058-fc989ffea5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.944560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f090e-34a6-47b1-8058-fc989ffea5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.945195 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f090e-34a6-47b1-8058-fc989ffea5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:29.946791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f090e-34a6-47b1-8058-fc989ffea5e6 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:29.957859 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1436/2883] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:29.962264 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c68fa-4862-4277-8ab1-5b44f0f2beea admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:29.975375 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c68fa-4862-4277-8ab1-5b44f0f2beea admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:29.981043 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901f448-7d4b-4d68-ac79-7bddb16a0ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:29.981727 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901f448-7d4b-4d68-ac79-7bddb16a0ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.982005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901f448-7d4b-4d68-ac79-7bddb16a0ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.982275 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901f448-7d4b-4d68-ac79-7bddb16a0ad4 admin admin] PATH_INFO: `/v3/projects/07629a038cff4975ab7dd0935d175fa2/users/c3c0e6946a264bebac71a7d46f39ad8e/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.998205 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901f448-7d4b-4d68-ac79-7bddb16a0ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07629a038cff4975ab7dd0935d175fa2, user_id=c3c0e6946a264bebac71a7d46f39ad8e, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:30.001077 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901f448-7d4b-4d68-ac79-7bddb16a0ad4 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:30.021430 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1448/2884] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:29 2022] PUT /identity/v3/projects/07629a038cff4975ab7dd0935d175fa2/users/c3c0e6946a264bebac71a7d46f39ad8e/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:30.035405 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c10652-62c4-4ab0-9e36-f7429ed5b4aa None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:30.035678 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c10652-62c4-4ab0-9e36-f7429ed5b4aa None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:30.035938 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c10652-62c4-4ab0-9e36-f7429ed5b4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:30.064939 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-84c10652-62c4-4ab0-9e36-f7429ed5b4aa None None] MFA Rules not processed for user `c3c0e6946a264bebac71a7d46f39ad8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:30.066108 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-84c10652-62c4-4ab0-9e36-f7429ed5b4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:30.135297 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:30.142266 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1437/2885] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:30.153756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901f448-7d4b-4d68-ac79-7bddb16a0ad4 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:30.155598 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-f901f448-7d4b-4d68-ac79-7bddb16a0ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:30.215321 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901f448-7d4b-4d68-ac79-7bddb16a0ad4 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:30.219230 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc01771-07bf-46a5-824d-20e36ddc1058 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd967a3fa32ef48b68c9e3a174f0c9a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:30.219898 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc01771-07bf-46a5-824d-20e36ddc1058 service glance] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:30.220238 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc01771-07bf-46a5-824d-20e36ddc1058 service glance] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:30.220436 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc01771-07bf-46a5-824d-20e36ddc1058 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:30.229194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc01771-07bf-46a5-824d-20e36ddc1058 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:30.230651 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc01771-07bf-46a5-824d-20e36ddc1058 service glance] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:30.235255 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:30.241265 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1449/2886] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:34.146626 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c10652-62c4-4ab0-9e36-f7429ed5b4aa None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:34.148186 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-84c10652-62c4-4ab0-9e36-f7429ed5b4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:34.220097 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c10652-62c4-4ab0-9e36-f7429ed5b4aa None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:34.226360 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:34.227012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:34.227286 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:34.227557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] PATH_INFO: `/v3/users/c5e5714efcca48fcb2e06c8a77d6a1a7` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:34.228726 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e5714efcca48fcb2e06c8a77d6a1a7)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:34.230677 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:34.286821 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e5714efcca48fcb2e06c8a77d6a1a7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.300884 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e5714efcca48fcb2e06c8a77d6a1a7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.301793 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e5714efcca48fcb2e06c8a77d6a1a7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.302445 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e5714efcca48fcb2e06c8a77d6a1a7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.316434 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e5714efcca48fcb2e06c8a77d6a1a7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.330720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1438/2887] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:34 2022] DELETE /identity/v3/users/c5e5714efcca48fcb2e06c8a77d6a1a7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:34.335550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f0bb6-a118-4da1-8ae5-47caca94ebb6 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:34.336056 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f0bb6-a118-4da1-8ae5-47caca94ebb6 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:34.336161 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f0bb6-a118-4da1-8ae5-47caca94ebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:34.357372 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-2e4f0bb6-a118-4da1-8ae5-47caca94ebb6 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:34.358601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2e4f0bb6-a118-4da1-8ae5-47caca94ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:34.424005 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1450/2888] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:34.436666 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:34.438367 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:34.516776 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b02cd-435b-43ce-a9e7-54b4a56366e4 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:34.521128 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d0c78-9eb2-44d2-a12e-d4ca43d8aa6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:34.521768 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d0c78-9eb2-44d2-a12e-d4ca43d8aa6b service neutron] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:34.522034 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d0c78-9eb2-44d2-a12e-d4ca43d8aa6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:34.522296 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d0c78-9eb2-44d2-a12e-d4ca43d8aa6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:34.533036 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d0c78-9eb2-44d2-a12e-d4ca43d8aa6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:34.534614 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d0c78-9eb2-44d2-a12e-d4ca43d8aa6b service neutron] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:34.545714 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1439/2889] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:34.859511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f0bb6-a118-4da1-8ae5-47caca94ebb6 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:34.861004 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-2e4f0bb6-a118-4da1-8ae5-47caca94ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:34.876675 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f0bb6-a118-4da1-8ae5-47caca94ebb6 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:34.884947 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:34.885448 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:34.885752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:34.885945 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] PATH_INFO: `/v3/projects/8a2c70dfe7c54102913fddf4b81807b8` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:34.887193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2c70dfe7c54102913fddf4b81807b8)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:34.889073 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:34.955885 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2c70dfe7c54102913fddf4b81807b8', 'request_id': 'req-c88b8255-6177-4c81-900b-37dbbc5c3814'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.968355 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2c70dfe7c54102913fddf4b81807b8', 'request_id': 'req-c88b8255-6177-4c81-900b-37dbbc5c3814'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.976576 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2c70dfe7c54102913fddf4b81807b8', 'request_id': 'req-c88b8255-6177-4c81-900b-37dbbc5c3814'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.990090 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] The token cache is being invalidate because project 8a2c70dfe7c54102913fddf4b81807b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:34.990404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.991135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.992826 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1451/2890] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:34 2022] DELETE /identity/v3/projects/8a2c70dfe7c54102913fddf4b81807b8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:34.997044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d0c78-9eb2-44d2-a12e-d4ca43d8aa6b service neutron] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:35.006983 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d0c78-9eb2-44d2-a12e-d4ca43d8aa6b service neutron] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:35.026547 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:35.071908 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0253ba-f4f7-462f-b1af-07b3044e31b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:35.072572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0253ba-f4f7-462f-b1af-07b3044e31b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.072842 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0253ba-f4f7-462f-b1af-07b3044e31b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.073247 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0253ba-f4f7-462f-b1af-07b3044e31b1 admin admin] PATH_INFO: `/v3/users/f1e9018fd3f9411588b016b334514029` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.074472 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0253ba-f4f7-462f-b1af-07b3044e31b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e9018fd3f9411588b016b334514029)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:35.076480 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0253ba-f4f7-462f-b1af-07b3044e31b1 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:35.133340 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3c0253ba-f4f7-462f-b1af-07b3044e31b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e9018fd3f9411588b016b334514029'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.153791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3c0253ba-f4f7-462f-b1af-07b3044e31b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e9018fd3f9411588b016b334514029'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.154583 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3c0253ba-f4f7-462f-b1af-07b3044e31b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e9018fd3f9411588b016b334514029'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.155250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3c0253ba-f4f7-462f-b1af-07b3044e31b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e9018fd3f9411588b016b334514029'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.164775 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-3c0253ba-f4f7-462f-b1af-07b3044e31b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e9018fd3f9411588b016b334514029'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.177757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1440/2891] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:34 2022] DELETE /identity/v3/users/f1e9018fd3f9411588b016b334514029 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:35.463550 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:35.465795 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:35.480450 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b8255-6177-4c81-900b-37dbbc5c3814 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:35.550337 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:35.550982 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.551257 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.551522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3 admin admin] PATH_INFO: `/v3/projects/ee803d96097044a6a72f3ca5c304ff7c` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.552797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee803d96097044a6a72f3ca5c304ff7c)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:35.554824 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:35.588569 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:35.615657 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee803d96097044a6a72f3ca5c304ff7c', 'request_id': 'req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.625909 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee803d96097044a6a72f3ca5c304ff7c', 'request_id': 'req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.632752 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee803d96097044a6a72f3ca5c304ff7c', 'request_id': 'req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.646809 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3 admin admin] The token cache is being invalidate because project ee803d96097044a6a72f3ca5c304ff7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:35.647137 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.647797 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-508ebe17-fd6e-4b9f-82e3-7b2e3b39f5f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.649327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1452/2892] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:35 2022] DELETE /identity/v3/projects/ee803d96097044a6a72f3ca5c304ff7c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:35.654429 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665005-1f09-4210-8069-08c88c74e168 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.654706 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665005-1f09-4210-8069-08c88c74e168 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.654977 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665005-1f09-4210-8069-08c88c74e168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.675588 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-09665005-1f09-4210-8069-08c88c74e168 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:35.676732 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-09665005-1f09-4210-8069-08c88c74e168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:35.744381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1441/2893] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:35.753757 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3ec88-db0c-4fe9-93e8-1b7d8e1fcf97 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.754036 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3ec88-db0c-4fe9-93e8-1b7d8e1fcf97 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.754328 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3ec88-db0c-4fe9-93e8-1b7d8e1fcf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.777602 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d2a3ec88-db0c-4fe9-93e8-1b7d8e1fcf97 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:35.778942 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d2a3ec88-db0c-4fe9-93e8-1b7d8e1fcf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:35.788697 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1453/2894] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:35.793381 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665005-1f09-4210-8069-08c88c74e168 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:35.805055 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665005-1f09-4210-8069-08c88c74e168 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:35.810459 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2218046-12a9-4258-956d-e4805982c221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:35.811062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2218046-12a9-4258-956d-e4805982c221 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.811333 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2218046-12a9-4258-956d-e4805982c221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.811598 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2218046-12a9-4258-956d-e4805982c221 admin admin] PATH_INFO: `/v3/domains` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.812250 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2218046-12a9-4258-956d-e4805982c221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:35.812550 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2218046-12a9-4258-956d-e4805982c221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:35.814189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2218046-12a9-4258-956d-e4805982c221 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:35.829918 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1442/2895] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:35.834912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3ec88-db0c-4fe9-93e8-1b7d8e1fcf97 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:35.844500 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3ec88-db0c-4fe9-93e8-1b7d8e1fcf97 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:35.849396 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45a093-da66-4d15-bd48-d64314cafc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:35.849998 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45a093-da66-4d15-bd48-d64314cafc54 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.850278 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45a093-da66-4d15-bd48-d64314cafc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.850547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45a093-da66-4d15-bd48-d64314cafc54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.851192 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45a093-da66-4d15-bd48-d64314cafc54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:35.853085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45a093-da66-4d15-bd48-d64314cafc54 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:35.883883 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1454/2896] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:35 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:35.888326 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2218046-12a9-4258-956d-e4805982c221 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:35.899447 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2218046-12a9-4258-956d-e4805982c221 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:35.927486 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:35.965919 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82d7f2-2db3-4242-8f47-065ed8a944a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:35.966529 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82d7f2-2db3-4242-8f47-065ed8a944a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.966802 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82d7f2-2db3-4242-8f47-065ed8a944a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.967069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82d7f2-2db3-4242-8f47-065ed8a944a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.967716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82d7f2-2db3-4242-8f47-065ed8a944a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:35.969653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82d7f2-2db3-4242-8f47-065ed8a944a1 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:35.993350 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1443/2897] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:35 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:35.998691 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45a093-da66-4d15-bd48-d64314cafc54 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.011877 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45a093-da66-4d15-bd48-d64314cafc54 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.016604 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0c364-4462-4292-b6f8-3cc748740324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.017228 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0c364-4462-4292-b6f8-3cc748740324 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.017506 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0c364-4462-4292-b6f8-3cc748740324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.017773 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0c364-4462-4292-b6f8-3cc748740324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.018416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0c364-4462-4292-b6f8-3cc748740324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.021142 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0c364-4462-4292-b6f8-3cc748740324 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.031543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1455/2898] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:36.036106 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82d7f2-2db3-4242-8f47-065ed8a944a1 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.046971 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82d7f2-2db3-4242-8f47-065ed8a944a1 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.052945 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e590c6-1ac8-49aa-941e-3d957e1be3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.053611 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e590c6-1ac8-49aa-941e-3d957e1be3dc admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.053892 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e590c6-1ac8-49aa-941e-3d957e1be3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.054189 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e590c6-1ac8-49aa-941e-3d957e1be3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.054932 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e590c6-1ac8-49aa-941e-3d957e1be3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.056713 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e590c6-1ac8-49aa-941e-3d957e1be3dc admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.067762 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1444/2899] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:36.072501 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0c364-4462-4292-b6f8-3cc748740324 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.083887 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0c364-4462-4292-b6f8-3cc748740324 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.090219 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28217b-a720-49b5-8ec2-4bfaa09df48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.090920 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28217b-a720-49b5-8ec2-4bfaa09df48b admin admin] REQUEST_METHOD: `PUT` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.091193 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28217b-a720-49b5-8ec2-4bfaa09df48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.091490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28217b-a720-49b5-8ec2-4bfaa09df48b admin admin] PATH_INFO: `/v3/projects/8ec551e1a605494aa85e68a50b359236/users/193c49e6859449408966e2e1131bb120/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.108821 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28217b-a720-49b5-8ec2-4bfaa09df48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec551e1a605494aa85e68a50b359236, user_id=193c49e6859449408966e2e1131bb120, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.111593 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28217b-a720-49b5-8ec2-4bfaa09df48b admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.128854 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1456/2900] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:36 2022] PUT /identity/v3/projects/8ec551e1a605494aa85e68a50b359236/users/193c49e6859449408966e2e1131bb120/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:36.139529 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146e576-a531-44fa-8e2c-96a303514b16 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.139800 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146e576-a531-44fa-8e2c-96a303514b16 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.140070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146e576-a531-44fa-8e2c-96a303514b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.169868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-0146e576-a531-44fa-8e2c-96a303514b16 None None] MFA Rules not processed for user `193c49e6859449408966e2e1131bb120`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:36.171275 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-0146e576-a531-44fa-8e2c-96a303514b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:36.248791 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1445/2901] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:36.254048 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28217b-a720-49b5-8ec2-4bfaa09df48b admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.323419 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28217b-a720-49b5-8ec2-4bfaa09df48b admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.330595 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003111fb-6685-4ca0-a846-77f5b8ef3601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.331600 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003111fb-6685-4ca0-a846-77f5b8ef3601 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.331878 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003111fb-6685-4ca0-a846-77f5b8ef3601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.332135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003111fb-6685-4ca0-a846-77f5b8ef3601 admin admin] PATH_INFO: `/v3/projects` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.332784 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003111fb-6685-4ca0-a846-77f5b8ef3601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.334723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003111fb-6685-4ca0-a846-77f5b8ef3601 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.366026 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1457/2902] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:36 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:36.370481 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146e576-a531-44fa-8e2c-96a303514b16 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.382836 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146e576-a531-44fa-8e2c-96a303514b16 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.451468 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eed6e1-10c7-4b01-b2de-f9094dfb131b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.452107 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eed6e1-10c7-4b01-b2de-f9094dfb131b admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.452366 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eed6e1-10c7-4b01-b2de-f9094dfb131b admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.452630 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eed6e1-10c7-4b01-b2de-f9094dfb131b admin admin] PATH_INFO: `/v3/users` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.453306 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eed6e1-10c7-4b01-b2de-f9094dfb131b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.455278 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eed6e1-10c7-4b01-b2de-f9094dfb131b admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.482073 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1446/2903] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:36 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:36.486473 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003111fb-6685-4ca0-a846-77f5b8ef3601 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.497858 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003111fb-6685-4ca0-a846-77f5b8ef3601 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.502920 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755267c8-9af4-47f2-ab01-50f9c539b716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.503476 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755267c8-9af4-47f2-ab01-50f9c539b716 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.503787 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755267c8-9af4-47f2-ab01-50f9c539b716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.504222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755267c8-9af4-47f2-ab01-50f9c539b716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.504901 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755267c8-9af4-47f2-ab01-50f9c539b716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.506366 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755267c8-9af4-47f2-ab01-50f9c539b716 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.518042 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1458/2904] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:36.522752 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eed6e1-10c7-4b01-b2de-f9094dfb131b admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.533462 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eed6e1-10c7-4b01-b2de-f9094dfb131b admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.539209 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649506cc-235d-4dd4-812c-6e544f7327d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.540044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649506cc-235d-4dd4-812c-6e544f7327d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.540268 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649506cc-235d-4dd4-812c-6e544f7327d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.540566 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649506cc-235d-4dd4-812c-6e544f7327d7 admin admin] PATH_INFO: `/v3/projects/326f9cd2d2cf4336a566546eddaa9359/users/1a6111edfff446ccb7d1e7b265370924/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.557230 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649506cc-235d-4dd4-812c-6e544f7327d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=326f9cd2d2cf4336a566546eddaa9359, user_id=1a6111edfff446ccb7d1e7b265370924, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.560062 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649506cc-235d-4dd4-812c-6e544f7327d7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.575188 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1447/2905] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:36 2022] PUT /identity/v3/projects/326f9cd2d2cf4336a566546eddaa9359/users/1a6111edfff446ccb7d1e7b265370924/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:36.579468 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755267c8-9af4-47f2-ab01-50f9c539b716 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.591311 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755267c8-9af4-47f2-ab01-50f9c539b716 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.614594 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:36.663366 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cea51-6434-4cc1-b602-843a60f60bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.663983 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cea51-6434-4cc1-b602-843a60f60bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.664263 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cea51-6434-4cc1-b602-843a60f60bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.664521 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cea51-6434-4cc1-b602-843a60f60bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.665164 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cea51-6434-4cc1-b602-843a60f60bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.666949 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cea51-6434-4cc1-b602-843a60f60bb1 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.678416 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1459/2906] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:36.684306 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649506cc-235d-4dd4-812c-6e544f7327d7 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.690119 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:36.696061 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649506cc-235d-4dd4-812c-6e544f7327d7 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.701916 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d4cd5-d294-4400-b904-315eee87d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.702617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d4cd5-d294-4400-b904-315eee87d647 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.703063 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d4cd5-d294-4400-b904-315eee87d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.703450 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d4cd5-d294-4400-b904-315eee87d647 admin admin] PATH_INFO: `/v3/projects/326f9cd2d2cf4336a566546eddaa9359/users/1a6111edfff446ccb7d1e7b265370924/roles/9aeb65f617f04008b419583f1e3ccb55` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.706030 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d4cd5-d294-4400-b904-315eee87d647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=326f9cd2d2cf4336a566546eddaa9359, user_id=1a6111edfff446ccb7d1e7b265370924, role_id=9aeb65f617f04008b419583f1e3ccb55)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.709300 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d4cd5-d294-4400-b904-315eee87d647 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.722176 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1448/2907] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:36 2022] PUT /identity/v3/projects/326f9cd2d2cf4336a566546eddaa9359/users/1a6111edfff446ccb7d1e7b265370924/roles/9aeb65f617f04008b419583f1e3ccb55 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:36.733849 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0540225-de14-447b-877b-d851f6407e7f None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.734131 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0540225-de14-447b-877b-d851f6407e7f None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.734431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0540225-de14-447b-877b-d851f6407e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.765387 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-d0540225-de14-447b-877b-d851f6407e7f None None] MFA Rules not processed for user `1a6111edfff446ccb7d1e7b265370924`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:36.766617 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-d0540225-de14-447b-877b-d851f6407e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:36.854662 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1460/2908] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:36.928778 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d4cd5-d294-4400-b904-315eee87d647 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.931359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f84d4cd5-d294-4400-b904-315eee87d647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:37.003933 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d4cd5-d294-4400-b904-315eee87d647 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:37.008627 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b71a4-ee00-4cea-8f53-9a067f25d363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:37.009384 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b71a4-ee00-4cea-8f53-9a067f25d363 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:37.009604 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b71a4-ee00-4cea-8f53-9a067f25d363 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:37.009894 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b71a4-ee00-4cea-8f53-9a067f25d363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:37.020170 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b71a4-ee00-4cea-8f53-9a067f25d363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:37.021558 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b71a4-ee00-4cea-8f53-9a067f25d363 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:37.032123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1449/2909] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:37.691278 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0540225-de14-447b-877b-d851f6407e7f None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:37.759679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0540225-de14-447b-877b-d851f6407e7f None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:37.764803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:37.765496 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:37.765775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:37.766046 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] PATH_INFO: `/v3/users/193c49e6859449408966e2e1131bb120` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:37.767247 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=193c49e6859449408966e2e1131bb120)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:37.769517 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:37.822035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193c49e6859449408966e2e1131bb120'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:37.823634 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:37.831311 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193c49e6859449408966e2e1131bb120'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:37.832222 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193c49e6859449408966e2e1131bb120'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:37.839679 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193c49e6859449408966e2e1131bb120'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:37.853108 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193c49e6859449408966e2e1131bb120'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:37.859487 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1461/2910] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:37 2022] DELETE /identity/v3/users/193c49e6859449408966e2e1131bb120 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:37.864237 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e918c71-2901-402d-8c2b-9f75f0668269 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:37.864748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e918c71-2901-402d-8c2b-9f75f0668269 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:37.864748 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e918c71-2901-402d-8c2b-9f75f0668269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:37.884858 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-1e918c71-2901-402d-8c2b-9f75f0668269 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:37.886427 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1e918c71-2901-402d-8c2b-9f75f0668269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:37.951027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1450/2911] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:37.961931 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:37.964298 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:38.028439 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f806e-0c80-41d0-928a-ec994250e4c3 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:38.032527 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459d86c-9bef-4352-b541-5bf1f504863f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:38.033140 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459d86c-9bef-4352-b541-5bf1f504863f service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:38.033446 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459d86c-9bef-4352-b541-5bf1f504863f service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:38.033716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459d86c-9bef-4352-b541-5bf1f504863f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:38.043699 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459d86c-9bef-4352-b541-5bf1f504863f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:38.045109 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459d86c-9bef-4352-b541-5bf1f504863f service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:38.054911 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1462/2912] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:38.351228 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e918c71-2901-402d-8c2b-9f75f0668269 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:38.352757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-1e918c71-2901-402d-8c2b-9f75f0668269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:38.365033 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e918c71-2901-402d-8c2b-9f75f0668269 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:38.374070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:38.374070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:38.374070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:38.374070 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] PATH_INFO: `/v3/projects/8ec551e1a605494aa85e68a50b359236` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:38.375512 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec551e1a605494aa85e68a50b359236)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:38.377536 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:38.429077 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec551e1a605494aa85e68a50b359236', 'request_id': 'req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.438028 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec551e1a605494aa85e68a50b359236', 'request_id': 'req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.445048 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec551e1a605494aa85e68a50b359236', 'request_id': 'req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.466979 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] The token cache is being invalidate because project 8ec551e1a605494aa85e68a50b359236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:38.467348 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.468223 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.469869 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1451/2913] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:38 2022] DELETE /identity/v3/projects/8ec551e1a605494aa85e68a50b359236 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:38.474447 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459d86c-9bef-4352-b541-5bf1f504863f service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:38.484477 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459d86c-9bef-4352-b541-5bf1f504863f service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:38.543927 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:38.544601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:38.544928 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:38.545139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] PATH_INFO: `/v3/users/1a6111edfff446ccb7d1e7b265370924` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:38.546365 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a6111edfff446ccb7d1e7b265370924)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:38.548390 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:38.601647 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a6111edfff446ccb7d1e7b265370924'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.610985 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a6111edfff446ccb7d1e7b265370924'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.611597 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a6111edfff446ccb7d1e7b265370924'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.618683 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a6111edfff446ccb7d1e7b265370924'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.623984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:38.633867 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a6111edfff446ccb7d1e7b265370924'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.640781 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1463/2914] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:38 2022] DELETE /identity/v3/users/1a6111edfff446ccb7d1e7b265370924 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:38.931148 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:38.932628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:38.947066 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd407cf-bfe0-47a7-a88f-6cf6c5aa9f9c admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:38.964505 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:39.023273 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:39.023906 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:39.024185 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:39.024449 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83 admin admin] PATH_INFO: `/v3/projects/326f9cd2d2cf4336a566546eddaa9359` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:39.025641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=326f9cd2d2cf4336a566546eddaa9359)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:39.027554 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:39.077517 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '326f9cd2d2cf4336a566546eddaa9359', 'request_id': 'req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:39.089953 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '326f9cd2d2cf4336a566546eddaa9359', 'request_id': 'req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:39.097815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '326f9cd2d2cf4336a566546eddaa9359', 'request_id': 'req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:39.110401 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83 admin admin] The token cache is being invalidate because project 326f9cd2d2cf4336a566546eddaa9359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:39.110687 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:39.111435 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-c720a7ac-3cae-4dc9-ab79-627b1a4b1d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:39.113012 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1452/2915] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:38 2022] DELETE /identity/v3/projects/326f9cd2d2cf4336a566546eddaa9359 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:48.636916 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=5,keystone:DELETE=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:49.106951 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:55.201352 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.203178 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:55.217041 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe17de6-6313-4285-8b2d-172691e20f71 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.281967 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.282641 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.282917 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.283176 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] PATH_INFO: `/v3/users/c3c0e6946a264bebac71a7d46f39ad8e` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.284402 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c0e6946a264bebac71a7d46f39ad8e)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.286327 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.336553 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c0e6946a264bebac71a7d46f39ad8e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.345407 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c0e6946a264bebac71a7d46f39ad8e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.345935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c0e6946a264bebac71a7d46f39ad8e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.352926 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c0e6946a264bebac71a7d46f39ad8e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.364587 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c0e6946a264bebac71a7d46f39ad8e'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.370363 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1464/2916] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:55 2022] DELETE /identity/v3/users/c3c0e6946a264bebac71a7d46f39ad8e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:55.377320 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a683189-5458-4c0f-99b5-655c303cd0e8 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.377798 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a683189-5458-4c0f-99b5-655c303cd0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.377920 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a683189-5458-4c0f-99b5-655c303cd0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.406653 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-6a683189-5458-4c0f-99b5-655c303cd0e8 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:55.407897 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6a683189-5458-4c0f-99b5-655c303cd0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:55.472027 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1453/2917] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:55.482049 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.483663 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:55.544654 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5000a0-5d74-4de7-b0bd-5df16041799f admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.548906 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2568651-1f17-4f90-b139-480af63ec739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.549547 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568651-1f17-4f90-b139-480af63ec739 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.549808 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568651-1f17-4f90-b139-480af63ec739 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.550069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568651-1f17-4f90-b139-480af63ec739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.560635 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2568651-1f17-4f90-b139-480af63ec739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.562174 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2568651-1f17-4f90-b139-480af63ec739 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.571993 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1465/2918] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:55.872020 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a683189-5458-4c0f-99b5-655c303cd0e8 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.873718 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-6a683189-5458-4c0f-99b5-655c303cd0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:55.888371 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a683189-5458-4c0f-99b5-655c303cd0e8 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.893757 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffa3ee-b729-4f66-a2bb-b20f01255f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.894410 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffa3ee-b729-4f66-a2bb-b20f01255f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.895712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffa3ee-b729-4f66-a2bb-b20f01255f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.895712 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffa3ee-b729-4f66-a2bb-b20f01255f89 admin admin] PATH_INFO: `/v3/projects/07629a038cff4975ab7dd0935d175fa2` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.896535 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffa3ee-b729-4f66-a2bb-b20f01255f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07629a038cff4975ab7dd0935d175fa2)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.898536 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffa3ee-b729-4f66-a2bb-b20f01255f89 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.947773 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-33ffa3ee-b729-4f66-a2bb-b20f01255f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07629a038cff4975ab7dd0935d175fa2', 'request_id': 'req-33ffa3ee-b729-4f66-a2bb-b20f01255f89'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.956846 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-33ffa3ee-b729-4f66-a2bb-b20f01255f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07629a038cff4975ab7dd0935d175fa2', 'request_id': 'req-33ffa3ee-b729-4f66-a2bb-b20f01255f89'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.963088 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-33ffa3ee-b729-4f66-a2bb-b20f01255f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07629a038cff4975ab7dd0935d175fa2', 'request_id': 'req-33ffa3ee-b729-4f66-a2bb-b20f01255f89'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.973567 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-33ffa3ee-b729-4f66-a2bb-b20f01255f89 admin admin] The token cache is being invalidate because project 07629a038cff4975ab7dd0935d175fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:55.973852 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-33ffa3ee-b729-4f66-a2bb-b20f01255f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.974489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-33ffa3ee-b729-4f66-a2bb-b20f01255f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.975988 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1454/2919] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:55 2022] DELETE /identity/v3/projects/07629a038cff4975ab7dd0935d175fa2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:55.981708 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60163382-4c7f-41c9-bc41-17d2f7d0e82a None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.981990 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60163382-4c7f-41c9-bc41-17d2f7d0e82a None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.982262 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60163382-4c7f-41c9-bc41-17d2f7d0e82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.002343 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-60163382-4c7f-41c9-bc41-17d2f7d0e82a None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:56.003560 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-60163382-4c7f-41c9-bc41-17d2f7d0e82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:56.022399 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:56.067135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1466/2920] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:56.082016 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245975be-968c-4dac-84b4-48311c9407be None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.082374 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245975be-968c-4dac-84b4-48311c9407be None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.082751 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245975be-968c-4dac-84b4-48311c9407be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.106675 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-245975be-968c-4dac-84b4-48311c9407be None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:56.107873 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-245975be-968c-4dac-84b4-48311c9407be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:56.117330 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1455/2921] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:56.123847 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60163382-4c7f-41c9-bc41-17d2f7d0e82a None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.134325 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60163382-4c7f-41c9-bc41-17d2f7d0e82a None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.139762 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c09ede-cef0-4902-82a4-296bb6ee8a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.140464 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c09ede-cef0-4902-82a4-296bb6ee8a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.140716 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c09ede-cef0-4902-82a4-296bb6ee8a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.141052 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c09ede-cef0-4902-82a4-296bb6ee8a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.141765 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c09ede-cef0-4902-82a4-296bb6ee8a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:56.142058 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c09ede-cef0-4902-82a4-296bb6ee8a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.143694 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c09ede-cef0-4902-82a4-296bb6ee8a3f admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.157834 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1467/2922] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:56.162397 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245975be-968c-4dac-84b4-48311c9407be None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.172572 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245975be-968c-4dac-84b4-48311c9407be None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.178354 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415bee1-d999-4711-b545-69b8576008df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.178954 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415bee1-d999-4711-b545-69b8576008df admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.179224 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415bee1-d999-4711-b545-69b8576008df admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.179489 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415bee1-d999-4711-b545-69b8576008df admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.180122 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415bee1-d999-4711-b545-69b8576008df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.182076 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415bee1-d999-4711-b545-69b8576008df admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.212308 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1456/2923] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:56 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:56.216763 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c09ede-cef0-4902-82a4-296bb6ee8a3f admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.227035 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c09ede-cef0-4902-82a4-296bb6ee8a3f admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.286843 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fddc1-0121-41b1-828a-511e08b11172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.287449 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fddc1-0121-41b1-828a-511e08b11172 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.287723 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fddc1-0121-41b1-828a-511e08b11172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.288009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fddc1-0121-41b1-828a-511e08b11172 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.288667 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fddc1-0121-41b1-828a-511e08b11172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.290636 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fddc1-0121-41b1-828a-511e08b11172 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.316208 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1468/2924] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:56 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:56.320603 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415bee1-d999-4711-b545-69b8576008df admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.331957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415bee1-d999-4711-b545-69b8576008df admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.337357 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf9034-0e25-48ef-b322-210b9d315cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.337957 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf9034-0e25-48ef-b322-210b9d315cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.338225 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf9034-0e25-48ef-b322-210b9d315cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.338488 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf9034-0e25-48ef-b322-210b9d315cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.339126 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf9034-0e25-48ef-b322-210b9d315cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.340825 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf9034-0e25-48ef-b322-210b9d315cb9 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.351647 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1457/2925] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:56.356490 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fddc1-0121-41b1-828a-511e08b11172 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.371068 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fddc1-0121-41b1-828a-511e08b11172 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.376789 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48321a42-ff7a-4da7-b101-b9b1bcf8de04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.377415 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48321a42-ff7a-4da7-b101-b9b1bcf8de04 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.377684 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48321a42-ff7a-4da7-b101-b9b1bcf8de04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.377948 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48321a42-ff7a-4da7-b101-b9b1bcf8de04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.378578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48321a42-ff7a-4da7-b101-b9b1bcf8de04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.380166 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48321a42-ff7a-4da7-b101-b9b1bcf8de04 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.391147 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1469/2926] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:56.395797 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf9034-0e25-48ef-b322-210b9d315cb9 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.406628 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf9034-0e25-48ef-b322-210b9d315cb9 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.412448 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adeb929-998b-4d3e-be8f-1684c9505081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.413133 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adeb929-998b-4d3e-be8f-1684c9505081 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.413438 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adeb929-998b-4d3e-be8f-1684c9505081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.413710 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adeb929-998b-4d3e-be8f-1684c9505081 admin admin] PATH_INFO: `/v3/projects/1279c6549ac646c8a335f386884e6955/users/ea4bd84af87047ac99f91f8eb164fcd6/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.429069 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adeb929-998b-4d3e-be8f-1684c9505081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1279c6549ac646c8a335f386884e6955, user_id=ea4bd84af87047ac99f91f8eb164fcd6, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.431761 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adeb929-998b-4d3e-be8f-1684c9505081 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.447333 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1458/2927] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:56 2022] PUT /identity/v3/projects/1279c6549ac646c8a335f386884e6955/users/ea4bd84af87047ac99f91f8eb164fcd6/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:56.458793 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999cf71-73f3-40bc-aefe-a092a2bc778b None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.459069 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999cf71-73f3-40bc-aefe-a092a2bc778b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.459355 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999cf71-73f3-40bc-aefe-a092a2bc778b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.488735 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-6999cf71-73f3-40bc-aefe-a092a2bc778b None None] MFA Rules not processed for user `ea4bd84af87047ac99f91f8eb164fcd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:56.489957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-6999cf71-73f3-40bc-aefe-a092a2bc778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:56.567776 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1470/2928] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:26:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:56.581085 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adeb929-998b-4d3e-be8f-1684c9505081 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.583343 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-2adeb929-998b-4d3e-be8f-1684c9505081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:56.611435 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:56.650739 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adeb929-998b-4d3e-be8f-1684c9505081 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.655022 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e5dd9-b0a9-4aa9-8671-96c80437b6fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.655617 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e5dd9-b0a9-4aa9-8671-96c80437b6fa service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.655888 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e5dd9-b0a9-4aa9-8671-96c80437b6fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.656159 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e5dd9-b0a9-4aa9-8671-96c80437b6fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.665337 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e5dd9-b0a9-4aa9-8671-96c80437b6fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.666765 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e5dd9-b0a9-4aa9-8671-96c80437b6fa service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.676982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1459/2929] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:06.562153 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:06.672764 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=17 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:07.077544 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999cf71-73f3-40bc-aefe-a092a2bc778b None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.144204 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999cf71-73f3-40bc-aefe-a092a2bc778b None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.149566 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.150194 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.150507 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.150803 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] PATH_INFO: `/v3/users/ea4bd84af87047ac99f91f8eb164fcd6` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.151984 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea4bd84af87047ac99f91f8eb164fcd6)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.153935 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.204970 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea4bd84af87047ac99f91f8eb164fcd6'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.214457 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea4bd84af87047ac99f91f8eb164fcd6'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.215135 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea4bd84af87047ac99f91f8eb164fcd6'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.231497 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea4bd84af87047ac99f91f8eb164fcd6'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.245724 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea4bd84af87047ac99f91f8eb164fcd6'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.252303 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1471/2930] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:07 2022] DELETE /identity/v3/users/ea4bd84af87047ac99f91f8eb164fcd6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:07.257847 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5a4f3-aa04-46c5-a52d-94cb10c18d64 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.258201 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5a4f3-aa04-46c5-a52d-94cb10c18d64 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.258535 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5a4f3-aa04-46c5-a52d-94cb10c18d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.287722 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-8eb5a4f3-aa04-46c5-a52d-94cb10c18d64 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:07.289187 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8eb5a4f3-aa04-46c5-a52d-94cb10c18d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.363848 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1460/2931] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:07.376203 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.378731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.448607 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ec890-05f4-433c-bb50-a256954e1c14 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.452957 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddfd96-6553-480e-992f-1af4175beb49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.453601 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddfd96-6553-480e-992f-1af4175beb49 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.453875 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddfd96-6553-480e-992f-1af4175beb49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.454140 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddfd96-6553-480e-992f-1af4175beb49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.463912 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddfd96-6553-480e-992f-1af4175beb49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.465373 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddfd96-6553-480e-992f-1af4175beb49 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.475381 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1472/2932] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:07.763851 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5a4f3-aa04-46c5-a52d-94cb10c18d64 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.765431 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-8eb5a4f3-aa04-46c5-a52d-94cb10c18d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.778007 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5a4f3-aa04-46c5-a52d-94cb10c18d64 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.784902 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486f841-520b-45cb-8dfe-954f8318e1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.785557 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486f841-520b-45cb-8dfe-954f8318e1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.785817 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486f841-520b-45cb-8dfe-954f8318e1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.786136 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486f841-520b-45cb-8dfe-954f8318e1d9 admin admin] PATH_INFO: `/v3/projects/1279c6549ac646c8a335f386884e6955` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.787506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486f841-520b-45cb-8dfe-954f8318e1d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1279c6549ac646c8a335f386884e6955)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.789352 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486f841-520b-45cb-8dfe-954f8318e1d9 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.841868 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f486f841-520b-45cb-8dfe-954f8318e1d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1279c6549ac646c8a335f386884e6955', 'request_id': 'req-f486f841-520b-45cb-8dfe-954f8318e1d9'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.850819 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f486f841-520b-45cb-8dfe-954f8318e1d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1279c6549ac646c8a335f386884e6955', 'request_id': 'req-f486f841-520b-45cb-8dfe-954f8318e1d9'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.857080 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f486f841-520b-45cb-8dfe-954f8318e1d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1279c6549ac646c8a335f386884e6955', 'request_id': 'req-f486f841-520b-45cb-8dfe-954f8318e1d9'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.867544 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f486f841-520b-45cb-8dfe-954f8318e1d9 admin admin] The token cache is being invalidate because project 1279c6549ac646c8a335f386884e6955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:07.867893 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f486f841-520b-45cb-8dfe-954f8318e1d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.868478 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-f486f841-520b-45cb-8dfe-954f8318e1d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.870014 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1461/2933] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:07 2022] DELETE /identity/v3/projects/1279c6549ac646c8a335f386884e6955 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:07.874930 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd58a3-846c-49aa-9dd7-8f0911747114 None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.875431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd58a3-846c-49aa-9dd7-8f0911747114 None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.875431 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd58a3-846c-49aa-9dd7-8f0911747114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.895936 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-b0fd58a3-846c-49aa-9dd7-8f0911747114 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:07.897128 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-b0fd58a3-846c-49aa-9dd7-8f0911747114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.920379 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:07.978485 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1473/2934] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:07.989618 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c1b49-aa7e-442b-9715-5911b6354304 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.989900 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c1b49-aa7e-442b-9715-5911b6354304 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.990173 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c1b49-aa7e-442b-9715-5911b6354304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.010443 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-f90c1b49-aa7e-442b-9715-5911b6354304 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:08.011641 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-f90c1b49-aa7e-442b-9715-5911b6354304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:08.021359 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1462/2935] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:08.025861 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd58a3-846c-49aa-9dd7-8f0911747114 None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.036404 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd58a3-846c-49aa-9dd7-8f0911747114 None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.041578 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4711b9-c158-43b9-8bcf-f6812f1e7444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.042167 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4711b9-c158-43b9-8bcf-f6812f1e7444 admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.042445 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4711b9-c158-43b9-8bcf-f6812f1e7444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.042714 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4711b9-c158-43b9-8bcf-f6812f1e7444 admin admin] PATH_INFO: `/v3/domains` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.043364 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4711b9-c158-43b9-8bcf-f6812f1e7444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:08.043670 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4711b9-c158-43b9-8bcf-f6812f1e7444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.045290 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4711b9-c158-43b9-8bcf-f6812f1e7444 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.057363 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1474/2936] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:08.061716 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c1b49-aa7e-442b-9715-5911b6354304 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.071152 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c1b49-aa7e-442b-9715-5911b6354304 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.076248 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d519e3-2a92-4202-b43b-aaf3bd9d1301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.076839 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d519e3-2a92-4202-b43b-aaf3bd9d1301 admin admin] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.077114 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d519e3-2a92-4202-b43b-aaf3bd9d1301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.077413 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d519e3-2a92-4202-b43b-aaf3bd9d1301 admin admin] PATH_INFO: `/v3/projects` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.078044 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d519e3-2a92-4202-b43b-aaf3bd9d1301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.080042 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d519e3-2a92-4202-b43b-aaf3bd9d1301 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.111218 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1463/2937] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:08.115603 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4711b9-c158-43b9-8bcf-f6812f1e7444 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.126254 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4711b9-c158-43b9-8bcf-f6812f1e7444 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.183937 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414793a7-eb55-4caf-bf5c-191dd6985e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.184543 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414793a7-eb55-4caf-bf5c-191dd6985e74 admin admin] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.184818 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414793a7-eb55-4caf-bf5c-191dd6985e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.185085 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414793a7-eb55-4caf-bf5c-191dd6985e74 admin admin] PATH_INFO: `/v3/users` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.185738 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414793a7-eb55-4caf-bf5c-191dd6985e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.187686 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414793a7-eb55-4caf-bf5c-191dd6985e74 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.213047 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1475/2938] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:08.218667 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d519e3-2a92-4202-b43b-aaf3bd9d1301 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.229574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d519e3-2a92-4202-b43b-aaf3bd9d1301 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.234311 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414179b0-035e-49d0-8f13-c13eef38cc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.234889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414179b0-035e-49d0-8f13-c13eef38cc7d admin admin] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.235161 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414179b0-035e-49d0-8f13-c13eef38cc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.235428 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414179b0-035e-49d0-8f13-c13eef38cc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.236324 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414179b0-035e-49d0-8f13-c13eef38cc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.237949 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414179b0-035e-49d0-8f13-c13eef38cc7d admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.247889 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1464/2939] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:08.251932 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414793a7-eb55-4caf-bf5c-191dd6985e74 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.262817 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414793a7-eb55-4caf-bf5c-191dd6985e74 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.269139 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de836f-3966-4bf2-b1e7-a81b013d027a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.269775 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de836f-3966-4bf2-b1e7-a81b013d027a admin admin] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.270051 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de836f-3966-4bf2-b1e7-a81b013d027a admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.270666 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de836f-3966-4bf2-b1e7-a81b013d027a admin admin] PATH_INFO: `/v3/roles` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.271334 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de836f-3966-4bf2-b1e7-a81b013d027a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.272929 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de836f-3966-4bf2-b1e7-a81b013d027a admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.284248 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1476/2940] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:08.288591 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414179b0-035e-49d0-8f13-c13eef38cc7d admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.299119 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414179b0-035e-49d0-8f13-c13eef38cc7d admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.303914 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9974af3-ce3e-48fb-b211-017f138156a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.304568 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9974af3-ce3e-48fb-b211-017f138156a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.304838 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9974af3-ce3e-48fb-b211-017f138156a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.305103 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9974af3-ce3e-48fb-b211-017f138156a3 admin admin] PATH_INFO: `/v3/projects/40506b646e724511890b3fa7a446c67e/users/31ccba4a006a422f91f32bc8495aea69/roles/2dfbdb214b97432588648dba947cb07a` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.321785 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9974af3-ce3e-48fb-b211-017f138156a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40506b646e724511890b3fa7a446c67e, user_id=31ccba4a006a422f91f32bc8495aea69, role_id=2dfbdb214b97432588648dba947cb07a)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.324574 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9974af3-ce3e-48fb-b211-017f138156a3 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.338601 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1465/2941] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:08 2022] PUT /identity/v3/projects/40506b646e724511890b3fa7a446c67e/users/31ccba4a006a422f91f32bc8495aea69/roles/2dfbdb214b97432588648dba947cb07a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:08.407514 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244409f-53f2-4c49-87c5-30abbdaa644b None None] REQUEST_METHOD: `POST` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.407785 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244409f-53f2-4c49-87c5-30abbdaa644b None None] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.408032 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244409f-53f2-4c49-87c5-30abbdaa644b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.437133 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.auth.core [None req-7244409f-53f2-4c49-87c5-30abbdaa644b None None] MFA Rules not processed for user `31ccba4a006a422f91f32bc8495aea69`. Rule list: `[]` (Enabled: `True`). {{(pid=81709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:08.438488 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-7244409f-53f2-4c49-87c5-30abbdaa644b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:08.514432 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1477/2942] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:08.526720 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9974af3-ce3e-48fb-b211-017f138156a3 admin admin] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.528815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-a9974af3-ce3e-48fb-b211-017f138156a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:08.552843 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:08.591707 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9974af3-ce3e-48fb-b211-017f138156a3 admin admin] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.596441 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeea886-e028-4f19-b88d-fb6e1eb8cca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414692e72024816a99d63234f7c233f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.597123 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeea886-e028-4f19-b88d-fb6e1eb8cca0 service cinder] REQUEST_METHOD: `GET` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.597421 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeea886-e028-4f19-b88d-fb6e1eb8cca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.597901 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeea886-e028-4f19-b88d-fb6e1eb8cca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.607506 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeea886-e028-4f19-b88d-fb6e1eb8cca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.609799 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeea886-e028-4f19-b88d-fb6e1eb8cca0 service cinder] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.623956 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1466/2943] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:13.740844 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244409f-53f2-4c49-87c5-30abbdaa644b None None] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:13.767874 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:13.823681 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244409f-53f2-4c49-87c5-30abbdaa644b None None] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:13.829059 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:13.829731 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.830009 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.830278 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] PATH_INFO: `/v3/users/31ccba4a006a422f91f32bc8495aea69` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.831575 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ccba4a006a422f91f32bc8495aea69)` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:13.833585 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:13.900629 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ccba4a006a422f91f32bc8495aea69'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.912511 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ccba4a006a422f91f32bc8495aea69'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.913481 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ccba4a006a422f91f32bc8495aea69'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.923165 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ccba4a006a422f91f32bc8495aea69'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.938810 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.notifications [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ccba4a006a422f91f32bc8495aea69'} {{(pid=81709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.946522 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1478/2944] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:13 2022] DELETE /identity/v3/users/31ccba4a006a422f91f32bc8495aea69 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:13.951283 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e8952-5bd9-482d-8dea-8d280048d8b1 None None] REQUEST_METHOD: `POST` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.951766 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e8952-5bd9-482d-8dea-8d280048d8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.951903 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e8952-5bd9-482d-8dea-8d280048d8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.977621 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.auth.core [None req-563e8952-5bd9-482d-8dea-8d280048d8b1 None None] MFA Rules not processed for user `5c98c93e9a414022917c074607b2165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:13.978766 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-563e8952-5bd9-482d-8dea-8d280048d8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:14.056440 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1467/2945] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 31 00:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:14.066790 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:14.068456 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:14.147447 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8da91-ed45-4111-8b46-7ccf262d4e91 admin admin] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:14.151574 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6345f10-dc4a-449f-bff2-cf15f06f54e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f2b852544b450a86fdcb5fa18fd290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:14.152183 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6345f10-dc4a-449f-bff2-cf15f06f54e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:14.152480 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6345f10-dc4a-449f-bff2-cf15f06f54e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:14.152717 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6345f10-dc4a-449f-bff2-cf15f06f54e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:14.162570 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6345f10-dc4a-449f-bff2-cf15f06f54e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:14.164010 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6345f10-dc4a-449f-bff2-cf15f06f54e6 service neutron] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:14.174720 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1479/2946] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:14.465763 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e8952-5bd9-482d-8dea-8d280048d8b1 None None] Authenticating user token {{(pid=81710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:14.467527 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.fernet_utils [None req-563e8952-5bd9-482d-8dea-8d280048d8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:14.482262 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e8952-5bd9-482d-8dea-8d280048d8b1 None None] Validating token access rules against request {{(pid=81710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:14.488198 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aef04c-2a1d-4b77-9421-5f3f8432aac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c98c93e9a414022917c074607b2165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c418df945e4be9ac1404a45cc7dcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:14.488376 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aef04c-2a1d-4b77-9421-5f3f8432aac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:14.488536 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aef04c-2a1d-4b77-9421-5f3f8432aac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:14.488815 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aef04c-2a1d-4b77-9421-5f3f8432aac7 admin admin] PATH_INFO: `/v3/projects/40506b646e724511890b3fa7a446c67e` {{(pid=81710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:14.490115 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aef04c-2a1d-4b77-9421-5f3f8432aac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40506b646e724511890b3fa7a446c67e)` {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:14.492050 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aef04c-2a1d-4b77-9421-5f3f8432aac7 admin admin] RBAC: Authorization granted {{(pid=81710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:14.543560 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-20aef04c-2a1d-4b77-9421-5f3f8432aac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40506b646e724511890b3fa7a446c67e', 'request_id': 'req-20aef04c-2a1d-4b77-9421-5f3f8432aac7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:14.554982 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-20aef04c-2a1d-4b77-9421-5f3f8432aac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40506b646e724511890b3fa7a446c67e', 'request_id': 'req-20aef04c-2a1d-4b77-9421-5f3f8432aac7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:14.561950 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-20aef04c-2a1d-4b77-9421-5f3f8432aac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40506b646e724511890b3fa7a446c67e', 'request_id': 'req-20aef04c-2a1d-4b77-9421-5f3f8432aac7'} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:14.573071 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-20aef04c-2a1d-4b77-9421-5f3f8432aac7 admin admin] The token cache is being invalidate because project 40506b646e724511890b3fa7a446c67e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81710) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:14.573388 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-20aef04c-2a1d-4b77-9421-5f3f8432aac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:14.574099 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG keystone.notifications [None req-20aef04c-2a1d-4b77-9421-5f3f8432aac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:14.575753 dv-cinder-852209-8-smb devstack@keystone.service[81710]: [pid: 81710|app: 0|req: 1468/2947] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:14 2022] DELETE /identity/v3/projects/40506b646e724511890b3fa7a446c67e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:24.169813 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:24.570145 dv-cinder-852209-8-smb devstack@keystone.service[81710]: DEBUG dbcounter [-] [81710] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81710) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:01.851062 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6345f10-dc4a-449f-bff2-cf15f06f54e6 service neutron] Authenticating user token {{(pid=81709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:01.853149 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-a6345f10-dc4a-449f-bff2-cf15f06f54e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:01.928258 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6345f10-dc4a-449f-bff2-cf15f06f54e6 service neutron] Validating token access rules against request {{(pid=81709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:01.998586 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062020e4-84dc-4ace-847f-1e7c4aedbed5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227f958b82a446e19a4d5b29d74193bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '204574e6a3c34ca4a7c266b5549bfdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:01.999207 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062020e4-84dc-4ace-847f-1e7c4aedbed5 service placement] REQUEST_METHOD: `GET` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:01.999486 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062020e4-84dc-4ace-847f-1e7c4aedbed5 service placement] SCRIPT_NAME: `/identity` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:01.999756 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062020e4-84dc-4ace-847f-1e7c4aedbed5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:02.001732 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.fernet_utils [None req-062020e4-84dc-4ace-847f-1e7c4aedbed5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:02.013510 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062020e4-84dc-4ace-847f-1e7c4aedbed5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:02.015084 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062020e4-84dc-4ace-847f-1e7c4aedbed5 service placement] RBAC: Authorization granted {{(pid=81709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:02.025649 dv-cinder-852209-8-smb devstack@keystone.service[81709]: [pid: 81709|app: 0|req: 1480/2948] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:12.021023 dv-cinder-852209-8-smb devstack@keystone.service[81709]: DEBUG dbcounter [-] [81709] Writing DB stats keystone:SELECT=58 {{(pid=81709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}